[Bug] [workflow define] Bug datax wants to use resource file error
#18.389 aperta il 2 lug 2026
Metriche repository
- Star
- (11.659 star)
- Metriche merge PR
- (Merge medio 2g 21h) (22 PR mergiate in 30 g)
Descrizione
Search before asking
- I had searched in the issues and found no similar issues.
What happened
error log
LOG-PATH]: /opt/dolphinscheduler/logs/20260702/177532592572544/6/59/120.log, [HOST]: 169.254.6.3:1234 2026-07-02 16:24:21.478 INFO - 🐬 Initialize Task Context 2026-07-02 16:24:21.480 INFO - Current tenant is default tenant, will use bootstrap user: root to execute the task 2026-07-02 16:24:21.480 INFO - TenantCode: root check successfully 2026-07-02 16:24:21.481 INFO - TaskInstance working directory: /opt/dolphinscheduler/data/exec/process/120 create successfully 2026-07-02 16:24:21.481 INFO - Download resource file /opt/dolphinscheduler/resources/default/resources/std_enterprise_abnormal_dm-doris.json -> /opt/dolphinscheduler/data/exec/process/120/std_enterprise_abnormal_dm-doris.json successfully 2026-07-02 16:24:21.482 INFO - Download resources successfully: ResourceContext(resourceItemMap={/opt/dolphinscheduler/resources/default/resources/std_enterprise_abnormal_dm-doris.json=ResourceContext.ResourceItem(resourceAbsolutePathInStorage=/opt/dolphinscheduler/resources/default/resources/std_enterprise_abnormal_dm-doris.json, resourceAbsolutePathInLocal=/opt/dolphinscheduler/data/exec/process/120/std_enterprise_abnormal_dm-doris.json)}) 2026-07-02 16:24:21.484 INFO - 🐬 Load Task Instance Plugin 2026-07-02 16:24:21.484 INFO - Initialized physicalTask: DATAX successfully 2026-07-02 16:24:21.484 INFO - Initialize datax task params { "localParams" : [ ], "varPool" : [ ], "customConfig" : 1, "json" : "{}", "dsType" : null, "dataSource" : 0, "dtType" : null, "dataTarget" : 0, "sql" : null, "targetTable" : null, "preStatements" : null, "postStatements" : null, "jobSpeedByte" : 0, "jobSpeedRecord" : 0, "jobChannel" : 0, "xms" : 1, "xmx" : 1, "batchSize" : 0, "resourceList" : [ { "id" : null, "resourceName" : "/opt/dolphinscheduler/resources/default/resources/std_enterprise_abnormal_dm-doris.json", "res" : null } ] } 2026-07-02 16:24:21.485 INFO - Set taskVarPool: null successfully 2026-07-02 16:24:21.485 INFO - 🐬 Execute Task Instance 2026-07-02 16:24:21.486 INFO - Final Script Content:
#!/bin/bash
BASEDIR=$(cd dirname $0; pwd)
cd $BASEDIR
export JAVA_HOME=/opt/java/openjdk
export PYTHON=/usr/bin/python3
export DATAX_PY=/opt/datax/bin/datax.py
export PATH=$JAVA_HOME/bin:$PATH:$PYTHON
export PYTHON_LAUNCHER=/usr/bin/python3
export DATAX_LAUNCHER=/opt/datax/bin/datax.py
${PYTHON_LAUNCHER} ${DATAX_LAUNCHER} --jvm="-Xms1G -Xmx1G" -p "-Dsub_time='5' -Dsystem.task.definition.name='std_enterprise_abnormal_dm-doris' -Dsystem.project.name='市级同步-DM-DORIS' -Dsystem.project.code='176377385027712' -Dsystem.workflow.instance.id='59' -Dsystem.biz.curdate='20260702' -Dsystem.biz.date='20260701' -Dsystem.task.instance.id='120' -Dsystem.workflow.definition.name='测试' -Dsystem.task.definition.code='177715282670720' -Dsystem.workflow.definition.code='177532592572544' -Dsystem.datetime='20260702162421'" /opt/dolphinscheduler/data/exec/process/120/120_job.json
2026-07-02 16:24:21.486 INFO - Executing shell command : sudo -u root -i /opt/dolphinscheduler/data/exec/process/120/120.sh 2026-07-02 16:24:21.489 INFO - process start, process id is: 299842 2026-07-02 16:24:21.556 INFO - -> 2026-07-02 16:24:21.562 INFO - -> DataX (DATAX-OPENSOURCE-3.0), From Alibaba ! 2026-07-02 16:24:21.562 INFO - -> Copyright (C) 2010-2017, Alibaba Group. All Rights Reserved. 2026-07-02 16:24:21.562 INFO - -> 2026-07-02 16:24:21.563 INFO - -> 2026-07-02 16:24:22.188 INFO - -> 2026-07-02 16:24:22.186 [main] WARN ConfigParser - 插件[null,null]加载失败,1s后重试... Exception:Code:[Framework-12], Description:[DataX插件初始化错误, 该问题通常是由于DataX安装错误引起,请联系您的运维解决 .]. - 插件加载失败,未完成指定插件加载:[null] 2026-07-02 16:24:23.324 INFO - -> 2026-07-02 16:24:23.324 [main] ERROR Engine - 2026-07-02 16:24:23.325 INFO - -> 2026-07-02 16:24:23.325 INFO - -> 经DataX智能分析,该任务最可能的错误原因是: 2026-07-02 16:24:23.325 INFO - -> com.alibaba.datax.common.exception.DataXException: Code:[Framework-12], Description:[DataX插件初始化错误, 该问题通常是由于DataX安装错误引起,请联系您的运维解决 .]. - 插件加载失败,未完成指定插件加载:[null] 2026-07-02 16:24:23.325 INFO - -> at com.alibaba.datax.common.exception.DataXException.asDataXException(DataXException.java:30) 2026-07-02 16:24:23.325 INFO - -> at com.alibaba.datax.core.util.ConfigParser.parsePluginConfig(ConfigParser.java:142) 2026-07-02 16:24:23.325 INFO - -> at com.alibaba.datax.core.util.ConfigParser.parse(ConfigParser.java:63) 2026-07-02 16:24:23.325 INFO - -> at com.alibaba.datax.core.Engine.entry(Engine.java:131) 2026-07-02 16:24:23.325 INFO - -> at com.alibaba.datax.core.Engine.main(Engine.java:201) 2026-07-02 16:24:23.325 INFO - -> 2026-07-02 16:24:23.362 INFO - process has exited. execute path:/opt/dolphinscheduler/data/exec/process/120, processId:299842 ,exitStatusCode:1 ,processWaitForStatus:true ,processExitValue:1 2026-07-02 16:24:23.564 INFO - 🐬 Finalize Task Instance 2026-07-02 16:24:23.565 INFO - FINALIZE_SESSION 2026-07-02 16:24:23.565 INFO - Deleted task exec directory: /opt/dolphinscheduler/data/exec/process/120
What you expected to happen
JSON can be customized, and JSON can also be referenced via resource files
How to reproduce
When running workflows with the DataX component, there is a custom template where I selected JSON. There is also a resource file at the bottom, and I want DataX to execute the JSON definition contained within this resource file, but an error occurs.
Anything else
No response
Version
3.4.2
Are you willing to submit PR?
- Yes I am willing to submit a PR!
Code of Conduct
- I agree to follow this project's Code of Conduct