apache/dolphinscheduler

[Bug] [workflow define] Bug datax wants to use resource file error

Open

#18,389 创建于 2026年7月2日

在 GitHub 查看
 (1 评论) (0 反应) (0 负责人)Java (4,324 fork)batch import
backendbughelp wanted

仓库指标

Star
 (11,659 star)
PR 合并指标
 (平均合并 2天 21小时) (30 天内合并 22 个 PR)

描述

Search before asking

  • I had searched in the issues and found no similar issues.

What happened

error log

LOG-PATH]: /opt/dolphinscheduler/logs/20260702/177532592572544/6/59/120.log, [HOST]: 169.254.6.3:1234 2026-07-02 16:24:21.478 INFO - 🐬 Initialize Task Context 2026-07-02 16:24:21.480 INFO - Current tenant is default tenant, will use bootstrap user: root to execute the task 2026-07-02 16:24:21.480 INFO - TenantCode: root check successfully 2026-07-02 16:24:21.481 INFO - TaskInstance working directory: /opt/dolphinscheduler/data/exec/process/120 create successfully 2026-07-02 16:24:21.481 INFO - Download resource file /opt/dolphinscheduler/resources/default/resources/std_enterprise_abnormal_dm-doris.json -> /opt/dolphinscheduler/data/exec/process/120/std_enterprise_abnormal_dm-doris.json successfully 2026-07-02 16:24:21.482 INFO - Download resources successfully: ResourceContext(resourceItemMap={/opt/dolphinscheduler/resources/default/resources/std_enterprise_abnormal_dm-doris.json=ResourceContext.ResourceItem(resourceAbsolutePathInStorage=/opt/dolphinscheduler/resources/default/resources/std_enterprise_abnormal_dm-doris.json, resourceAbsolutePathInLocal=/opt/dolphinscheduler/data/exec/process/120/std_enterprise_abnormal_dm-doris.json)}) 2026-07-02 16:24:21.484 INFO - 🐬 Load Task Instance Plugin 2026-07-02 16:24:21.484 INFO - Initialized physicalTask: DATAX successfully 2026-07-02 16:24:21.484 INFO - Initialize datax task params { "localParams" : [ ], "varPool" : [ ], "customConfig" : 1, "json" : "{}", "dsType" : null, "dataSource" : 0, "dtType" : null, "dataTarget" : 0, "sql" : null, "targetTable" : null, "preStatements" : null, "postStatements" : null, "jobSpeedByte" : 0, "jobSpeedRecord" : 0, "jobChannel" : 0, "xms" : 1, "xmx" : 1, "batchSize" : 0, "resourceList" : [ { "id" : null, "resourceName" : "/opt/dolphinscheduler/resources/default/resources/std_enterprise_abnormal_dm-doris.json", "res" : null } ] } 2026-07-02 16:24:21.485 INFO - Set taskVarPool: null successfully 2026-07-02 16:24:21.485 INFO - 🐬 Execute Task Instance 2026-07-02 16:24:21.486 INFO - Final Script Content:

#!/bin/bash BASEDIR=$(cd dirname $0; pwd) cd $BASEDIR export JAVA_HOME=/opt/java/openjdk export PYTHON=/usr/bin/python3 export DATAX_PY=/opt/datax/bin/datax.py export PATH=$JAVA_HOME/bin:$PATH:$PYTHON export PYTHON_LAUNCHER=/usr/bin/python3 export DATAX_LAUNCHER=/opt/datax/bin/datax.py ${PYTHON_LAUNCHER} ${DATAX_LAUNCHER} --jvm="-Xms1G -Xmx1G" -p "-Dsub_time='5' -Dsystem.task.definition.name='std_enterprise_abnormal_dm-doris' -Dsystem.project.name='市级同步-DM-DORIS' -Dsystem.project.code='176377385027712' -Dsystem.workflow.instance.id='59' -Dsystem.biz.curdate='20260702' -Dsystem.biz.date='20260701' -Dsystem.task.instance.id='120' -Dsystem.workflow.definition.name='测试' -Dsystem.task.definition.code='177715282670720' -Dsystem.workflow.definition.code='177532592572544' -Dsystem.datetime='20260702162421'" /opt/dolphinscheduler/data/exec/process/120/120_job.json

2026-07-02 16:24:21.486 INFO - Executing shell command : sudo -u root -i /opt/dolphinscheduler/data/exec/process/120/120.sh 2026-07-02 16:24:21.489 INFO - process start, process id is: 299842 2026-07-02 16:24:21.556 INFO - -> 2026-07-02 16:24:21.562 INFO - -> DataX (DATAX-OPENSOURCE-3.0), From Alibaba ! 2026-07-02 16:24:21.562 INFO - -> Copyright (C) 2010-2017, Alibaba Group. All Rights Reserved. 2026-07-02 16:24:21.562 INFO - -> 2026-07-02 16:24:21.563 INFO - -> 2026-07-02 16:24:22.188 INFO - -> 2026-07-02 16:24:22.186 [main] WARN ConfigParser - 插件[null,null]加载失败,1s后重试... Exception:Code:[Framework-12], Description:[DataX插件初始化错误, 该问题通常是由于DataX安装错误引起,请联系您的运维解决 .]. - 插件加载失败,未完成指定插件加载:[null] 2026-07-02 16:24:23.324 INFO - -> 2026-07-02 16:24:23.324 [main] ERROR Engine - 2026-07-02 16:24:23.325 INFO - -> 2026-07-02 16:24:23.325 INFO - -> 经DataX智能分析,该任务最可能的错误原因是: 2026-07-02 16:24:23.325 INFO - -> com.alibaba.datax.common.exception.DataXException: Code:[Framework-12], Description:[DataX插件初始化错误, 该问题通常是由于DataX安装错误引起,请联系您的运维解决 .]. - 插件加载失败,未完成指定插件加载:[null] 2026-07-02 16:24:23.325 INFO - -> at com.alibaba.datax.common.exception.DataXException.asDataXException(DataXException.java:30) 2026-07-02 16:24:23.325 INFO - -> at com.alibaba.datax.core.util.ConfigParser.parsePluginConfig(ConfigParser.java:142) 2026-07-02 16:24:23.325 INFO - -> at com.alibaba.datax.core.util.ConfigParser.parse(ConfigParser.java:63) 2026-07-02 16:24:23.325 INFO - -> at com.alibaba.datax.core.Engine.entry(Engine.java:131) 2026-07-02 16:24:23.325 INFO - -> at com.alibaba.datax.core.Engine.main(Engine.java:201) 2026-07-02 16:24:23.325 INFO - -> 2026-07-02 16:24:23.362 INFO - process has exited. execute path:/opt/dolphinscheduler/data/exec/process/120, processId:299842 ,exitStatusCode:1 ,processWaitForStatus:true ,processExitValue:1 2026-07-02 16:24:23.564 INFO - 🐬 Finalize Task Instance 2026-07-02 16:24:23.565 INFO - FINALIZE_SESSION 2026-07-02 16:24:23.565 INFO - Deleted task exec directory: /opt/dolphinscheduler/data/exec/process/120

What you expected to happen

JSON can be customized, and JSON can also be referenced via resource files

How to reproduce

When running workflows with the DataX component, there is a custom template where I selected JSON. There is also a resource file at the bottom, and I want DataX to execute the JSON definition contained within this resource file, but an error occurs.

Anything else

No response

Version

3.4.2

Are you willing to submit PR?

  • Yes I am willing to submit a PR!

Code of Conduct

贡献者指南