[Bug] [workflow define] Datax wants to use resource file error

[happyhope]

Search before asking

• I had searched in the issues and found no similar issues.

What happened

error log

LOG-PATH]: /opt/dolphinscheduler/logs/20260702/177532592572544/6/59/120.log, [HOST]: 169.254.6.3:1234
2026-07-02 16:24:21.478 INFO - 🐬 Initialize Task Context
2026-07-02 16:24:21.480 INFO - Current tenant is default tenant, will use bootstrap user: root to execute the task
2026-07-02 16:24:21.480 INFO - TenantCode: root check successfully
2026-07-02 16:24:21.481 INFO - TaskInstance working directory: /opt/dolphinscheduler/data/exec/process/120 create successfully
2026-07-02 16:24:21.481 INFO - Download resource file /opt/dolphinscheduler/resources/default/resources/std_enterprise_abnormal_dm-doris.json -> /opt/dolphinscheduler/data/exec/process/120/std_enterprise_abnormal_dm-doris.json successfully
2026-07-02 16:24:21.482 INFO - Download resources successfully: ResourceContext(resourceItemMap={/opt/dolphinscheduler/resources/default/resources/std_enterprise_abnormal_dm-doris.json=ResourceContext.ResourceItem(resourceAbsolutePathInStorage=/opt/dolphinscheduler/resources/default/resources/std_enterprise_abnormal_dm-doris.json, resourceAbsolutePathInLocal=/opt/dolphinscheduler/data/exec/process/120/std_enterprise_abnormal_dm-doris.json)})
2026-07-02 16:24:21.484 INFO - 🐬 Load Task Instance Plugin
2026-07-02 16:24:21.484 INFO - Initialized physicalTask: DATAX successfully
2026-07-02 16:24:21.484 INFO - Initialize datax task params {
"localParams" : [ ],
"varPool" : [ ],
"customConfig" : 1,
"json" : "{}",
"dsType" : null,
"dataSource" : 0,
"dtType" : null,
"dataTarget" : 0,
"sql" : null,
"targetTable" : null,
"preStatements" : null,
"postStatements" : null,
"jobSpeedByte" : 0,
"jobSpeedRecord" : 0,
"jobChannel" : 0,
"xms" : 1,
"xmx" : 1,
"batchSize" : 0,
"resourceList" : [ {
"id" : null,
"resourceName" : "/opt/dolphinscheduler/resources/default/resources/std_enterprise_abnormal_dm-doris.json",
"res" : null
} ]
}
2026-07-02 16:24:21.485 INFO - Set taskVarPool: null successfully
2026-07-02 16:24:21.485 INFO - 🐬 Execute Task Instance
2026-07-02 16:24:21.486 INFO - Final Script Content:

#!/bin/bash
BASEDIR=$(cd dirname $0; pwd)
cd $BASEDIR
export JAVA_HOME=/opt/java/openjdk
export PYTHON=/usr/bin/python3
export DATAX_PY=/opt/datax/bin/datax.py
export PATH=$JAVA_HOME/bin:$PATH:$PYTHON
export PYTHON_LAUNCHER=/usr/bin/python3
export DATAX_LAUNCHER=/opt/datax/bin/datax.py
${PYTHON_LAUNCHER} ${DATAX_LAUNCHER} --jvm="-Xms1G -Xmx1G" -p "-Dsub_time='5' -Dsystem.task.definition.name='std_enterprise_abnormal_dm-doris' -Dsystem.project.name='市级同步-DM-DORIS' -Dsystem.project.code='176377385027712' -Dsystem.workflow.instance.id='59' -Dsystem.biz.curdate='20260702' -Dsystem.biz.date='20260701' -Dsystem.task.instance.id='120' -Dsystem.workflow.definition.name='测试' -Dsystem.task.definition.code='177715282670720' -Dsystem.workflow.definition.code='177532592572544' -Dsystem.datetime='20260702162421'" /opt/dolphinscheduler/data/exec/process/120/120_job.json

2026-07-02 16:24:21.486 INFO - Executing shell command : sudo -u root -i /opt/dolphinscheduler/data/exec/process/120/120.sh
2026-07-02 16:24:21.489 INFO - process start, process id is: 299842
2026-07-02 16:24:21.556 INFO - ->
2026-07-02 16:24:21.562 INFO - -> DataX (DATAX-OPENSOURCE-3.0), From Alibaba !
2026-07-02 16:24:21.562 INFO - -> Copyright (C) 2010-2017, Alibaba Group. All Rights Reserved.
2026-07-02 16:24:21.562 INFO - ->
2026-07-02 16:24:21.563 INFO - ->
2026-07-02 16:24:22.188 INFO - -> 2026-07-02 16:24:22.186 [main] WARN ConfigParser - 插件[null,null]加载失败，1s后重试... Exception:Code:[Framework-12], Description:[DataX插件初始化错误, 该问题通常是由于DataX安装错误引起，请联系您的运维解决 .]. - 插件加载失败，未完成指定插件加载:[null]
2026-07-02 16:24:23.324 INFO - -> 2026-07-02 16:24:23.324 [main] ERROR Engine -
2026-07-02 16:24:23.325 INFO - ->
2026-07-02 16:24:23.325 INFO - -> 经DataX智能分析,该任务最可能的错误原因是:
2026-07-02 16:24:23.325 INFO - -> com.alibaba.datax.common.exception.DataXException: Code:[Framework-12], Description:[DataX插件初始化错误, 该问题通常是由于DataX安装错误引起，请联系您的运维解决 .]. - 插件加载失败，未完成指定插件加载:[null]
2026-07-02 16:24:23.325 INFO - -> at com.alibaba.datax.common.exception.DataXException.asDataXException(DataXException.java:30)
2026-07-02 16:24:23.325 INFO - -> at com.alibaba.datax.core.util.ConfigParser.parsePluginConfig(ConfigParser.java:142)
2026-07-02 16:24:23.325 INFO - -> at com.alibaba.datax.core.util.ConfigParser.parse(ConfigParser.java:63)
2026-07-02 16:24:23.325 INFO - -> at com.alibaba.datax.core.Engine.entry(Engine.java:131)
2026-07-02 16:24:23.325 INFO - -> at com.alibaba.datax.core.Engine.main(Engine.java:201)
2026-07-02 16:24:23.325 INFO - ->
2026-07-02 16:24:23.362 INFO - process has exited. execute path:/opt/dolphinscheduler/data/exec/process/120, processId:299842 ,exitStatusCode:1 ,processWaitForStatus:true ,processExitValue:1
2026-07-02 16:24:23.564 INFO - 🐬 Finalize Task Instance
2026-07-02 16:24:23.565 INFO - FINALIZE_SESSION
2026-07-02 16:24:23.565 INFO - Deleted task exec directory: /opt/dolphinscheduler/data/exec/process/120

What you expected to happen

JSON can be customized, and JSON can also be referenced via resource files

How to reproduce

When running workflows with the DataX component, there is a custom template where I selected JSON. There is also a resource file at the bottom, and I want DataX to execute the JSON definition contained within this resource file, but an error occurs.

Anything else

No response

Version

3.4.2

Are you willing to submit PR?

• Yes I am willing to submit a PR!

Code of Conduct

• I agree to follow this project's Code of Conduct

[github-actions]

Search before asking

• I had searched in the issues and found no similar issues.

What happened

error log

LOG-PATH]: /opt/dolphinscheduler/logs/20260702/177532592572544/6/59/120.log, [HOST]: 169.254.6.3:1234
2026-07-02 16:24:21.478 INFO - 🐬 Initialize Task Context
2026-07-02 16:24:21.480 INFO - Current tenant is default tenant, will use bootstrap user: root to execute the task
2026-07-02 16:24:21.480 INFO - TenantCode: root check successfully
2026-07-02 16:24:21.481 INFO - TaskInstance working directory: /opt/dolphinscheduler/data/exec/process/120 create successfully
2026-07-02 16:24:21.481 INFO - Download resource file /opt/dolphinscheduler/resources/default/resources/std_enterprise_abnormal_dm-doris.json -> /opt/dolphinscheduler/data/exec/process/120/std_enterprise_abnormal_dm-doris.json successfully
2026-07-02 16:24:21.482 INFO - Download resources successfully: ResourceContext(resourceItemMap={/opt/dolphinscheduler/resources/default/resources/std_enterprise_abnormal_dm-doris.json=ResourceContext.ResourceItem(resourceAbsolutePathInStorage=/opt/dolphinscheduler/resources/default/resources/std_enterprise_abnormal_dm-doris.json, resourceAbsolutePathInLocal=/opt/dolphinscheduler/data/exec/process/120/std_enterprise_abnormal_dm-doris.json)})
2026-07-02 16:24:21.484 INFO - 🐬 Load Task Instance Plugin
2026-07-02 16:24:21.484 INFO - Initialized physicalTask: DATAX successfully
2026-07-02 16:24:21.484 INFO - Initialize datax task params {
"localParams" : [ ],
"varPool" : [ ],
"customConfig" : 1,
"json" : "{}",
"dsType" : null,
"dataSource" : 0,
"dtType" : null,
"dataTarget" : 0,
"sql" : null,
"targetTable" : null,
"preStatements" : null,
"postStatements" : null,
"jobSpeedByte" : 0,
"jobSpeedRecord" : 0,
"jobChannel" : 0,
"xms" : 1,
"xmx" : 1,
"batchSize" : 0,
"resourceList" : [ {
"id" : null,
"resourceName" : "/opt/dolphinscheduler/resources/default/resources/std_enterprise_abnormal_dm-doris.json",
"res" : null
} ]
}
2026-07-02 16:24:21.485 INFO - Set taskVarPool: null successfully
2026-07-02 16:24:21.485 INFO - 🐬 Execute Task Instance
2026-07-02 16:24:21.486 INFO - Final Script Content:

#!/bin/bash
BASEDIR=$(cd dirname $0; pwd)
cd $BASEDIR
export JAVA_HOME=/opt/java/openjdk
export PYTHON=/usr/bin/python3
export DATAX_PY=/opt/datax/bin/datax.py
export PATH=$JAVA_HOME/bin:$PATH:$PYTHON
export PYTHON_LAUNCHER=/usr/bin/python3
export DATAX_LAUNCHER=/opt/datax/bin/datax.py
${PYTHON_LAUNCHER} ${DATAX_LAUNCHER} --jvm="-Xms1G -Xmx1G" -p "-Dsub_time='5' -Dsystem.task.definition.name='std_enterprise_abnormal_dm-doris' -Dsystem.project.name='市级同步-DM-DORIS' -Dsystem.project.code='176377385027712' -Dsystem.workflow.instance.id='59' -Dsystem.biz.curdate='20260702' -Dsystem.biz.date='20260701' -Dsystem.task.instance.id='120' -Dsystem.workflow.definition.name='测试' -Dsystem.task.definition.code='177715282670720' -Dsystem.workflow.definition.code='177532592572544' -Dsystem.datetime='20260702162421'" /opt/dolphinscheduler/data/exec/process/120/120_job.json

2026-07-02 16:24:21.486 INFO - Executing shell command : sudo -u root -i /opt/dolphinscheduler/data/exec/process/120/120.sh
2026-07-02 16:24:21.489 INFO - process start, process id is: 299842
2026-07-02 16:24:21.556 INFO - ->
2026-07-02 16:24:21.562 INFO - -> DataX (DATAX-OPENSOURCE-3.0), From Alibaba !
2026-07-02 16:24:21.562 INFO - -> Copyright (C) 2010-2017, Alibaba Group. All Rights Reserved.
2026-07-02 16:24:21.562 INFO - ->
2026-07-02 16:24:21.563 INFO - ->
2026-07-02 16:24:22.188 INFO - -> 2026-07-02 16:24:22.186 [main] WARN ConfigParser - 插件[null,null]加载失败，1s后重试... Exception:Code:[Framework-12], Description:[DataX插件初始化错误, 该问题通常是由于DataX安装错误引起，请联系您的运维解决 .]. - 插件加载失败，未完成指定插件加载:[null]
2026-07-02 16:24:23.324 INFO - -> 2026-07-02 16:24:23.324 [main] ERROR Engine -
2026-07-02 16:24:23.325 INFO - ->
2026-07-02 16:24:23.325 INFO - -> 经DataX智能分析,该任务最可能的错误原因是:
2026-07-02 16:24:23.325 INFO - -> com.alibaba.datax.common.exception.DataXException: Code:[Framework-12], Description:[DataX插件初始化错误, 该问题通常是由于DataX安装错误引起，请联系您的运维解决 .]. - 插件加载失败，未完成指定插件加载:[null]
2026-07-02 16:24:23.325 INFO - -> at com.alibaba.datax.common.exception.DataXException.asDataXException(DataXException.java:30)
2026-07-02 16:24:23.325 INFO - -> at com.alibaba.datax.core.util.ConfigParser.parsePluginConfig(ConfigParser.java:142)
2026-07-02 16:24:23.325 INFO - -> at com.alibaba.datax.core.util.ConfigParser.parse(ConfigParser.java:63)
2026-07-02 16:24:23.325 INFO - -> at com.alibaba.datax.core.Engine.entry(Engine.java:131)
2026-07-02 16:24:23.325 INFO - -> at com.alibaba.datax.core.Engine.main(Engine.java:201)
2026-07-02 16:24:23.325 INFO - ->
2026-07-02 16:24:23.362 INFO - process has exited. execute path:/opt/dolphinscheduler/data/exec/process/120, processId:299842 ,exitStatusCode:1 ,processWaitForStatus:true ,processExitValue:1
2026-07-02 16:24:23.564 INFO - 🐬 Finalize Task Instance
2026-07-02 16:24:23.565 INFO - FINALIZE_SESSION
2026-07-02 16:24:23.565 INFO - Deleted task exec directory: /opt/dolphinscheduler/data/exec/process/120

What you expected to happen

JSON can be customized, and JSON can also be referenced via resource files

How to reproduce

When running workflows with the DataX component, there is a custom template where I selected JSON. There is also a resource file at the bottom, and I want DataX to execute the JSON definition contained within this resource file, but an error occurs.

Anything else

No response

Version

3.4.2

Are you willing to submit PR?

• Yes I am willing to submit a PR!

Code of Conduct

• I agree to follow this project's Code of Conduct

[wipheg]

Hi! I'd like to work on this issue.

I investigated the problem and I think the DataX task currently doesn't correctly handle JSON definitions provided through resource files. I'll look into how the resource file is resolved and passed to DataX, identify the root cause, and submit a fix if everything looks good.

Could you please assign this issue to me?

Thanks!

[nikhiln64]

Hi, I'd like to work on this if it's still available (I see @wipheg expressed interest on 07-08 but there's no PR or assignment yet - happy to defer if you're still on it). Root cause from reading the plugin: with customConfig the DataX task uses getJson() verbatim and no code path ever reads the attached resource file, even though the worker downloads it - so the job runs with an empty json. Plan: mirror the SeaTunnel plugin's pattern (read the first resource via TaskExecutionContext's resource context when json is blank), run it through ParameterUtils.convertParameterPlaceholders so param substitution still works, validate in checkParameters, and add unit tests. Could a committer assign me if that works?

[SbloodyS]

I've assigned to you. Looking forward to your contribution. @nikhiln64