flinkx1.12.7 在恢复checkpoint没起效
Nobody has claimed this yet.
Assessment
- Difficulty
- 4/5
- Estimated time
- 3-5 days
- Newbie friendliness
- 25/100
- Issue type
- Bug
- Clarity
- Needs clarification
- Activity status
- Stale
- Domain
- distributed-systems
Research direction
Reproduce the command from ./bin/flinkx using flinkx-examples/sql/develp/cp.sql and Flink 1.12.7. First inspect how the -s option and the values passed through -confProp are parsed and applied. Done means identifying the supported restart-from-savepoint or checkpoint procedure and confirming it with the reported configuration.
Written by the indexing model from the issue text.
Description
example: execute the command as follows:
- savepoint 使用
./bin/flinkx -mode standalone -jobType sql -flinkxDistDir flinkx-dist -job flinkx-examples/sql/develp/cp.sql -flinkLibDir ../flink-1.12.7/lib -flinkConfDir ../flink-1.12.7/conf -confProp "{"sql.checkpoint.mode":"EXACTLY_ONCE","execution.checkpointing.interval":"6000"}" -s hdfs://dswhhadoop-3:8020/warehouse/tablespace/managed/checkpoint/0aa6ad6d5daafd265bebb8de6c2d8bd4
结果报错! 显示没有-s这个参数选项，无法恢复savepoint
- 另外一种方式
./bin/flinkx -mode standalone -jobType sql -flinkxDistDir flinkx-dist -job flinkx-examples/sql/develp/cp.sql -flinkLibDir ../flink-1.12.7/lib -flinkConfDir ../flink-1.12.7/conf -confProp "{"sql.checkpoint.mode":"EXACTLY_ONCE","execution.checkpointing.interval":"6000","flink.checkpoint.interval":8000,"sql.checkpoint.timeout":"200000","state.backend":"FILESYSTEM","state.savepoints.dir":"hdfs://dswhhadoop-3:8020/warehouse/tablespace/managed/savepoint","state.checkpoints.dir":"hdfs://dswhhadoop-3:8020/warehouse/tablespace/managed/checkpoint"}"
通过在配置-confProp中 配置"state.savepoints.dir 也没有起作用 ，bi站官方视频上面是之前的版本，支持-s ,1.12版不支持了,
不知道如何使用flinkx 自带的任务挂了，重启实现断点续传功能？
- Dominant language
- No language data
- Stars
- 55
- Forks
- 13
- PR merge metrics
- No merged PRs in 30d
Contributor guide
No contributing guide indexed for this repository
First steps
- Read the whole issue, then the project's contributing guide.
- Comment on the issue to say you are picking it up — it saves two people doing the same work.
- Fork the repository and make your change on a branch.
- Open a pull request that references the issue number.
More from DTStack/flinkx
-
Difficulty 3/5 1-2 days Newbie friendliness 35/100
-
Difficulty 4/5 3-5 days Newbie friendliness 25/100
-
Difficulty 3/5 1-2 days Newbie friendliness 25/100
Similar issues
-
Difficulty 2/5 1-3 hours Newbie friendliness 88/100
-
Difficulty 2/5 1-3 hours Newbie friendliness 78/100
-
area/runtimes kind/bug needs-triage
Difficulty 2/5 1-3 hours Newbie friendliness 84/100
-
Difficulty 2/5 1-3 hours Newbie friendliness 78/100
-
python
Difficulty 2/5 1-3 hours Newbie friendliness 88/100
finos/opengris-scaler#1009 ·