Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Bug]: resume cdc task which database level include start-ts and end-ts cdc mysqlSink Send failed #21181

Open
1 task done
heni02 opened this issue Jan 10, 2025 · 1 comment
Assignees
Labels
kind/bug Something isn't working phase/testing severity/s0 Extreme impact: Cause the application to break down and seriously affect the use
Milestone

Comments

@heni02
Copy link
Contributor

heni02 commented Jan 10, 2025

Is there an existing issue for the same bug?

  • I have checked the existing issues.

Branch Name

main

Commit ID

fcbf276

Other Environment Information

- Hardware parameters:
- OS type:
- Others:

Actual Behavior

resume任务,mo日志报错cdc mysqlSink Send failed :err: Error 1064 (42000): You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near '' at line 1, sql: /* [1736496646010324969-1, 1736496979095611357-1) /DELETE FROM tpcc_10_mysql.bmsql_warehouse WHERE (w_id) IN ((2));/ [1736496646010324969-1, 1736496979095611357-1) */REPLACE INTO `tpcc_10_m"
企业微信截图_1d30fe71-d1bc-4bf6-9f54-b45c9a231c79

https://shanghai.idc.matrixorigin.cn:30001/explore?panes=%7B%225wK%22:%7B%22datasource%22:%22loki%22,%22queries%22:%5B%7B%22refId%22:%22A%22,%22expr%22:%22%7Bnamespace%3D%5C%22mo-cdc-test%5C%22%7D%20%7C%3D%20%60ERROR%60%22,%22queryType%22:%22range%22,%22datasource%22:%7B%22type%22:%22loki%22,%22uid%22:%22loki%22%7D,%22editorMode%22:%22builder%22%7D%5D,%22range%22:%7B%22from%22:%221736497261908%22,%22to%22:%221736497668552%22%7D%7D%7D&schemaVersion=1&orgId=1

show cdc:
企业微信截图_71f562eb-d267-4c67-9764-0b07e7abf00f

Expected Behavior

No response

Steps to Reproduce

1.mo准备数据:使用mo-load-data加载tpcc10仓数据
2.创建pitr: create pitr database_pitr for database tpcc_10 range 24 'h';
3.创建database任务
./mo_cdc task create --task-name "cdc_db" --source-uri="mysql://ac1:admin:[email protected]:6001" --sink-type="mysql" --sink-uri="mysql://root:mo123456@10.222.1.129:3306" --databases="tpcc_10:tpcc_10_mysql" --start-ts='2025-01-10T07:15:44+00:00' --end-ts='2025-01-10T13:30:00+00:00' --level="database"
4.同步完后pause任务
5.使用mo-tpcc工具运行10分钟tpcc10仓100并发测试
6.5步骤中间时间resume任务

Additional information

No response

@heni02 heni02 added kind/bug Something isn't working severity/s0 Extreme impact: Cause the application to break down and seriously affect the use labels Jan 10, 2025
@heni02 heni02 added this to the 2.1.0 milestone Jan 10, 2025
@ck89119 ck89119 assigned heni02 and unassigned ck89119 Jan 13, 2025
@heni02
Copy link
Contributor Author

heni02 commented Jan 16, 2025

回归验证resume任务还是会报错
commit: 04f5ee8
企业微信截图_4ed5c76e-52f5-41c0-b409-5f7df896ff5c

https://shanghai.idc.matrixorigin.cn:30001/explore?panes=%7B%22nJ8%22:%7B%22datasource%22:%22loki%22,%22queries%22:%5B%7B%22refId%22:%22A%22,%22expr%22:%22%7Bnamespace%3D%5C%22mo-cdc-test%5C%22%7D%20%7C%3D%20%60ERROR%60%22,%22queryType%22:%22range%22,%22datasource%22:%7B%22type%22:%22loki%22,%22uid%22:%22loki%22%7D,%22editorMode%22:%22builder%22%7D%5D,%22range%22:%7B%22from%22:%221737009675134%22,%22to%22:%221737013275134%22%7D%7D%7D&schemaVersion=1&orgId=1

cdc命令:
./mo_cdc task create --task-name "cdc_db" --source-uri="mysql://ac1:admin:[email protected]:6001" --sink-type="mysql" --sink-uri="mysql://root:[email protected]:3306" --databases="tpcc_10:tpcc_10_mysql" --start-ts='2025-01-16T06:50:44+00:00' --end-ts='2025-01-16T10:30:00+00:00' --level="database"
[root@mo-srv-128 mo-backup]# ./mo_cdc task pause --task-name "cdc_db" --source-uri="mysql://ac1:admin:[email protected]:6001"
OK
[root@mo-srv-128 mo-backup]# ./mo_cdc task resume --task-name "cdc_db" --source-uri="mysql://ac1:admin:[email protected]:6001"
OK
[root@mo-srv-128 mo-backup]# ./mo_cdc task show --task-name "cdc_db" --source-uri="mysql://ac1:admin:[email protected]:6001"
[
{
"task-id": "01946deb-1545-781e-9759-361bf0a01397",
"task-name": "cdc_db",
"source-uri": "mysql://ac1:admin:@10.222.6.8:6001",
"sink-uri": "mysql://root:
@10.222.1.129:3306",
"state": "running",
"err-msg": "",
"checkpoint": "{\n "tpcc_10.bmsql_config": 2025-01-16 07:29:05.091256235 +0000 UTC,\n "tpcc_10.bmsql_customer": 2025-01-16 07:21:26.472972597 +0000 UTC,\n "tpcc_10.bmsql_district": 2025-01-16 07:21:26.449308708 +0000 UTC,\n "tpcc_10.bmsql_history": 2025-01-16 07:29:04.939968353 +0000 UTC,\n "tpcc_10.bmsql_item": 2025-01-16 07:29:05.069685759 +0000 UTC,\n "tpcc_10.bmsql_new_order": 2025-01-16 07:29:05.009932916 +0000 UTC,\n "tpcc_10.bmsql_oorder": 2025-01-16 07:29:05.023536945 +0000 UTC,\n "tpcc_10.bmsql_order_line": 2025-01-16 07:29:04.932416964 +0000 UTC,\n "tpcc_10.bmsql_stock": 2025-01-16 07:21:26.353286035 +0000 UTC,\n "tpcc_10.bmsql_warehouse": 2025-01-16 07:21:26.487583852 +0000 UTC,\n}",
"timestamp": "2025-01-16 07:29:05.89031057 +0000 UTC"
}
]

@heni02 heni02 assigned ck89119 and unassigned heni02 Jan 16, 2025
@ck89119 ck89119 mentioned this issue Jan 17, 2025
7 tasks
@ck89119 ck89119 assigned heni02 and unassigned ck89119 Jan 17, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
kind/bug Something isn't working phase/testing severity/s0 Extreme impact: Cause the application to break down and seriously affect the use
Projects
None yet
Development

No branches or pull requests

3 participants