CDC data inconsistency after injection kafka failure last for 10mins

[Lily2025]

What did you do?

1、downstream：kafka，params：replication-factor=4&protocol=canal-json&compression=zstd&enable-tidb-extension=true&max-message-bytes=104857600&partition-num=1
2、run frequently updates workload
3、inject kafka failure last for 10mins
4、recover fault
5、stop workload
6、send finishmark
7、wait for finishmark sync to target
8、compare the data between upstream and target

What did you expect to see?

data consistency

What did you see instead?

CDC data inconsistency

sync_diff.log

Versions of the cluster

./cdc version
Release Version: v8.5.0
Git Commit Hash: 3703b18
Git Branch: HEAD
UTC Build Time: 2024-12-17 04:34:05
Go Version: go1.23.3
Failpoint Build: false
2025-01-16T08:50:11.300+0800

current status of DM cluster (execute query-status <task-name> in dmctl)

No response

[Lily2025]

/assign 3AceShowHand

[River2000i]

/area ticdc

[River2000i]

/remove-area dm

[Lily2025]

/severity critical