Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

cdc: provide a warning when creating a changefeed with a cursor that's too far in the past #124290

Open
daniel-crlabs opened this issue May 16, 2024 · 1 comment
Labels
A-cdc Change Data Capture C-enhancement Solution expected to add code/behavior + preserve backward-compat (pg compat issues are exception) E-easy Easy issue to tackle, requires little or no CockroachDB experience O-support Originated from a customer P-3 Issues/test failures with no fix SLA T-cdc

Comments

@daniel-crlabs
Copy link
Contributor

daniel-crlabs commented May 16, 2024

Is your feature request related to a problem? Please describe.

Currently customers can create changefeeds specifying the cursor option so it starts from that given time. Unfortunately customers might make typos when entering the cursor epoch time and start a cursor with a timestamp that's too far in the past.

This typo could cause the changefeed to lag very far behind if the table is huge and the customer is unaware of this typo.

Describe the solution you'd like

Provide a warning when the customer creates a changefeed to let them know they are creating a changefeed with a cursor that's too far in the past (maybe if the curosr is older than 5 hours from the time the changefeed is being created) and this could cause changefeed latency.

Describe alternatives you've considered

None

Additional context

Customers might attribute the changefeed latency to many other issues and waste time troubleshooting something that's not the real problem or even recognize/realize the problem was caused because they made a typo.

Jira issue: CRDB-38811

@daniel-crlabs daniel-crlabs added C-enhancement Solution expected to add code/behavior + preserve backward-compat (pg compat issues are exception) A-cdc Change Data Capture labels May 16, 2024
@blathers-crl blathers-crl bot added the T-cdc label May 16, 2024
Copy link

blathers-crl bot commented May 16, 2024

cc @cockroachdb/cdc

@rharding6373 rharding6373 added E-easy Easy issue to tackle, requires little or no CockroachDB experience O-support Originated from a customer P-3 Issues/test failures with no fix SLA labels May 20, 2024
@lunevalex lunevalex changed the title Provide a warning when creating a changefeed with a cursor that's too far in the past cdc: provide a warning when creating a changefeed with a cursor that's too far in the past May 22, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
A-cdc Change Data Capture C-enhancement Solution expected to add code/behavior + preserve backward-compat (pg compat issues are exception) E-easy Easy issue to tackle, requires little or no CockroachDB experience O-support Originated from a customer P-3 Issues/test failures with no fix SLA T-cdc
Projects
None yet
Development

No branches or pull requests

2 participants