Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

More details for 'tail prefetch size is calculated based on' #12667

Open
wants to merge 4 commits into
base: main
Choose a base branch
from

Conversation

andlr
Copy link
Contributor

@andlr andlr commented May 16, 2024

These messages indicate that SST file was created by a pre-9.0.0 RocksDB. Eventually, TailPrefetchStats might be removed, so it would be more informative if log message also included name of the affected SST file.

Issue: #12664

@facebook-github-bot
Copy link
Contributor

@hx235 has imported this pull request. If you are a Meta employee, you can view this diff on Phabricator.

Copy link
Contributor

@ajkr ajkr left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

It is a warning so we can track use cases that are at risk of regression when we finally remove TailPrefetchStats. The warnings and the risk can be mitigated by running compaction with a new enough RocksDB version (see #12664). If you still wanted to make a code change here, may I suggest a couple ideas:

  • As you mentioned the documentation was inadequate to know what to do. Maybe the warning text or surrounding comments could be improved.
  • Deduplicating the error could help with the spam problem. Maybe one warning per DB open saying N files are at risk.

@facebook-github-bot
Copy link
Contributor

@andlr has updated the pull request. You must reimport the pull request before landing.

@andlr andlr changed the title Use 'INFO' level for 'tail prefetch size is calculated based on' More details for 'tail prefetch size is calculated based on' May 17, 2024
@andlr
Copy link
Contributor Author

andlr commented May 17, 2024

It is a warning so we can track use cases that are at risk of regression when we finally remove TailPrefetchStats. The warnings and the risk can be mitigated by running compaction with a new enough RocksDB version (see #12664). If you still wanted to make a code change here, may I suggest a couple ideas:

  • As you mentioned the documentation was inadequate to know what to do. Maybe the warning text or surrounding comments could be improved.
  • Deduplicating the error could help with the spam problem. Maybe one warning per DB open saying N files are at risk.

Thanks for the explanation. I think in such case, it's probably enough to add name of the SST file into the log message, and a comment in code, saying that this backward compatibility won't be preserved forever

@andlr andlr requested a review from ajkr May 17, 2024 08:58
Copy link
Contributor

@ajkr ajkr left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM, thank you!

@facebook-github-bot
Copy link
Contributor

@hx235 has imported this pull request. If you are a Meta employee, you can view this diff on Phabricator.

@facebook-github-bot
Copy link
Contributor

@andlr has updated the pull request. You must reimport the pull request before landing.

@facebook-github-bot
Copy link
Contributor

@hx235 has imported this pull request. If you are a Meta employee, you can view this diff on Phabricator.

@facebook-github-bot
Copy link
Contributor

@andlr has updated the pull request. You must reimport the pull request before landing.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

4 participants