Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Support new prefetches in MergeTreeReadPoolParallelReplicas* #64059

Open
nickitat opened this issue May 17, 2024 · 0 comments
Open

Support new prefetches in MergeTreeReadPoolParallelReplicas* #64059

nickitat opened this issue May 17, 2024 · 0 comments
Labels
feature performance

Comments

@nickitat
Copy link
Member

  1. need to refactor PrefetchedReadPool

    • tasks should be created on demand (instead of creating all at once)
    • we should prefetch next task as soon as another one from the "prefetch window" completes

    this part repeating what was described in Next improvements for read prefetch #54131

  2. MergeTreeReadPoolParallelReplicas* should just provide a custom implementation of getNextTask that will query the initiator
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
feature performance
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
1 participant
@nickitat