Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Beam Resource Hints API support #4897

Open
abomm opened this issue Jun 22, 2023 · 0 comments
Open

Beam Resource Hints API support #4897

abomm opened this issue Jun 22, 2023 · 0 comments

Comments

@abomm
Copy link

abomm commented Jun 22, 2023

When using the Scio DSL, I would like to have access to the ResourceHint API to tell Beam / Dataflow what RAM and GPU accelerators I would like to use, which is available when using Beam PCollections directly.

https://beam.apache.org/documentation/runtime/resource-hints/

Ideally this would be available using an API similar to withName com.spotify.scio.values.TransformNameable#withName, where there would be an API withResourceHints giving access to the min_ram and accelerator fields.

Thank you!

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant