Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add support for setting the storage size of the PV used by a workflow step #250

Open
flaviodsr opened this issue Sep 27, 2021 · 0 comments
Labels
area/core enhancement New feature or request

Comments

@flaviodsr
Copy link
Member

Training a ML model usually requires copying remote data into the local storage (a persistent volume in kubernetes) where it will be used for training. The amount of storage required for storing this data varies, however FuseML does not provide a way to specify the size of that storage, instead, FuseML hardcodes that storage size (2 GiB, see: https://github.com/fuseml/fuseml-core/blob/main/pkg/core/tekton/constants.go#L8). Consequently, FuseML cannot be used for training models with more than 2 GiB of data.

@flaviodsr flaviodsr added enhancement New feature or request area/core labels Sep 27, 2021
@stefannica stefannica added this to Backlog in FuseML Project Board via automation Sep 27, 2021
@stefannica stefannica moved this from Backlog to V3 in FuseML Project Board Sep 27, 2021
@stefannica stefannica moved this from V3 to Backlog in FuseML Project Board Nov 23, 2021
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
area/core enhancement New feature or request
Projects
Development

No branches or pull requests

1 participant