convert-pth-to-ggml.py has become very slow #663
-
A few weeks ago, Edit: looking at |
Beta Was this translation helpful? Give feedback.
Replies: 1 comment
-
By writing the models to my SSD instead of my HDD, converting them is much much faster. Maybe some room for improvement in the future (the naive solution if you have enough ram is just to store the entire thing in ram with |
Beta Was this translation helpful? Give feedback.
By writing the models to my SSD instead of my HDD, converting them is much much faster. Maybe some room for improvement in the future (the naive solution if you have enough ram is just to store the entire thing in ram with
BytesIO
then write it to disk, but I don't have enough RAM for this), but random writes on HDDs are just not great.