When are 1bit quants coming? #5764
superchargez
started this conversation in
Ideas
Replies: 4 comments 7 replies
-
It's already here! See: #5453 |
Beta Was this translation helpful? Give feedback.
0 replies
-
That's not a quant |
Beta Was this translation helpful? Give feedback.
7 replies
-
Is this the same as https://www.youtube.com/watch?v=Gtf3CxIRiPk&ab_channel=1littlecoder |
Beta Was this translation helpful? Give feedback.
0 replies
-
0 bits quantization is just |
Beta Was this translation helpful? Give feedback.
0 replies
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
-
So, there is a paper The Era of 1-bit LLMs:
All Large Language Models are in 1.58 Bits by same people who wrote BitNet: Scaling 1-bit Transformers for
Large Language Models in October last year. So, is anybody going to try creating a 1bit quant algorithms?
Beta Was this translation helpful? Give feedback.
All reactions