roberta-large support #7007
Unanswered
alexbenari
asked this question in
Q&A
Replies: 0 comments
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
-
Is it possible to use roberta-large with llama.cpp?
My end goal is to compute a log-likelihood sentence score for sequences using this model (as defined in this paper). So I was planning to use llama.cpp for inference and implement the score computation on top of that (basically port the minicons python implementaiton or find an existing cpp implementaiton which I failed to do so far).
Does anyone have an idea how I can get roberta-large to work on llama.cpp? Any pointers on scoring implementation will also be gratly appreciated,
Beta Was this translation helpful? Give feedback.
All reactions