Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

feat: Attach RAG documents to ModelFiles #1154

Closed
nick-tonjum opened this issue Mar 13, 2024 · 1 comment
Closed

feat: Attach RAG documents to ModelFiles #1154

nick-tonjum opened this issue Mar 13, 2024 · 1 comment

Comments

@nick-tonjum
Copy link

Good afternoon!
I had a great idea when playing with ModelFiles in the webui.

What if it were possible to attach RAG documents (or a group of RAG documents) to a modelfile? I know a lot of work would have to be put into this because ollama doesn't support this directly, but I think it could be done. It would be nice to have a model file that would just always have a rag document attached to it when conversing with it, rather than including all my data in the system prompt or manually attaching a document every time I ask it a question.

For example, I could make a modelfile that's based on mixtral or something but has a RAG document attached to it with a big essay about my life or whatever, and anyone who asks the model a question about me would get an answer from it utilizing RAG. This would also be nice if this worked through the API as well.

@tjbck
Copy link
Contributor

tjbck commented Mar 13, 2024

Duplicate: #529

@tjbck tjbck closed this as completed Mar 13, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants