Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

feat: dropdown suggestions for the 'Pull a model from Ollama.com' input box #1260

Draft
wants to merge 7 commits into
base: dev
Choose a base branch
from

Conversation

dannyl1u
Copy link
Collaborator

@dannyl1u dannyl1u commented Mar 22, 2024

Pull Request Checklist

  • Description: Briefly describe the changes in this pull request.
  • Changelog: Ensure a changelog entry following the format of Keep a Changelog is added at the bottom of the PR description.
  • Documentation: Have you updated relevant documentation?
  • Dependencies: Are there any new dependencies? Have you updated the dependency versions in the documentation?

Description

This PR introduces a new feature in the input box where model names from ollama.com are suggested to the user as they type. This feature enhances the user experience by providing real-time suggestions and reducing the time users spend typing or remembering specific models.


Changelog Entry

Added

  • Implemented searchable dropdown feature for model names from ollama.com

Closes #1242

@jannikstdl
Copy link
Contributor

Cool👍🏼

@tjbck
Copy link
Contributor

tjbck commented Mar 22, 2024

To provide more pointers, we might want to add a route to our Ollama proxy server that scraps official Ollama website!

@dannyl1u dannyl1u force-pushed the feat/model-search-typeahead branch from 8d9e7b2 to 891f513 Compare March 26, 2024 03:39
@jannikstdl
Copy link
Contributor

To provide more pointers, we might want to add a route to our Ollama proxy server that scraps official Ollama website!

@tjbck just be aware that this would be a external connection and we should give it a fallback and/or the ability to deactivate since just clicking in the inputfield would make an external request and many users are running OpenWebUI in an isolated environment.

@dannyl1u
Copy link
Collaborator Author

To provide more pointers, we might want to add a route to our Ollama proxy server that scraps official Ollama website!

@tjbck just be aware that this would be a external connection and we should give it a fallback and/or the ability to deactivate since just clicking in the inputfield would make an external request and many users are running OpenWebUI in an isolated environment.

@jannikstdl I considered this as well, but the actual pulling of models requires external connection anyways, so I think it's safe to assume that if a user is using open-webui to pull a model, they are OK with it making an external connection.

@jannikstdl
Copy link
Contributor

To provide more pointers, we might want to add a route to our Ollama proxy server that scraps official Ollama website!

@tjbck just be aware that this would be a external connection and we should give it a fallback and/or the ability to deactivate since just clicking in the inputfield would make an external request and many users are running OpenWebUI in an isolated environment.

@jannikstdl I considered this as well, but the actual pulling of models requires external connection anyways, so I think it's safe to assume that if a user is using open-webui to pull a model, they are OK with it making an external connection.

Yes that was my first thought too but now as the GGUF upload feature is out of experimental state users might use this instead of pulling models from ollama which does not require external connections.

@tjbck
Copy link
Contributor

tjbck commented Apr 10, 2024

Let's get the ball rolling for this feature, If I have time I'll implement the web scrap feature as well.

@dannyl1u dannyl1u force-pushed the feat/model-search-typeahead branch from 1079f7c to 53cafeb Compare April 29, 2024 22:45
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

3 participants