Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Providers: HuggingFace #27

Open
nigue3025 opened this issue Sep 21, 2023 · 1 comment
Open

Providers: HuggingFace #27

nigue3025 opened this issue Sep 21, 2023 · 1 comment
Labels
enhancement New feature or request good first issue Good for newcomers help wanted Extra attention is needed providers

Comments

@nigue3025
Copy link

nigue3025 commented Sep 21, 2023

Hi,

I'm new to Langchain and LLM.

I've recently deployed an LLM model using the Hugging Face text-generation-inference library on my local machine.

I've successfully accessed the model using Python by following the instructions provided at https://python.langchain.com/docs/integrations/llms/huggingface_textgen_inference.

However, I would prefer to use WPF with C#. I'm delighted to discover that there is support for Langchain with .NET.

Is there a way for me to access Hugging Face text-generation-inference in Langchain using C# as well?

Since I've deployed the model on a local server machine and I want to access the model from another client machine via an intranet connection, I'm open to alternative solutions aside from using text-generation-inference in C# on the client machine.

Any advice would be greatly appreciated.

@HavenDV
Copy link
Contributor

HavenDV commented Sep 21, 2023

Hi. Unfortunately there is still a lot missing from this project and currently HuggingFace support is quite limited and doesn't allow you to do what you described

@HavenDV HavenDV changed the title Support for hugginface text-generation inference Providers: HuggingFace Mar 22, 2024
@HavenDV HavenDV added enhancement New feature or request good first issue Good for newcomers help wanted Extra attention is needed providers labels Mar 22, 2024
@HavenDV HavenDV pinned this issue Mar 22, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request good first issue Good for newcomers help wanted Extra attention is needed providers
Projects
Status: No status
Development

No branches or pull requests

2 participants