Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Support for AWS Bedrock? #736

Open
johannesstricker opened this issue Apr 19, 2024 · 8 comments
Open

Support for AWS Bedrock? #736

johannesstricker opened this issue Apr 19, 2024 · 8 comments
Labels
enhancement New feature or request

Comments

@johannesstricker
Copy link

I see that the python package has support for AWS Bedrock, but the TS package doesn't seem to support it.
I'd be happy to help implementing it, but is there a guide that explains what needs to be done to implement a new LLM provider?

@himself65
Copy link
Member

Hi, you can implement a class base on

export abstract class BaseLLM<

@himself65 himself65 added the enhancement New feature or request label Apr 19, 2024
@benjaminbascary
Copy link

Hi, you can implement a class base on

export abstract class BaseLLM<

Hey, can you please explain a little bit more? Im trying to use Bedrock too

@himself65
Copy link
Member

You can follow this PR #305

@johannesstricker
Copy link
Author

I have implemented partial support for bedrock. Will try to open up a PR soonish..

@himself65
Copy link
Member

I have implemented partial support for bedrock. Will try to open up a PR soonish..

You can open PR and let me give some feedback!

@petergoldstein
Copy link
Contributor

@johannesstricker Did you open a PR? We're also interested in Bedrock support (Claude 3 in particular) and have dev effort to contribute, but wouldn't want to duplicate effort.

@johannesstricker
Copy link
Author

No, didn't find time, yet, sorry.

@parhammmm
Copy link
Contributor

@himself65 @petergoldstein @johannesstricker created a PR for bedrock support #847

Currently only with the Anthropic models, others can be added by creating a Provider class

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request
Projects
None yet
Development

No branches or pull requests

5 participants