You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
As a user, I'd like to use models on Amazon Bedrock in my Haystack 2.0 pipelines. This was brought up in deepset-ai/haystack#6545
Detailed design
A new generator class for Amazon Bedrock with the same features as the 1.x version, which was implemented as an invocation layer. All currently available models on Bedrock should be supported and streaming should be supported for all models that support streaming. For example, we should be able to load Llama 2 Chat 13B model:
Excited to see AWS Bedrock in Haystack 2.0. The generator looks implemented, I was wondering if there was an issue to follow the implementation of the AmazonBedrockEmbedder (implmented in 1.x) :)
Summary and motivation
As a user, I'd like to use models on Amazon Bedrock in my Haystack 2.0 pipelines. This was brought up in deepset-ai/haystack#6545
Detailed design
A new generator class for Amazon Bedrock with the same features as the 1.x version, which was implemented as an invocation layer. All currently available models on Bedrock should be supported and streaming should be supported for all models that support streaming. For example, we should be able to load Llama 2 Chat 13B model:
Related PRs for the support in Haystack 1.x were deepset-ai/haystack#6226 and deepset-ai/haystack#6406
Checklist
If the request is accepted, ensure the following checklist is complete before closing this issue.
main
branchintegration:<your integration name>
has been added to this repoThe text was updated successfully, but these errors were encountered: