✨ Access to AWS Bedrock batch inference

[wmartin-gss]

Describe the feature request.

I know that AWS Bedrock has a batch inference mode (though don't know whether it's available to us in eu-west-1). Is it possible for us to make use of this?

Describe the context.

We are working on information extraction from free text case notes; we have a DPIA covering the use of Bedrock, but were wondering whether we could make our pipeline more efficient/cost-effective by taking advantage of the batch inference mode.

Value / Purpose

To decrease the cost of information extraction on large datasets

User Types

Data scientists