📖 Access to AWS Bedrock batch inference

[simon-pope]

User Story

As a user of AWS Bedrock
I want to make use of batch inference
So that I can decrease the cost of information extraction on large datasets

Value / Purpose

Make our pipeline more efficient/cost-effective by taking advantage of the batch inference mod

Useful Contacts

No response

User Types

No response

Hypothesis

If we... [do a thing]
Then... [this will happen]

Proposal

No response

Additional Information

From Feature Request:

We are working on information extraction from free text case notes; we have a DPIA covering the use of Bedrock, but were wondering whether we could make our pipeline more efficient/cost-effective by taking advantage of the batch inference mode.

Definition of Done

• AWS Bedrock batch inference is available
• End users informed of change
• Documentation update