chore(bedrock): agent refactoring

[aws-rafams]

Fixes #731, #767, #747

• Interfaces
• Unit Testing
• Integ Testing

---

By submitting this pull request, I confirm that you can use, modify, copy, and redistribute this contribution, under the terms of the project license.

[krokoko]

Testing to override default prompt for an agent:

const prompt_path = path.join(__dirname, 'pre-processing.txt');

    const file = readFileSync(prompt_path, 'utf-8');
    
    const agent = new bedrock.Agent(this, 'Agent', {
      foundationModel: bedrock.BedrockFoundationModel.AMAZON_NOVA_LITE_V1,
      instruction: 'You are a helpful and friendly agent that answers questions about literature.',
      userInputEnabled: true,
      codeInterpreterEnabled: false,
      shouldPrepareAgent:true,
      promptOverrideConfiguration: bedrock.PromptOverrideConfiguration.fromSteps(
        [
          {
            stepType: bedrock.AgentStepType.PRE_PROCESSING,
            stepEnabled: true,
            customPromptTemplate: file,
            inferenceConfig: {
              temperature: 0.0,
              topP: 1,
              topK: 250,
              maximumLength: 1,
              stopSequences: ["\n\nHuman:"],
            },
          }
        ]
      )
    });

Seems to work fine:

Need to test more scenarios

[krokoko]

Adding a guardrail fails:

// create your agent

const guardrails = new bedrock.Guardrail(this, "bedrockGuardrails", {
      name: "my-BedrockGuardrails",
      description: "Legal ethical guardrails.",
    });

    guardrails.addDeniedTopicFilter(bedrock.Topic.FINANCIAL_ADVICE);

    agent.addGuardrail(guardrails);

synth fails with:

validation-helpers.ts:98
    throw new Error(errors.join('\n'));
          ^
Error: The field version with value "${Token[TOKEN.1058]}" does not match the required pattern /^(([0-9]{1,8})|(DRAFT))$/
    at Object.throwIfInvalid (.../src/common/helpers/validation-helpers.ts:98:11)

from this:

public addGuardrail(guardrail: IGuardrail) {
    // Do some checks
    validation.throwIfInvalid(this.validateGuardrail, guardrail);
    // Add it to the construct
    this.guardrail = guardrail;
    // Handle permissions
    guardrail.grantApply(this.role);
  }

[aws-rafams]

[FIXED]

Adding a guardrail fails:

// create your agent

const guardrails = new bedrock.Guardrail(this, "bedrockGuardrails", {
      name: "my-BedrockGuardrails",
      description: "Legal ethical guardrails.",
    });

    guardrails.addDeniedTopicFilter(bedrock.Topic.FINANCIAL_ADVICE);

    agent.addGuardrail(guardrails);

synth fails with:

validation-helpers.ts:98
    throw new Error(errors.join('\n'));
          ^
Error: The field version with value "${Token[TOKEN.1058]}" does not match the required pattern /^(([0-9]{1,8})|(DRAFT))$/
    at Object.throwIfInvalid (.../src/common/helpers/validation-helpers.ts:98:11)

from this:

public addGuardrail(guardrail: IGuardrail) {
    // Do some checks
    validation.throwIfInvalid(this.validateGuardrail, guardrail);
    // Add it to the construct
    this.guardrail = guardrail;
    // Handle permissions
    guardrail.grantApply(this.role);
  }

I see, validation occurs even when tokens are unresolved. Will modify and add the !cdk.Token.isUnresolved(guardrailName) part missing

[dineshSajwan]

Tested Python samples with the changes and it worked all fine.

[krokoko]

Some issues were fixed in Cfn and the bedrock agent sample is now deploying correctly with the changes above

[krokoko]

Creating an agent alias and attaching it to an agent works:

creating 2 aliases, pointing to a specific version:

[krokoko]

CRIS works also as expected:

const cris = bedrock.CrossRegionInferenceProfile.fromConfig({
      geoRegion: bedrock.CrossRegionInferenceProfileRegion.US,
      model: bedrock.BedrockFoundationModel.ANTHROPIC_CLAUDE_3_5_SONNET_V1_0,
    });

    const agent = new bedrock.Agent(this, 'Agent', {
      foundationModel: cris,
      instruction: 'You are a helpful and friendly agent that answers questions about literature.',
      shouldPrepareAgent:true
    });

[krokoko]

Issue #747 is fixed with these changes. Following code snippets deploys and runs successfully:

const agent = new bedrock.Agent(this, "Agent", {
      foundationModel: bedrock.BedrockFoundationModel.ANTHROPIC_CLAUDE_HAIKU_V1_0,
      instruction: "You are a helpful and friendly agent that answers questions about literature.",
    });

    const agent2 = new bedrock.Agent(this, "Agent2", {
      foundationModel: bedrock.BedrockFoundationModel.ANTHROPIC_CLAUDE_HAIKU_V1_0,
      instruction: "You are a helpful and friendly agent that answers questions about literature.",
    });

    const actionGroupFunction = new lambda_python.PythonFunction(this, "ActionGroupFunction", {
      runtime: lambda.Runtime.PYTHON_3_12,
      entry: path.join(__dirname, "../lambda/action-group"),
    });
    
    const actionGroup = new bedrock.AgentActionGroup({
      name: "query-library",
      description: "Use these functions to get information about the books in the library.",
      executor: bedrock.ActionGroupExecutor.fromlambdaFunction(actionGroupFunction),
      enabled: true,
      apiSchema: bedrock.ApiSchema.fromLocalAsset(path.join(__dirname, "action-group.yaml")),
    });

    agent.addActionGroup(actionGroup);
    agent2.addActionGroup(actionGroup);

[krokoko]

Agent with Guardrails works as expected: