Failing test: Chrome X-Pack UI Functional Tests.x-pack/test/functional_gen_ai/inference/tests/index·ts - Inference plugin - API integration tests Connector bedrock-claude-3-5-sonnet chatComplete API streaming enabled executes a tool when explicitly requested

[kibanamachine]

A test failed on a tracked branch

TypeError: Cannot read properties of undefined (reading 'length')
    at Context.<anonymous> (chat_complete.ts:204:34)
    at processTicksAndRejections (node:internal/process/task_queues:95:5)
    at Object.apply (wrap_function.js:74:16)

First failure: kibana-on-merge - main

[elasticmachine]

Pinging @elastic/appex-ai-infra (Team:AI Infra)

[pgayvallet]

Similar to #203064 - was caused by a temporary bedrock service outage.

[kibanamachine]

New failure: kibana-on-merge - 8.x

[legrego]

Latest failure ^ looks to be the same:

[00:00:00]  
[00:00:00]   â””-: Inference plugin - API integration tests
[00:00:00]     â””-> "before all" hook: beforeTestSuite.trigger in "Inference plugin - API integration tests"
[00:00:32]     â””-: Connector bedrock-claude-3-5-sonnet
[00:00:32]       â””-> "before all" hook: beforeTestSuite.trigger in "Connector bedrock-claude-3-5-sonnet"
[00:00:32]       â””-: chatComplete API
[00:00:32]         â””-> "before all" hook: beforeTestSuite.trigger in "chatComplete API"
[00:00:43]         â””-: streaming enabled
[00:00:43]           â””-> "before all" hook: beforeTestSuite.trigger for "returns a chat completion message for a simple prompt"
[00:00:43]           â””-> returns a chat completion message for a simple prompt
[00:00:43]             â””-> "before each" hook: global before each for "returns a chat completion message for a simple prompt"
[00:00:43]             │ proc [kibana] [2024-12-05T18:47:51.002+00:00][WARN ][http.server.kbn-internal-api-restricted] Access to uri [/internal/inference/chat_complete/stream] with method [post] is deprecated {"service":{"node":{"roles":["background_tasks","ui"]}}}
[00:00:48]             └- ✓ pass  (4.9s)
[00:00:48]           â””-> executes a tool when explicitly requested
[00:00:48]             â””-> "before each" hook: global before each for "executes a tool when explicitly requested"
[00:00:48]             │ proc [kibana] [2024-12-05T18:47:55.908+00:00][WARN ][http.server.kbn-internal-api-restricted] Access to uri [/internal/inference/chat_complete/stream] with method [post] is deprecated {"service":{"node":{"roles":["background_tasks","ui"]}}}
[00:00:52]             │ proc [kibana] [2024-12-05T18:47:59.638+00:00][ERROR][plugins.inference.chatComplete] Error: Encountered error in Bedrock stream of type serviceUnavailableException
[00:00:52]             │ proc [kibana] Bedrock is unable to process your request.
[00:00:52]             │ proc [kibana]     at createInferenceInternalError (/opt/buildkite-agent/builds/bk-agent-prod-gcp-1733423946255724876/elastic/kibana-on-merge/kibana-build-xpack/node_modules/@kbn/inference-common/src/errors.js:49:10)
[00:00:52]             │ proc [kibana]     at /opt/buildkite-agent/builds/bk-agent-prod-gcp-1733423946255724876/elastic/kibana-on-merge/kibana-build-xpack/node_modules/@kbn/inference-plugin/server/chat_complete/adapters/bedrock/serde_eventstream_into_observable.js:48:69
[00:00:52]             │ proc [kibana]     at processTicksAndRejections (node:internal/process/task_queues:95:5) {"service":{"node":{"roles":["background_tasks","ui"]}}}
[00:00:52]             │ info Taking window screenshot "/opt/buildkite-agent/builds/bk-agent-prod-gcp-1733423946255724876/elastic/kibana-on-merge/kibana/x-pack/test/functional/screenshots/failure/Inference plugin - API integration tests Connector bedrock-claude-3-5-sonnet cha-8f9597ece72839087f620732258141ef0f75c9da0f0c75ec346e525f63a9dbc2.png"
[00:00:52]             │ info Current URL is: data:,
[00:00:52]             │ info Saving page source to: /opt/buildkite-agent/builds/bk-agent-prod-gcp-1733423946255724876/elastic/kibana-on-merge/kibana/x-pack/test/functional/failure_debug/html/Inference plugin - API integration tests Connector bedrock-claude-3-5-sonnet cha-8f9597ece72839087f620732258141ef0f75c9da0f0c75ec346e525f63a9dbc2.html
[00:00:52]             └- ✖ fail: Inference plugin - API integration tests Connector bedrock-claude-3-5-sonnet chatComplete API streaming enabled executes a tool when explicitly requested
[00:00:52]             │      TypeError: Cannot read properties of undefined (reading 'length')
[00:00:52]             │       at Context.<anonymous> (chat_complete.ts:204:34)
[00:00:52]             │       at processTicksAndRejections (node:internal/process/task_queues:95:5)
[00:00:52]             │       at Object.apply (wrap_function.js:74:16)
[00:00:52]             │ 
[00:00:52]             │ 

Given the apparent frequency so far, we may want to look into ways of gracefully handling this within our test infrastructure.