Skip to content

[fundamental] Recording support metrics #6220

[fundamental] Recording support metrics

[fundamental] Recording support metrics #6220

Triggered via pull request January 29, 2024 06:49
@crazygaocrazygao
synchronize #1762
Status Failure
Total duration 5m 14s
Artifacts 2

promptflow-executor-unit-test.yml

on: pull_request_target
authorize
0s
authorize
Matrix: executor_unit_tests
Publish Tests Results
1m 30s
Publish Tests Results
Fit to window
Zoom out
Zoom in

Annotations

887 errors, 4 warnings, and 5 notices
executor_unit_tests (ubuntu-latest)
Process completed with exit code 1.
test_batch_storage (tests.executor.e2etests.test_batch_engine.TestBatch) with error: tests.executor.e2etests.test_batch_engine.TestBatch#L0
artifacts/Test Results (Python 3.9) (OS ubuntu-latest)/test-results.xml [took 0s]
test_batch_run_then_eval (tests.executor.e2etests.test_batch_engine.TestBatch) with error: tests.executor.e2etests.test_batch_engine.TestBatch#L0
artifacts/Test Results (Python 3.9) (OS ubuntu-latest)/test-results.xml [took 0s]
test_batch_with_metrics (tests.executor.e2etests.test_batch_engine.TestBatch) with error: tests.executor.e2etests.test_batch_engine.TestBatch#L0
artifacts/Test Results (Python 3.9) (OS ubuntu-latest)/test-results.xml [took 0s]
test_end_tracing (tests.executor.unittests._core.test_tracer.TestTracer) with error: tests.executor.unittests._core.test_tracer.TestTracer#L0
artifacts/Test Results (Python 3.9) (OS ubuntu-latest)/test-results.xml [took 0s]
test_deserialize_enum[Status-UNKNOWN-UNKNOWN] (tests.executor.unittests.contracts.test_tool) with error: tests.executor.unittests.contracts.test_tool#L0
artifacts/Test Results (Python 3.9) (OS ubuntu-latest)/test-results.xml [took 0s]
test_start_tracing (tests.executor.unittests._core.test_tracer.TestTracer) with error: tests.executor.unittests._core.test_tracer.TestTracer#L0
artifacts/Test Results (Python 3.9) (OS ubuntu-latest)/test-results.xml [took 0s]
test_push_pop (tests.executor.unittests._core.test_tracer.TestTracer) with error: tests.executor.unittests._core.test_tracer.TestTracer#L0
artifacts/Test Results (Python 3.9) (OS ubuntu-latest)/test-results.xml [took 0s]
test_to_serializable[obj0] (tests.executor.unittests._core.test_tracer.TestTracer) with error: tests.executor.unittests._core.test_tracer.TestTracer#L0
artifacts/Test Results (Python 3.9) (OS ubuntu-latest)/test-results.xml [took 0s]
test_to_serializable[obj1] (tests.executor.unittests._core.test_tracer.TestTracer) with error: tests.executor.unittests._core.test_tracer.TestTracer#L0
artifacts/Test Results (Python 3.9) (OS ubuntu-latest)/test-results.xml [took 0s]
test_to_serializable[obj2] (tests.executor.unittests._core.test_tracer.TestTracer) with error: tests.executor.unittests._core.test_tracer.TestTracer#L0
artifacts/Test Results (Python 3.9) (OS ubuntu-latest)/test-results.xml [took 0s]
test_to_serializable[42] (tests.executor.unittests._core.test_tracer.TestTracer) with error: tests.executor.unittests._core.test_tracer.TestTracer#L0
artifacts/Test Results (Python 3.9) (OS ubuntu-latest)/test-results.xml [took 0s]
test_batch_with_partial_failure (tests.executor.e2etests.test_batch_engine.TestBatch) with error: tests.executor.e2etests.test_batch_engine.TestBatch#L0
artifacts/Test Results (Python 3.9) (OS ubuntu-latest)/test-results.xml [took 0s]
test_batch_with_line_number (tests.executor.e2etests.test_batch_engine.TestBatch) with error: tests.executor.e2etests.test_batch_engine.TestBatch#L0
artifacts/Test Results (Python 3.9) (OS ubuntu-latest)/test-results.xml [took 0s]
test_batch_with_openai_metrics (tests.executor.e2etests.test_batch_engine.TestBatch) with error: tests.executor.e2etests.test_batch_engine.TestBatch#L0
artifacts/Test Results (Python 3.9) (OS ubuntu-latest)/test-results.xml [took 0s]
test_batch_with_default_input (tests.executor.e2etests.test_batch_engine.TestBatch) with error: tests.executor.e2etests.test_batch_engine.TestBatch#L0
artifacts/Test Results (Python 3.9) (OS ubuntu-latest)/test-results.xml [took 0s]
test_batch_run_in_existing_loop (tests.executor.e2etests.test_batch_engine.TestBatch) with error: tests.executor.e2etests.test_batch_engine.TestBatch#L0
artifacts/Test Results (Python 3.9) (OS ubuntu-latest)/test-results.xml [took 0s]
test_import_requisites (tests.executor.unittests.contracts.test_flow.TestFlow) with error: tests.executor.unittests.contracts.test_flow.TestFlow#L0
artifacts/Test Results (Python 3.9) (OS ubuntu-latest)/test-results.xml [took 0s]
test_apply_node_overrides (tests.executor.unittests.contracts.test_flow.TestFlow) with error: tests.executor.unittests.contracts.test_flow.TestFlow#L0
artifacts/Test Results (Python 3.9) (OS ubuntu-latest)/test-results.xml [took 0s]
test_has_aggregation_node (tests.executor.unittests.contracts.test_flow.TestFlow) with error: tests.executor.unittests.contracts.test_flow.TestFlow#L0
artifacts/Test Results (Python 3.9) (OS ubuntu-latest)/test-results.xml [took 0s]
test_parse[1-int-1] (tests.executor.unittests.contracts.test_tool.TestValueType) with error: tests.executor.unittests.contracts.test_tool.TestValueType#L0
artifacts/Test Results (Python 3.9) (OS ubuntu-latest)/test-results.xml [took 0s]
test_get_node (tests.executor.unittests.contracts.test_flow.TestFlow) with error: tests.executor.unittests.contracts.test_flow.TestFlow#L0
artifacts/Test Results (Python 3.9) (OS ubuntu-latest)/test-results.xml [took 0s]
test_get_tool (tests.executor.unittests.contracts.test_flow.TestFlow) with error: tests.executor.unittests.contracts.test_flow.TestFlow#L0
artifacts/Test Results (Python 3.9) (OS ubuntu-latest)/test-results.xml [took 0s]
test_is_reduce_node (tests.executor.unittests.contracts.test_flow.TestFlow) with error: tests.executor.unittests.contracts.test_flow.TestFlow#L0
artifacts/Test Results (Python 3.9) (OS ubuntu-latest)/test-results.xml [took 0s]
test_is_normal_node (tests.executor.unittests.contracts.test_flow.TestFlow) with error: tests.executor.unittests.contracts.test_flow.TestFlow#L0
artifacts/Test Results (Python 3.9) (OS ubuntu-latest)/test-results.xml [took 0s]
test_node_logs[print_input_flow] (tests.executor.e2etests.test_logs.TestExecutorLogs) with error: tests.executor.e2etests.test_logs.TestExecutorLogs#L0
artifacts/Test Results (Python 3.9) (OS ubuntu-latest)/test-results.xml [took 0s]
test_is_llm_node (tests.executor.unittests.contracts.test_flow.TestFlow) with error: tests.executor.unittests.contracts.test_flow.TestFlow#L0
artifacts/Test Results (Python 3.9) (OS ubuntu-latest)/test-results.xml [took 0s]
test_is_node_referenced_by (tests.executor.unittests.contracts.test_flow.TestFlow) with error: tests.executor.unittests.contracts.test_flow.TestFlow#L0
artifacts/Test Results (Python 3.9) (OS ubuntu-latest)/test-results.xml [took 0s]
test_is_chat_flow (tests.executor.unittests.contracts.test_flow.TestFlow) with error: tests.executor.unittests.contracts.test_flow.TestFlow#L0
artifacts/Test Results (Python 3.9) (OS ubuntu-latest)/test-results.xml [took 0s]
test_get_chat_input_name (tests.executor.unittests.contracts.test_flow.TestFlow) with error: tests.executor.unittests.contracts.test_flow.TestFlow#L0
artifacts/Test Results (Python 3.9) (OS ubuntu-latest)/test-results.xml [took 0s]
test_get_chat_output_name (tests.executor.unittests.contracts.test_flow.TestFlow) with error: tests.executor.unittests.contracts.test_flow.TestFlow#L0
artifacts/Test Results (Python 3.9) (OS ubuntu-latest)/test-results.xml [took 0s]
test_replace_with_variant (tests.executor.unittests.contracts.test_flow.TestFlow) with error: tests.executor.unittests.contracts.test_flow.TestFlow#L0
artifacts/Test Results (Python 3.9) (OS ubuntu-latest)/test-results.xml [took 0s]
test_long_run_log (tests.executor.e2etests.test_logs.TestExecutorLogs) with error: tests.executor.e2etests.test_logs.TestExecutorLogs#L0
artifacts/Test Results (Python 3.9) (OS ubuntu-latest)/test-results.xml [took 0s]
test_activate_config_log (tests.executor.e2etests.test_logs.TestExecutorLogs) with error: tests.executor.e2etests.test_logs.TestExecutorLogs#L0
artifacts/Test Results (Python 3.9) (OS ubuntu-latest)/test-results.xml [took 0s]
test_import_pydantic (tests.executor.unittests._utils.test_dataclass_serializer) with error: tests.executor.unittests._utils.test_dataclass_serializer#L0
artifacts/Test Results (Python 3.9) (OS ubuntu-latest)/test-results.xml [took 0s]
test_deserialize_tool (tests.executor.unittests.contracts.test_tool.TestTool) with error: tests.executor.unittests.contracts.test_tool.TestTool#L0
artifacts/Test Results (Python 3.9) (OS ubuntu-latest)/test-results.xml [took 0s]
test_inject_operation_headers_sync (tests.executor.unittests._core.test_api_injector) with error: tests.executor.unittests._core.test_api_injector#L0
artifacts/Test Results (Python 3.9) (OS ubuntu-latest)/test-results.xml [took 0s]
test_inject_operation_headers_async (tests.executor.unittests._core.test_api_injector) with error: tests.executor.unittests._core.test_api_injector#L0
artifacts/Test Results (Python 3.9) (OS ubuntu-latest)/test-results.xml [took 0s]
test_aoai_generator_proxy_sync (tests.executor.unittests._core.test_api_injector) with error: tests.executor.unittests._core.test_api_injector#L0
artifacts/Test Results (Python 3.9) (OS ubuntu-latest)/test-results.xml [took 0s]
test_aoai_generator_proxy_async (tests.executor.unittests._core.test_api_injector) with error: tests.executor.unittests._core.test_api_injector#L0
artifacts/Test Results (Python 3.9) (OS ubuntu-latest)/test-results.xml [took 0s]
test_aoai_call_inject (tests.executor.unittests._core.test_api_injector) with error: tests.executor.unittests._core.test_api_injector#L0
artifacts/Test Results (Python 3.9) (OS ubuntu-latest)/test-results.xml [took 0s]
test_aoai_tool_header (tests.executor.unittests._core.test_api_injector) with error: tests.executor.unittests._core.test_api_injector#L0
artifacts/Test Results (Python 3.9) (OS ubuntu-latest)/test-results.xml [took 0s]
test_aoai_chat_tool_prompt (tests.executor.unittests._core.test_api_injector) with error: tests.executor.unittests._core.test_api_injector#L0
artifacts/Test Results (Python 3.9) (OS ubuntu-latest)/test-results.xml [took 0s]
test_log_progress (tests.executor.unittests._utils.test_utils.TestUtils) with error: tests.executor.unittests._utils.test_utils.TestUtils#L0
artifacts/Test Results (Python 3.9) (OS ubuntu-latest)/test-results.xml [took 0s]
test_get_aoai_telemetry_headers (tests.executor.unittests._core.test_api_injector) with error: tests.executor.unittests._core.test_api_injector#L0
artifacts/Test Results (Python 3.9) (OS ubuntu-latest)/test-results.xml [took 0s]
test_inject_and_recover_openai_api (tests.executor.unittests._core.test_api_injector) with error: tests.executor.unittests._core.test_api_injector#L0
artifacts/Test Results (Python 3.9) (OS ubuntu-latest)/test-results.xml [took 0s]
test_creation (tests.executor.unittests.contracts.test_run_info.TestRunInfo) with error: tests.executor.unittests.contracts.test_run_info.TestRunInfo#L0
artifacts/Test Results (Python 3.9) (OS ubuntu-latest)/test-results.xml [took 0s]
test_node_status (tests.executor.unittests.batch.test_result.TestBatchResult) with error: tests.executor.unittests.batch.test_result.TestBatchResult#L0
artifacts/Test Results (Python 3.9) (OS ubuntu-latest)/test-results.xml [took 0s]
test_system_metrics (tests.executor.unittests.batch.test_result.TestBatchResult) with error: tests.executor.unittests.batch.test_result.TestBatchResult#L0
artifacts/Test Results (Python 3.9) (OS ubuntu-latest)/test-results.xml [took 0s]
test_error_summary (tests.executor.unittests.batch.test_result.TestBatchResult) with error: tests.executor.unittests.batch.test_result.TestBatchResult#L0
artifacts/Test Results (Python 3.9) (OS ubuntu-latest)/test-results.xml [took 0s]
test_create (tests.executor.unittests.batch.test_result.TestErrorSummary) with error: tests.executor.unittests.batch.test_result.TestErrorSummary#L0
artifacts/Test Results (Python 3.9) (OS ubuntu-latest)/test-results.xml [took 0s]
test_create (tests.executor.unittests.batch.test_result.TestSystemMetrics) with error: tests.executor.unittests.batch.test_result.TestSystemMetrics#L0
artifacts/Test Results (Python 3.9) (OS ubuntu-latest)/test-results.xml [took 0s]
test_generator_proxy_next (tests.executor.unittests._core.test_generator_proxy) with error: tests.executor.unittests._core.test_generator_proxy#L0
artifacts/Test Results (Python 3.9) (OS ubuntu-latest)/test-results.xml [took 0s]
test_generator_proxy_iter (tests.executor.unittests._core.test_generator_proxy) with error: tests.executor.unittests._core.test_generator_proxy#L0
artifacts/Test Results (Python 3.9) (OS ubuntu-latest)/test-results.xml [took 0s]
test_generate_from_proxy (tests.executor.unittests._core.test_generator_proxy) with error: tests.executor.unittests._core.test_generator_proxy#L0
artifacts/Test Results (Python 3.9) (OS ubuntu-latest)/test-results.xml [took 0s]
test_iterator_proxy_next (tests.executor.unittests._core.test_generator_proxy) with error: tests.executor.unittests._core.test_generator_proxy#L0
artifacts/Test Results (Python 3.9) (OS ubuntu-latest)/test-results.xml [took 0s]
test_iterator_proxy_iter (tests.executor.unittests._core.test_generator_proxy) with error: tests.executor.unittests._core.test_generator_proxy#L0
artifacts/Test Results (Python 3.9) (OS ubuntu-latest)/test-results.xml [took 0s]
test_parse[Test-Test] (tests.executor.unittests.contracts.test_run_mode) with error: tests.executor.unittests.contracts.test_run_mode#L0
artifacts/Test Results (Python 3.9) (OS ubuntu-latest)/test-results.xml [took 0s]
test_generate_from_iterator_proxy (tests.executor.unittests._core.test_generator_proxy) with error: tests.executor.unittests._core.test_generator_proxy#L0
artifacts/Test Results (Python 3.9) (OS ubuntu-latest)/test-results.xml [took 0s]
test_parse[SingleNode-SingleNode] (tests.executor.unittests.contracts.test_run_mode) with error: tests.executor.unittests.contracts.test_run_mode#L0
artifacts/Test Results (Python 3.9) (OS ubuntu-latest)/test-results.xml [took 0s]
test_parse[Batch-Batch] (tests.executor.unittests.contracts.test_run_mode) with error: tests.executor.unittests.contracts.test_run_mode#L0
artifacts/Test Results (Python 3.9) (OS ubuntu-latest)/test-results.xml [took 0s]
test_parse[Default-Test] (tests.executor.unittests.contracts.test_run_mode) with error: tests.executor.unittests.contracts.test_run_mode#L0
artifacts/Test Results (Python 3.9) (OS ubuntu-latest)/test-results.xml [took 0s]
test_parse_invalid (tests.executor.unittests.contracts.test_run_mode) with error: tests.executor.unittests.contracts.test_run_mode#L0
artifacts/Test Results (Python 3.9) (OS ubuntu-latest)/test-results.xml [took 0s]
test_secret (tests.executor.unittests.contracts.test_types) with error: tests.executor.unittests.contracts.test_types#L0
artifacts/Test Results (Python 3.9) (OS ubuntu-latest)/test-results.xml [took 0s]
test_line_record (tests.executor.unittests.storage.test_run_records) with error: tests.executor.unittests.storage.test_run_records#L0
artifacts/Test Results (Python 3.9) (OS ubuntu-latest)/test-results.xml [took 0s]
test_prompt_template (tests.executor.unittests.contracts.test_types) with error: tests.executor.unittests.contracts.test_types#L0
artifacts/Test Results (Python 3.9) (OS ubuntu-latest)/test-results.xml [took 0s]
test_file_path (tests.executor.unittests.contracts.test_types) with error: tests.executor.unittests.contracts.test_types#L0
artifacts/Test Results (Python 3.9) (OS ubuntu-latest)/test-results.xml [took 0s]
test_line_serialize (tests.executor.unittests.storage.test_run_records) with error: tests.executor.unittests.storage.test_run_records#L0
artifacts/Test Results (Python 3.9) (OS ubuntu-latest)/test-results.xml [took 0s]
test_assistant_definition (tests.executor.unittests.contracts.test_types) with error: tests.executor.unittests.contracts.test_types#L0
artifacts/Test Results (Python 3.9) (OS ubuntu-latest)/test-results.xml [took 0s]
test_resolve_tool_error (tests.executor.unittests.executor.test_errors) with error: tests.executor.unittests.executor.test_errors#L0
artifacts/Test Results (Python 3.9) (OS ubuntu-latest)/test-results.xml [took 0s]
test_node_record (tests.executor.unittests.storage.test_run_records) with error: tests.executor.unittests.storage.test_run_records#L0
artifacts/Test Results (Python 3.9) (OS ubuntu-latest)/test-results.xml [took 0s]
test_resolve_tool_error_with_none_inner (tests.executor.unittests.executor.test_errors) with error: tests.executor.unittests.executor.test_errors#L0
artifacts/Test Results (Python 3.9) (OS ubuntu-latest)/test-results.xml [took 0s]
test_node_serialize (tests.executor.unittests.storage.test_run_records) with error: tests.executor.unittests.storage.test_run_records#L0
artifacts/Test Results (Python 3.9) (OS ubuntu-latest)/test-results.xml [took 0s]
test_get_feature_list (tests.executor.unittests._utils.test_feature_utils) with error: tests.executor.unittests._utils.test_feature_utils#L0
artifacts/Test Results (Python 3.9) (OS ubuntu-latest)/test-results.xml [took 0s]
test_visualization_render (tests.executor.unittests.contracts.test_run_management) with error: tests.executor.unittests.contracts.test_run_management#L0
artifacts/Test Results (Python 3.9) (OS ubuntu-latest)/test-results.xml [took 0s]
build
Node.js 16 actions are deprecated. Please update the following actions to use Node.js 20: actions/setup-python@v4, actions/upload-artifact@v3. For more information see: https://github.blog/changelog/2023-09-22-github-actions-transitioning-from-node-16-to-node-20/.
executor_unit_tests (ubuntu-latest)
Node.js 16 actions are deprecated. Please update the following actions to use Node.js 20: azure/login@v1, actions/setup-python@v4, actions/download-artifact@v3, SimenB/github-actions-cpu-cores@v1, actions/upload-artifact@v3. For more information see: https://github.blog/changelog/2023-09-22-github-actions-transitioning-from-node-16-to-node-20/.
Publish Tests Results
Node.js 16 actions are deprecated. Please update the following actions to use Node.js 20: actions/download-artifact@v3. For more information see: https://github.blog/changelog/2023-09-22-github-actions-transitioning-from-node-16-to-node-20/.
Publish Tests Results
Unexpected input(s) 'token', valid inputs are ['testActionFileName', 'testResultTitle', 'osVersion', 'pythonVersion', 'coverageThreshold', 'context']
2 tests found
There are 2 tests, see "Raw output" for the full list of tests.
1 skipped test found
There is 1 skipped test, see "Raw output" for the name of the skipped test.
186 tests found
There are 186 tests, see "Raw output" for the full list of tests.
701 tests found (test 1 to 536)
There are 701 tests, see "Raw output" for the list of tests 1 to 536.
701 tests found (test 537 to 701)
There are 701 tests, see "Raw output" for the list of tests 537 to 701.

Artifacts

Produced during runtime
Name Size
Test Results (Python 3.9) (OS ubuntu-latest) Expired
5.22 MB
wheel Expired
2.45 MB