[Report errors using the data and models provided on the official website] <Test Error>

[2414466154]

Is there an existing issue for this?

• I have searched the existing issues

Description

No response

Current Behavior

No response

Expected Behavior

No response

Steps To Reproduce

No response

Environment

- Operating System and Version:
- AI Verify Version:
- Any other relevant information (e.g. version of related package dependencies installed):

Did you build using source code or from docker file? If from source code, please provide the below information:
- Python Version:
- Node Version:
- Redis Version:
- Mongo Version: 
- Screen Resolution:

Screenshots/ Code snippets

2023-10-22 17:27:14,055 [INFO][app_logger.py::add_to_log(116)] [task_processing.py:run_task_processing_in_process(66)]: The task validation is successful: task:6534bdf13585ef039a5ac224-6534eaf23585ef039a5c137d
2023-10-22 17:27:14,056 [INFO][app_logger.py::add_to_log(116)] [task_processing.py:run_task_processing_in_process(71)]: Working on task: message_id 1697966834021-0, message_args {"mode":"upload","id":"task:6534bdf13585ef039a5ac224-6534eaf23585ef039a5c137d","algorithmId":"algo:aiverify.stock.shap_toolbox:shap_toolbox","algorithmArgs":{"explain_type":"global","background_path":"/app/aiverify/uploads/data/pickle_pandas_mock_binary_classification_credit_risk_testing.sav","background_samples":23,"data_samples":25},"testDataset":"/app/aiverify/uploads/data/pickle_pandas_mock_binary_classification_credit_risk_testing.sav","modelFile":"/app/aiverify/uploads/model/my_binary_classification_mock_credit_risk_sklearn.linear_model._logistic.LogisticRegression.sav","groundTruthDataset":"/app/aiverify/uploads/data/pickle_pandas_mock_binary_classification_credit_risk_testing.sav","modelType":"classification","groundTruth":"gender"}, task_type: TaskType.NEW
2023-10-22 17:27:14,056 [INFO][app_logger.py::add_to_log(116)] [task_result.py:set_status(146)]: The current task has changed status to TaskStatus.RUNNING
2023-10-22 17:27:14,056 [INFO][app_logger.py::add_to_log(116)] [task_processing.py:process_new_task(110)]: Sending task update
2023-10-22 17:27:14,062 [INFO][app_logger.py::add_to_log(116)] [stream_processing.py:detect_pipeline(30)]: Attempting to detect pipeline model from the given path
2023-10-22 17:27:14,062 [INFO][log_utils.py::log_message(31)] [pipeline_manager.py:read_pipeline_path(55)]: Attempting to read pipeline: /app/aiverify/uploads/model/my_binary_classification_mock_credit_risk_sklearn.linear_model._logistic.LogisticRegression.sav
2023-10-22 17:27:14,062 [INFO][log_utils.py::log_message(31)] [pipeline_manager.py:read_pipeline_path(83)]: Pipeline validation successful
2023-10-22 17:27:14,063 [ERROR][log_utils.py::log_message(37)] [pipeline_manager.py:read_pipeline_path(101)]: There was an error getting pipeline files in the folder
2023-10-22 17:27:14,063 [INFO][app_logger.py::add_to_log(116)] [task_processing.py:_load_instances(277)]: Unable to find pipeline model. Loading non-pipeline instances
2023-10-22 17:27:14,063 [INFO][log_utils.py::log_message(31)] [data_manager.py:read_data(56)]: Attempting to read data: /app/aiverify/uploads/data/pickle_pandas_mock_binary_classification_credit_risk_testing.sav
2023-10-22 17:27:14,064 [INFO][log_utils.py::log_message(31)] [data_manager.py:read_data(81)]: Data validation successful
2023-10-22 17:27:14,064 [INFO][log_utils.py::log_message(31)] [data_manager.py:read_data(89)]: Attempting to deserialize data: /app/aiverify/uploads/data/pickle_pandas_mock_binary_classification_credit_risk_testing.sav
2023-10-22 17:27:14,068 [INFO][app_logger.py::add_to_log(116)] [task.py:_send_task_update(278)]: Task has received notification to send task update
2023-10-22 17:27:14,070 [INFO][log_utils.py::log_message(31)] [data_manager.py:read_data(157)]: Consolidation results: {pandasdata.Plugin object at 0x7f4d45f2f890} {class 'pickleserializer.Plugin'}
2023-10-22 17:27:14,070 [INFO][log_utils.py::log_message(31)] [data_manager.py:read_data(181)]: Supported data format: DataPluginType.PANDAS[SerializerPluginType.PICKLE]
2023-10-22 17:27:14,070 [INFO][app_logger.py::add_to_log(116)] [stream_processing.py:load_data(75)]: Data Instance: {pandasdata.Plugin object at 0x7f4d45f2f890}, Data Deserializer: SerializerPluginType.PICKLE
2023-10-22 17:27:14,070 [INFO][app_logger.py::add_to_log(116)] [worker.py:_send_update(614)]: The update sent successfully: task:6534bdf13585ef039a5ac224-6534eaf23585ef039a5c137d:{'type': 'TaskResponse', 'status': 'Running', 'elapsedTime': 0, 'startTime': '2023-10-22T17:27:14.055111', 'output': '""', 'logFile': '/app/aiverify/test-engine-app/logs/task:6534bdf13585ef039a5ac224-6534eaf23585ef039a5c137d.log', 'taskProgress': 0}
2023-10-22 17:27:14,071 [INFO][log_utils.py::log_message(31)] [model_manager.py:read_model_file(51)]: Attempting to read model: /app/aiverify/uploads/model/my_binary_classification_mock_credit_risk_sklearn.linear_model._logistic.LogisticRegression.sav
2023-10-22 17:27:14,071 [INFO][log_utils.py::log_message(31)] [model_manager.py:read_model_file(78)]: Model validation successful
2023-10-22 17:27:14,071 [INFO][log_utils.py::log_message(31)] [model_manager.py:read_model_file(84)]: Attempting to deserialize model: /app/aiverify/uploads/model/my_binary_classification_mock_credit_risk_sklearn.linear_model._logistic.LogisticRegression.sav
2023-10-22 17:27:14,096 [INFO][log_utils.py::log_message(31)] [model_manager.py:read_model_file(107)]: Attempting to identify model format: {class 'sklearn.linear_model._logistic.LogisticRegression'}
2023-10-22 17:27:14,096 [INFO][log_utils.py::log_message(31)] [model_manager.py:read_model_file(117)]: Supported model format: {class 'sklearn.linear_model._logistic.LogisticRegression'}, ModelPluginType.SKLEARN[sklearn.linear_model._logistic.LogisticRegression]
2023-10-22 17:27:14,096 [INFO][app_logger.py::add_to_log(116)] [stream_processing.py:load_model(201)]: Model Instance: {sklearnmodel.Plugin object at 0x7f4d44aaea90}, Model Deserializer: SerializerPluginType.PICKLE
2023-10-22 17:27:14,096 [INFO][log_utils.py::log_message(31)] [data_manager.py:read_data(56)]: Attempting to read data: /app/aiverify/uploads/data/pickle_pandas_mock_binary_classification_credit_risk_testing.sav
2023-10-22 17:27:14,096 [INFO][log_utils.py::log_message(31)] [data_manager.py:read_data(81)]: Data validation successful
2023-10-22 17:27:14,097 [INFO][log_utils.py::log_message(31)] [data_manager.py:read_data(89)]: Attempting to deserialize data: /app/aiverify/uploads/data/pickle_pandas_mock_binary_classification_credit_risk_testing.sav
2023-10-22 17:27:14,097 [INFO][log_utils.py::log_message(31)] [data_manager.py:read_data(157)]: Consolidation results: {pandasdata.Plugin object at 0x7f4d44da93d0} {class 'pickleserializer.Plugin'}
2023-10-22 17:27:14,098 [INFO][log_utils.py::log_message(31)] [data_manager.py:read_data(181)]: Supported data format: DataPluginType.PANDAS[SerializerPluginType.PICKLE]
2023-10-22 17:27:14,098 [INFO][app_logger.py::add_to_log(116)] [stream_processing.py:load_ground_truth(259)]: GroundTruth Instance: {pandasdata.Plugin object at 0x7f4d44da93d0}, GroundTruth Deserializer: SerializerPluginType.PICKLE
2023-10-22 17:27:14,102 [ERROR][log_utils.py::log_message(37)] [algorithm_manager.py:get_algorithm(126)]: There was an error getting algorithm instance (not found): algo:aiverify.stock.shap_toolbox:shap_toolbox
2023-10-22 17:27:14,102 [INFO][app_logger.py::add_to_log(116)] [plugin_controller.py:get_plugin_instance(112)]: Attempting to find algo:aiverify.stock.shap_toolbox:shap_toolbox in the algorithm registry
2023-10-22 17:27:14,104 [INFO][app_logger.py::add_to_log(116)] [plugin_controller.py:get_plugin_instance(141)]: algo:aiverify.stock.shap_toolbox:shap_toolbox is in the algorithm registry. Attempting to re-discover algorithm
2023-10-22 17:27:14,110 [ERROR][log_utils.py::log_message(37)] [algorithm_manager.py:get_algorithm(126)]: There was an error getting algorithm instance (not found): algo:aiverify.stock.shap_toolbox:shap_toolbox
2023-10-22 17:27:14,110 [WARNING][app_logger.py::add_to_log(121)] [task_processing.py:process_new_task(189)]: The task terminated: Unable to get algorithm instance: There was an error loading algorithm: There was an error getting algorithm instance (not found): algo:aiverify.stock.shap_toolbox:shap_toolbox
2023-10-22 17:27:14,111 [INFO][app_logger.py::add_to_log(116)] [task_result.py:set_progress(114)]: The current task completion progress is 100
2023-10-22 17:27:14,111 [INFO][app_logger.py::add_to_log(116)] [task_result.py:set_status(146)]: The current task has changed status to TaskStatus.ERROR
2023-10-22 17:27:14,141 [INFO][app_logger.py::add_to_log(116)] [worker.py:_send_update(614)]: The update sent successfully: task:6534bdf13585ef039a5ac224-6534eaf23585ef039a5c137d:{'type': 'TaskResponse', 'status': 'Error', 'elapsedTime': 0, 'startTime': '2023-10-22T17:27:14.055111', 'output': '', 'errorMessages': '[{"category": "SYSTEM_ERROR", "code": "CSYSx00146", "description": "Task Terminated: Unable to get algorithm instance: There was an error loading algorithm: There was an error getting algorithm instance (not found): algo:aiverify.stock.shap_toolbox:shap_toolbox", "severity": "warning", "component": "task_processing.py"}]', 'logFile': '/app/aiverify/test-engine-app/logs/task:6534bdf13585ef039a5ac224-6534eaf23585ef039a5c137d.log', 'taskProgress': 100}
2023-10-22 17:27:14,141 [INFO][app_logger.py::add_to_log(116)] [worker.py:_send_acknowledgement(659)]: The acknowledgement sent successfully - 1697966834021-0
2023-10-22 17:27:14,141 [INFO][app_logger.py::add_to_log(116)] [task.py:cleanup(104)]: The system has received notification to clean up task

Additional Context

No response

Possible Solution (Optional)

No response

[imda-benedictlee]

Hi @2414466154, thank you for bringing this issue to our attention. May I know which version of AI Verify were you using when the error occurred?

[imda-benedictlee]

Hi @2414466154, I would like to check in with you to see if you require any assistance or have any updates for me regarding the version of AI Verify that you were using when the error occurred?