chore: retrieves the exact model running status upon message error

[louis-menlo]

Describe Your Changes

• In previous versions, the model was marked as stopped as soon as a message error occurred. However, it could be an issue with the inference parameters, meaning the model was still running, leading to an incorrect status. This PR aims to improve this by checking the model status before marking it as not started.
• This also updates legacy model.json settings & inferences to overwrite cortex.cpp prompt extraction from the model's metadata, which could cause issues.

Changes made

The changes in the provided diff focus on adding a feature to check the loading status of a model and ensuring better code readability. Here’s a summary of the changes:

1. ModelExtension Class in model.ts:

   • Added a new abstract method isModelLoaded(model: string): Promise<boolean> to check if a model is loaded.

2. CortexAPI in cortex.ts:

   • Reformatted the importModel method for better readability by spreading its parameters over multiple lines.
   • Added a new method getModelStatus(model: string): Promise<boolean> which sends a GET request to check the status of a model and returns true if successful, false otherwise.
   • Minor formatting change in the finalizeModel method to add a comma at the end of the model metadata.

3. JanModelExtension in index.ts:

   • Implemented the isModelLoaded method which uses the newly added getModelStatus method from CortexAPI to check a model's loading status.

4. EventHandler in EventHandler.tsx:

   • Imported ModelExtension.
   • Enhanced error handling by checking if the active model is still loaded. If not, it sets the active model to undefined and resets the state model, ensuring that the application handles model load status accurately.

These changes collectively improve the application's ability to verify and respond to the model's loading status and improve method readability by spreading parameters on multiple lines.

[github-actions]

Barecheck - Code coverage report

Total: 69.58%

Your code coverage diff: 0.00% ▴

Uncovered files and lines

File	Lines
core/src/browser/extensions/model.ts	12
web/hooks/useModels.ts	49, 62-63, 67