Feat/model import cmd

[nguyenhoangthuan99]

Related Issues

Fix #1249

Add Model Import Command to CLI

This PR introduces a new import subcommand to the models command in our CLI application. The new functionality allows users to import GGUF (GPT-Generated Unified Format) models from local files into the application.

Features

• Import GGUF models using a specified model ID and file path
• Automatically parse GGUF files to extract model configuration
• Generate and store YAML configuration files for imported models
• Add imported models to the model list for easy management

Implementation Details

The implementation consists of two main parts:

1. ModelImportCmd class in model_import_cmd.h and model_import_cmd.cpp
2. CLI11 command setup in the main application file

ModelImportCmd

This class handles the core logic of importing a model:

• Parses the GGUF file using GGUFHandler
• Creates a ModelConfig object with the parsed information
• Generates a YAML configuration file using YamlHandler
• Adds the model entry to the model list using ModelListUtils

Error handling is implemented to ensure robust operation, including cleaning up partially created files in case of failures.

CLI Setup

The import subcommand is added to the models command with the following options:

• --model_id: A required option to specify the unique identifier for the imported model
• --model_path: A required option to specify the absolute path to the GGUF model file

Usage

To import a model, users can now use the following command:

./cortex models import --model_id <unique_model_id> --model_path /path/to/your/model.gguf

[nguyenhoangthuan99]

Need to add API for model import, to allow Jan's user import their models

[dan-menlo]

Need to add API for model import, to allow Jan's user import their models

@nguyenhoangthuan99 Will we be implementing the API as a separate issue?

[dan-menlo]

Lgtm - will let @vansangpfiev @namchuai evaluate for code.

• Import API will be separate PR?

[nguyenhoangthuan99]

I added API in this PR because the logic is the same, and it makes us easier to track.

[dan-menlo]

Closes #1058