Skip to content
Permalink

Comparing changes

Choose two branches to see what’s changed or to start a new pull request. If you need to, you can also or learn more about diff comparisons.

Open a pull request

Create a new pull request by comparing changes across two branches. If you need to, you can also . Learn more about diff comparisons here.
base repository: janhq/cortex.cpp
Failed to load repositories. Confirm that selected base ref is valid, then try again.
Loading
base: v1.0.5-rc1
Choose a base ref
...
head repository: janhq/cortex.cpp
Failed to load repositories. Confirm that selected head ref is valid, then try again.
Loading
compare: dev
Choose a head ref
Loading
Showing with 25,980 additions and 3,711 deletions.
  1. +18 −0 .devcontainer/Dockerfile
  2. +35 −0 .devcontainer/devcontainer.json
  3. +59 −0 .devcontainer/reinstall-cmake.sh
  4. +24 −4 .github/workflows/beta-build.yml
  5. +284 −0 .github/workflows/cortex-cpp-quality-gate.yml
  6. +19 −2 .github/workflows/nightly-build.yml
  7. +72 −0 .github/workflows/python-script-package.yml
  8. +275 −0 .github/workflows/python-venv-package.yml
  9. +17 −1 .github/workflows/stable-build.yml
  10. +50 −30 .github/workflows/{template-build-linux-x64.yml → template-build-linux.yml}
  11. +7 −1 .gitignore
  12. +111 −0 BUILDING.md
  13. +103 −341 README.md
  14. BIN assets/cortex-banner.png
  15. +0 −4 docs/docs/architecture.mdx
  16. +66 −6 docs/docs/architecture/cortex-db.mdx
  17. +35 −9 docs/docs/architecture/cortexrc.mdx
  18. +62 −44 docs/docs/architecture/data-folder.mdx
  19. +10 −9 docs/docs/architecture/updater.mdx
  20. +178 −1 docs/docs/assistants/index.md
  21. +7 −9 docs/docs/basic-usage/cortex-js.md
  22. +2 −2 docs/docs/basic-usage/cortex-py.md
  23. +129 −36 docs/docs/basic-usage/index.mdx
  24. +48 −56 docs/docs/capabilities/embeddings.md
  25. +24 −20 docs/docs/capabilities/hardware/index.mdx
  26. +23 −27 docs/docs/capabilities/models/index.mdx
  27. +55 −41 docs/docs/capabilities/models/model-yaml.mdx
  28. +4 −3 docs/docs/capabilities/models/presets.mdx
  29. +184 −3 docs/docs/capabilities/text-generation.md
  30. +2 −5 docs/docs/chat-completions.mdx
  31. +35 −10 docs/docs/cli/config.mdx
  32. +16 −11 docs/docs/cli/engines/index.mdx
  33. +83 −25 docs/docs/cli/models/index.mdx
  34. +17 −3 docs/docs/cli/ps.mdx
  35. +7 −5 docs/docs/cli/pull.mdx
  36. +8 −8 docs/docs/cli/run.mdx
  37. +1 −4 docs/docs/cli/start.mdx
  38. +5 −1 docs/docs/cli/stop.mdx
  39. +2 −4 docs/docs/cli/update.mdx
  40. +64 −60 docs/docs/configurations/cors.mdx
  41. +4 −4 docs/docs/configurations/index.mdx
  42. +24 −28 docs/docs/configurations/proxy.mdx
  43. +19 −22 docs/docs/configurations/token.mdx
  44. +0 −4 docs/docs/cortex-cpp.md
  45. +2 −5 docs/docs/cortex-llamacpp.mdx
  46. +3 −6 docs/docs/embeddings.mdx
  47. +41 −72 docs/docs/engines/index.mdx
  48. +62 −55 docs/docs/engines/llamacpp.mdx
  49. +7 −4 docs/docs/engines/onnx.mdx
  50. +246 −0 docs/docs/engines/python-engine.mdx
  51. +30 −7 docs/docs/engines/tensorrt-llm.mdx
  52. +158 −283 docs/docs/guides/function-calling.md
  53. +105 −123 docs/docs/guides/structured-outputs.md
  54. +13 −16 docs/docs/installation.mdx
  55. +246 −126 docs/docs/installation/docker.mdx
  56. +9 −13 docs/docs/installation/linux.mdx
  57. +35 −27 docs/docs/installation/mac.mdx
  58. +24 −27 docs/docs/installation/windows.mdx
  59. +33 −87 docs/docs/overview.mdx
  60. +48 −53 docs/docs/quickstart.mdx
  61. +5 −9 docs/docs/requirements.mdx
  62. +2 −6 docs/docs/telemetry.mdx
  63. +1 −0 docs/sidebars.ts
  64. BIN docs/static/img/cortex_hub.png
  65. BIN docs/static/img/mitproxy_ex.png
  66. BIN docs/static/img/social-card-old.jpg
  67. BIN docs/static/img/social-card.jpg
  68. BIN docs/static/img/sqlite_view_harlequin.png
  69. +611 −76 docs/static/openapi/cortex.json
  70. +1 −0 engine/.gitignore
  71. +14 −4 engine/CMakeLists.txt
  72. +5 −2 engine/Makefile
  73. +12 −3 engine/cli/CMakeLists.txt
  74. +9 −6 engine/cli/command_line_parser.cc
  75. +1 −0 engine/cli/command_line_parser.h
  76. +7 −9 engine/cli/commands/chat_completion_cmd.cc
  77. +4 −0 engine/cli/commands/chat_completion_cmd.h
  78. +4 −2 engine/cli/commands/hardware_list_cmd.cc
  79. +1 −1 engine/cli/commands/model_start_cmd.cc
  80. +8 −1 engine/cli/commands/model_start_cmd.h
  81. +1 −1 engine/cli/commands/model_status_cmd.cc
  82. +6 −0 engine/cli/commands/model_upd_cmd.cc
  83. +8 −10 engine/cli/commands/run_cmd.cc
  84. +6 −1 engine/cli/commands/run_cmd.h
  85. +26 −23 engine/cli/commands/server_start_cmd.cc
  86. +0 −4 engine/cli/utils/download_progress.cc
  87. +267 −4 engine/common/assistant.h
  88. +32 −0 engine/common/assistant_code_interpreter_tool.h
  89. +151 −0 engine/common/assistant_file_search_tool.h
  90. +130 −0 engine/common/assistant_function_tool.h
  91. +12 −76 engine/common/assistant_tool.h
  92. +4 −3 engine/common/base.h
  93. +12 −1 engine/common/download_task.h
  94. +211 −0 engine/common/dto/assistant_create_dto.h
  95. +201 −0 engine/common/dto/assistant_update_dto.h
  96. +16 −0 engine/common/dto/base_dto.h
  97. +5 −1 engine/common/engine_servicei.h
  98. +12 −6 engine/common/hardware_common.h
  99. +10 −5 engine/common/message_attachment.h
  100. +29 −0 engine/common/model_metadata.h
  101. +25 −0 engine/common/repository/assistant_repository.h
  102. +6 −6 engine/common/thread.h
  103. +0 −50 engine/common/thread_tool_resources.h
  104. +72 −0 engine/common/tokenizer.h
  105. +114 −0 engine/common/tool_resources.h
  106. +365 −81 engine/config/model_config.h
  107. +65 −59 engine/config/yaml_config.cc
  108. +184 −1 engine/controllers/assistants.cc
  109. +39 −0 engine/controllers/assistants.h
  110. +146 −42 engine/controllers/engines.cc
  111. +11 −7 engine/controllers/engines.h
  112. +5 −12 engine/controllers/files.cc
  113. +2 −2 engine/controllers/hardware.h
  114. +1 −1 engine/controllers/messages.h
  115. +96 −62 engine/controllers/models.cc
  116. +12 −4 engine/controllers/models.h
  117. +6 −3 engine/controllers/process_manager.cc
  118. +7 −0 engine/controllers/process_manager.h
  119. +103 −8 engine/controllers/server.cc
  120. +11 −4 engine/controllers/server.h
  121. +9 −22 engine/controllers/swagger.cc
  122. +31 −4 engine/controllers/swagger.h
  123. +1 −1 engine/controllers/threads.h
  124. +8 −0 engine/cortex-common/EngineI.h
  125. +3 −1 engine/cortex-common/remote_enginei.h
  126. +0 −2 engine/cortex-cpp-deps/.gitignore
  127. +0 −129 engine/cortex-cpp-deps/CMakeLists.txt
  128. +0 −11 engine/cortex-cpp-deps/README.md
  129. +1 −1 engine/database/engines.h
  130. +37 −0 engine/database/hardware.cc
  131. +4 −0 engine/database/hardware.h
  132. +45 −17 engine/database/models.cc
  133. +2 −3 engine/database/models.h
  134. BIN engine/deps/linux/libvulkan.so
  135. BIN engine/deps/windows/vulkan-1.dll
  136. +284 −0 engine/e2e-test/local_test.py
  137. +2 −2 engine/e2e-test/test_api_engine.py
  138. +1 −1 engine/e2e-test/test_api_engine_update.py
  139. +1 −0 engine/e2e-test/test_api_model.py
  140. +5 −5 engine/e2e-test/test_cli_engine_get.py
  141. +4 −4 engine/e2e-test/test_cli_engine_install.py
  142. +3 −2 engine/e2e-test/test_cli_engine_install_nightly.py
  143. +1 −1 engine/e2e-test/test_cli_engine_uninstall.py
  144. +66 −0 engine/examples/inja/CMakeLists.txt
  145. +5 −0 engine/examples/inja/README.md
  146. +17 −0 engine/examples/inja/data.txt
  147. +45 −0 engine/examples/inja/main.cc
  148. +10 −0 engine/examples/inja/template.txt
  149. +918 −0 engine/extensions/python-engine/python_engine.cc
  150. +111 −0 engine/extensions/python-engine/python_engine.h
  151. +0 −62 engine/extensions/remote-engine/anthropic_engine.cc
  152. +0 −13 engine/extensions/remote-engine/anthropic_engine.h
  153. +80 −0 engine/extensions/remote-engine/helper.h
  154. +0 −54 engine/extensions/remote-engine/openai_engine.cc
  155. +0 −14 engine/extensions/remote-engine/openai_engine.h
  156. +247 −196 engine/extensions/remote-engine/remote_engine.cc
  157. +21 −12 engine/extensions/remote-engine/remote_engine.h
  158. +8 −7 engine/extensions/{remote-engine → }/template_renderer.cc
  159. +1 −1 engine/extensions/{remote-engine → }/template_renderer.h
  160. +104 −25 engine/main.cc
  161. +214 −0 engine/repositories/assistant_fs_repository.cc
  162. +59 −0 engine/repositories/assistant_fs_repository.h
  163. +5 −9 engine/repositories/file_fs_repository.cc
  164. +5 −2 engine/repositories/file_fs_repository.h
  165. +1 −1 engine/repositories/message_fs_repository.h
  166. +180 −0 engine/services/assistant_service.cc
  167. +28 −4 engine/services/assistant_service.h
  168. +130 −0 engine/services/database_service.cc
  169. +69 −0 engine/services/database_service.h
  170. +13 −11 engine/services/download_service.cc
  171. +5 −3 engine/services/download_service.h
  172. +152 −131 engine/services/engine_service.cc
  173. +19 −15 engine/services/engine_service.h
  174. +2 −2 engine/services/file_service.cc
  175. +178 −50 engine/services/hardware_service.cc
  176. +9 −4 engine/services/hardware_service.h
  177. +119 −2 engine/services/inference_service.cc
  178. +18 −3 engine/services/inference_service.h
  179. +2 −5 engine/services/message_service.cc
  180. +296 −130 engine/services/model_service.cc
  181. +32 −32 engine/services/model_service.h
  182. +170 −117 engine/services/model_source_service.cc
  183. +46 −11 engine/services/model_source_service.h
  184. +5 −7 engine/services/thread_service.cc
  185. +2 −3 engine/services/thread_service.h
  186. +1 −1 engine/templates/linux/control
  187. +3 −1 engine/templates/linux/create_deb.sh
  188. +2 −1 engine/templates/linux/create_deb_local.sh
  189. +21 −10 engine/templates/linux/install.sh
  190. +1 −0 engine/templates/windows/installer-beta.iss
  191. +1 −0 engine/templates/windows/installer-nightly.iss
  192. +1 −0 engine/templates/windows/installer.iss
  193. +1 −0 engine/templates/windows/local-installer-beta.iss
  194. +1 −0 engine/templates/windows/local-installer-nightly.iss
  195. +1 −0 engine/templates/windows/local-installer.iss
  196. +1 −0 engine/test/components/CMakeLists.txt
  197. +4 −0 engine/test/components/main.cc
  198. +194 −0 engine/test/components/test_assistant.cc
  199. +49 −0 engine/test/components/test_assistant_tool_code_interpreter.cc
  200. +207 −0 engine/test/components/test_assistant_tool_file_search.cc
  201. +240 −0 engine/test/components/test_assistant_tool_function.cc
  202. +13 −0 engine/test/components/test_engine_matcher_utils.cc
  203. +6 −6 engine/test/components/test_format_utils.cc
  204. +122 −123 engine/test/components/test_gguf_parser.cc
  205. +58 −0 engine/test/components/test_json_helper.cc
  206. +478 −0 engine/test/components/test_remote_engine.cc
  207. +212 −0 engine/test/components/test_tool_resources.cc
  208. +6 −0 engine/test/components/test_yaml_handler.cc
  209. +137 −0 engine/utils/chat-template.hpp
  210. +6 −1 engine/utils/config_yaml_utils.cc
  211. +9 −2 engine/utils/config_yaml_utils.h
  212. +25 −9 engine/utils/cortex_utils.h
  213. +85 −31 engine/utils/curl_utils.cc
  214. +7 −2 engine/utils/curl_utils.h
  215. +7 −6 engine/utils/engine_constants.h
  216. +5 −0 engine/utils/engine_matcher_utils.h
  217. +2 −2 engine/utils/file_logger.cc
  218. +5 −2 engine/utils/file_manager_utils.cc
  219. +2 −1 engine/utils/file_manager_utils.h
  220. +9 −9 engine/utils/format_utils.h
  221. +420 −0 engine/utils/gguf_metadata_reader.h
  222. +1 −1 engine/utils/github_release_utils.h
  223. +8 −1 engine/utils/hardware/cpu_info.h
  224. +162 −0 engine/utils/hardware/cpu_usage.h
  225. +2,596 −0 engine/utils/hardware/gpu/adl/adl_defines.h
  226. +46 −0 engine/utils/hardware/gpu/adl/adl_sdk.h
  227. +4,289 −0 engine/utils/hardware/gpu/adl/adl_structures.h
  228. +1,355 −0 engine/utils/hardware/gpu/adl/amd_ags.h
  229. +84 −0 engine/utils/hardware/gpu/vulkan/vk_platform.h
  230. +99 −0 engine/utils/hardware/gpu/vulkan/vulkan.h
  231. +433 −0 engine/utils/hardware/gpu/vulkan/vulkan_core.h
  232. +425 −0 engine/utils/hardware/gpu/vulkan/vulkan_gpu.h
  233. +38 −16 engine/utils/hardware/gpu_info.h
  234. +101 −0 engine/utils/huggingface_utils.h
  235. +27 −0 engine/utils/jinja_utils.h
  236. +24 −0 engine/utils/json_helper.h
  237. +3,428 −0 engine/utils/minja.hpp
  238. +106 −0 engine/utils/process/utils.cc
  239. +25 −0 engine/utils/process/utils.h
  240. +56 −0 engine/utils/process_status_utils.h
  241. +76 −0 engine/utils/set_permission_utils.h
  242. +38 −0 engine/utils/string_utils.h
  243. +17 −11 engine/utils/system_info_utils.cc
  244. +7 −0 engine/utils/system_info_utils.h
  245. +19 −0 engine/utils/ulid_generator.h
18 changes: 18 additions & 0 deletions .devcontainer/Dockerfile
Original file line number Diff line number Diff line change
@@ -0,0 +1,18 @@
FROM mcr.microsoft.com/devcontainers/cpp:1-ubuntu-24.04

ARG REINSTALL_CMAKE_VERSION_FROM_SOURCE="none"

# Optionally install the cmake for vcpkg
COPY ./reinstall-cmake.sh /tmp/

RUN if [ "${REINSTALL_CMAKE_VERSION_FROM_SOURCE}" != "none" ]; then \
chmod +x /tmp/reinstall-cmake.sh && /tmp/reinstall-cmake.sh ${REINSTALL_CMAKE_VERSION_FROM_SOURCE}; \
fi \
&& rm -f /tmp/reinstall-cmake.sh

# [Optional] Uncomment this section to install additional vcpkg ports.
# RUN su vscode -c "${VCPKG_ROOT}/vcpkg install <your-port-name-here>"

# [Optional] Uncomment this section to install additional packages.
# RUN apt-get update && export DEBIAN_FRONTEND=noninteractive \
# && apt-get -y install --no-install-recommends <your-package-list-here>
35 changes: 35 additions & 0 deletions .devcontainer/devcontainer.json
Original file line number Diff line number Diff line change
@@ -0,0 +1,35 @@
// For format details, see https://aka.ms/devcontainer.json. For config options, see the
// README at: https://github.com/devcontainers/templates/tree/main/src/cpp
{
"hostRequirements": {
"cpus": 4,
"memory": "8gb",
"storage": "32gb"
},
"name": "C++",
"build": {
"dockerfile": "Dockerfile"
},
"features": {
"ghcr.io/stuartleeks/dev-container-features/shell-history:0": {},
"ghcr.io/sebst/devcontainer-features/pkgx:1": {},
"ghcr.io/devcontainers-extra/features/apt-packages:1": {
"clean_ppas": true,
"preserve_apt_list": true,
"packages": "build-essential linux-libc-dev",
"ppas": "ppa:deadsnakes/ppa"
}
},
// Features to add to the dev container. More info: https://containers.dev/features.
// "features": {},
// Use 'forwardPorts' to make a list of ports inside the container available locally.
// "forwardPorts": [],
// Use 'postCreateCommand' to run commands after the container is created.
"postCreateCommand": "git submodule update --init",
// Use 'postAttachCommand' to run commands after the container is attached.
"postAttachCommand": "pkgx install npx && npx -y runme run --filename README.md -t devcontainer -y"
// Configure tool-specific properties.
// "customizations": {},
// Uncomment to connect as root instead. More info: https://aka.ms/dev-containers-non-root.
// "remoteUser": "root"
}
59 changes: 59 additions & 0 deletions .devcontainer/reinstall-cmake.sh
Original file line number Diff line number Diff line change
@@ -0,0 +1,59 @@
#!/usr/bin/env bash
#-------------------------------------------------------------------------------------------------------------
# Copyright (c) Microsoft Corporation. All rights reserved.
# Licensed under the MIT License. See https://go.microsoft.com/fwlink/?linkid=2090316 for license information.
#-------------------------------------------------------------------------------------------------------------
#
set -e

CMAKE_VERSION=${1:-"none"}

if [ "${CMAKE_VERSION}" = "none" ]; then
echo "No CMake version specified, skipping CMake reinstallation"
exit 0
fi

# Cleanup temporary directory and associated files when exiting the script.
cleanup() {
EXIT_CODE=$?
set +e
if [[ -n "${TMP_DIR}" ]]; then
echo "Executing cleanup of tmp files"
rm -Rf "${TMP_DIR}"
fi
exit $EXIT_CODE
}
trap cleanup EXIT


echo "Installing CMake..."
apt-get -y purge --auto-remove cmake
mkdir -p /opt/cmake

architecture=$(dpkg --print-architecture)
case "${architecture}" in
arm64)
ARCH=aarch64 ;;
amd64)
ARCH=x86_64 ;;
*)
echo "Unsupported architecture ${architecture}."
exit 1
;;
esac

CMAKE_BINARY_NAME="cmake-${CMAKE_VERSION}-linux-${ARCH}.sh"
CMAKE_CHECKSUM_NAME="cmake-${CMAKE_VERSION}-SHA-256.txt"
TMP_DIR=$(mktemp -d -t cmake-XXXXXXXXXX)

echo "${TMP_DIR}"
cd "${TMP_DIR}"

curl -sSL "https://github.com/Kitware/CMake/releases/download/v${CMAKE_VERSION}/${CMAKE_BINARY_NAME}" -O
curl -sSL "https://github.com/Kitware/CMake/releases/download/v${CMAKE_VERSION}/${CMAKE_CHECKSUM_NAME}" -O

sha256sum -c --ignore-missing "${CMAKE_CHECKSUM_NAME}"
sh "${TMP_DIR}/${CMAKE_BINARY_NAME}" --prefix=/opt/cmake --skip-license

ln -s /opt/cmake/bin/cmake /usr/local/bin/cmake
ln -s /opt/cmake/bin/ctest /usr/local/bin/ctest
28 changes: 24 additions & 4 deletions .github/workflows/beta-build.yml
Original file line number Diff line number Diff line change
@@ -67,7 +67,7 @@ jobs:
cortex-llamacpp-version: ${{ needs.get-cortex-llamacpp-latest-version.outputs.cortex_llamacpp_latest_version }}

build-linux-x64:
uses: ./.github/workflows/template-build-linux-x64.yml
uses: ./.github/workflows/template-build-linux.yml
secrets: inherit
needs: [get-update-version, create-draft-release, get-cortex-llamacpp-latest-version]
with:
@@ -79,6 +79,22 @@ jobs:
channel: beta
upload_url: ${{ needs.create-draft-release.outputs.upload_url }}
cortex-llamacpp-version: ${{ needs.get-cortex-llamacpp-latest-version.outputs.cortex_llamacpp_latest_version }}
arch: amd64

build-linux-arm64:
uses: ./.github/workflows/template-build-linux.yml
secrets: inherit
needs: [get-update-version, create-draft-release, get-cortex-llamacpp-latest-version]
with:
ref: ${{ github.ref }}
public_provider: github
new_version: ${{ needs.get-update-version.outputs.new_version }}
runs-on: ubuntu-2004-arm64
cmake-flags: "-DCORTEX_VARIANT=beta -DCORTEX_CPP_VERSION='v${{ needs.get-update-version.outputs.new_version }}' -DCMAKE_TOOLCHAIN_FILE=/home/runner/actions-runner/_work/cortex.cpp/cortex.cpp/engine/vcpkg/scripts/buildsystems/vcpkg.cmake"
channel: beta
upload_url: ${{ needs.create-draft-release.outputs.upload_url }}
cortex-llamacpp-version: ${{ needs.get-cortex-llamacpp-latest-version.outputs.cortex_llamacpp_latest_version }}
arch: arm64

build-docker-x64:
uses: ./.github/workflows/template-build-docker-x64.yml
@@ -111,7 +127,7 @@ jobs:
GITHUB_TOKEN: ${{ secrets.GITHUB_TOKEN }}

noti-discord:
needs: [get-update-version, create-draft-release, build-macos, build-windows-x64, build-linux-x64, update_release]
needs: [get-update-version, create-draft-release, build-macos, build-windows-x64, build-linux-x64, build-linux-arm64, update_release]
runs-on: ubuntu-latest
permissions:
contents: write
@@ -136,9 +152,13 @@ jobs:
- Network Installer: https://github.com/janhq/cortex.cpp/releases/download/v${{ env.VERSION }}/cortex-${{ env.VERSION }}-mac-universal-network-installer.pkg
- Local Installer: https://github.com/janhq/cortex.cpp/releases/download/v${{ env.VERSION }}/cortex-${{ env.VERSION }}-mac-universal-local-installer.pkg
- Binary: https://github.com/janhq/cortex.cpp/releases/download/v${{ env.VERSION }}/cortex-${{ env.VERSION }}-mac-universal.tar.gz
- Linux Deb:
- Linux amd64 Deb:
- Network Installer: https://github.com/janhq/cortex.cpp/releases/download/v${{ env.VERSION }}/cortex-${{ env.VERSION }}-linux-amd64-network-installer.deb
- Local Installer: https://github.com/janhq/cortex.cpp/releases/download/v${{ env.VERSION }}/cortex-${{ env.VERSION }}-linux-amd64-local-installer.deb
- Binary: https://github.com/janhq/cortex.cpp/releases/download/v${{ env.VERSION }}/cortex-${{ env.VERSION }}-linux-amd64.tar.gz
- Linux arm64 Deb:
- Network Installer: https://github.com/janhq/cortex.cpp/releases/download/v${{ env.VERSION }}/cortex-${{ env.VERSION }}-linux-arm64-network-installer.deb
- Local Installer: https://github.com/janhq/cortex.cpp/releases/download/v${{ env.VERSION }}/cortex-${{ env.VERSION }}-linux-arm64-local-installer.deb
- Binary: https://github.com/janhq/cortex.cpp/releases/download/v${{ env.VERSION }}/cortex-${{ env.VERSION }}-linux-arm64.tar.gz
- Docker: menloltd/cortex:beta-${{ env.VERSION }}
- Github Release: https://github.com/janhq/cortex.cpp/releases/tag/v${{ env.VERSION }}
- Github Release: https://github.com/janhq/cortex.cpp/releases/tag/v${{ env.VERSION }}
Loading