feature(inference): Upgrade the default vision model to the new gpt-4…

…o-2024-05-13 which is faster and 2x cheaper
hoarder-app · May 16, 2024 · 168aed0 · 168aed0
1 parent c0aa6d5
commit 168aed0
Show file tree

Hide file tree

Showing 2 changed files with 2 additions and 2 deletions.
diff --git a/docs/docs/03-configuration.md b/docs/docs/03-configuration.md
@@ -33,7 +33,7 @@ Either `OPENAI_API_KEY` or `OLLAMA_BASE_URL` need to be set for automatic taggin
 | OPENAI_BASE_URL       | No       | Not set            | If you just want to use OpenAI you don't need to pass this variable. If, however, you want to use some other openai compatible API (e.g. azure openai service), set this to the url of the API. |
 | OLLAMA_BASE_URL       | No       | Not set            | If you want to use ollama for local inference, set the address of ollama API here.                                                                                                              |
 | INFERENCE_TEXT_MODEL  | No       | gpt-3.5-turbo-0125 | The model to use for text inference. You'll need to change this to some other model if you're using ollama.                                                                                     |
-| INFERENCE_IMAGE_MODEL | No       | gpt-4-turbo        | The model to use for image inference. You'll need to change this to some other model if you're using ollama and that model needs to support vision APIs (e.g. llava).                           |
+| INFERENCE_IMAGE_MODEL | No       | gpt-4o-2024-05-13  | The model to use for image inference. You'll need to change this to some other model if you're using ollama and that model needs to support vision APIs (e.g. llava).                           |
 | INFERENCE_LANG        | No       | english            | The language in which the tags will be generated.                                                                                                                                               |
 
 ## Crawler Configs

diff --git a/packages/shared/config.ts b/packages/shared/config.ts
@@ -14,7 +14,7 @@ const allEnv = z.object({
   OPENAI_BASE_URL: z.string().url().optional(),
   OLLAMA_BASE_URL: z.string().url().optional(),
   INFERENCE_TEXT_MODEL: z.string().default("gpt-3.5-turbo-0125"),
-  INFERENCE_IMAGE_MODEL: z.string().default("gpt-4-turbo"),
+  INFERENCE_IMAGE_MODEL: z.string().default("gpt-4o-2024-05-13"),
   REDIS_HOST: z.string().default("localhost"),
   REDIS_PORT: z.coerce.number().default(6379),
   REDIS_DB_IDX: z.coerce.number().optional(),