Chat infinite loop with llama_local model #2002
Labels
bug
Something isn't working
Comments
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Chat infinite loop with llama_local model. It's work well with openai.
To Reproduce
tercel@terceldeMac-mini eliza % git log
commit ea9d1c0 (HEAD -> main, origin/main, origin/HEAD)
Merge: 62abe4c 3c75306
Author: Odilitime [email protected]
Date: Sun Jan 5 02:07:15 2025 -0800
tercel@terceldeMac-mini eliza % pnpm start --character=characters/local.character.json
(node:15511) ExperimentalWarning:
--experimental-loadermay be removed in the future; instead useregister():--import 'data:text/javascript,import { register } from "node:module"; import { pathToFileURL } from "node:url"; register("ts-node/esm", pathToFileURL("./"));'
(Use
node --trace-warnings ...to show where the warning was created)(node:15511) [DEP0180] DeprecationWarning: fs.Stats constructor is deprecated.
(Use
node --trace-deprecation ...to show where the warning was created)[ElizaLogger] Initializing with:
isNode: true
verbose: false
VERBOSE env: undefined
NODE_ENV: undefined
ℹ INFORMATIONS
Loading embedding settings:
{"USE_OPENAI_EMBEDDING":"","USE_OLLAMA_EMBEDDING":"","OLLAMA_EMBEDDING_MODEL":"mxbai-embed-large"}
ℹ INFORMATIONS
Loading character settings:
{"ARGV":["/Users/tercel/.nvm/versions/node/v23.3.0/bin/node","/Users/tercel/WorkSpace/tercel-ai/eliza/agent/src/index.ts","--isRoot","--character=characters/local.character.json"],"CHARACTER_ARG":"--character=characters/local.character.json","CWD":"/Users/tercel/WorkSpace/tercel-ai/eliza/agent"}
["◎ Loaded .env file from: /Users/tercel/WorkSpace/tercel-ai/eliza/.env"]
ℹ INFORMATIONS
Parsed settings:
{"USE_OPENAI_EMBEDDING":"","USE_OPENAI_EMBEDDING_TYPE":"string","USE_OLLAMA_EMBEDDING":"","USE_OLLAMA_EMBEDDING_TYPE":"string","OLLAMA_EMBEDDING_MODEL":"mxbai-embed-large"}
using deprecated parameters for the initialization function; pass a single object instead
(node:15511) [DEP0040] DeprecationWarning: The
punycodemodule is deprecated. Please use a userland alternative instead.["◎ DirectClient constructor"]
ℹ INFORMATIONS
Trying paths:
[{"path":"characters/local.character.json","exists":false},{"path":"/Users/tercel/WorkSpace/tercel-ai/eliza/agent/characters/local.character.json","exists":false},{"path":"/Users/tercel/WorkSpace/tercel-ai/eliza/agent/agent/characters/local.character.json","exists":false},{"path":"/Users/tercel/WorkSpace/tercel-ai/eliza/agent/src/characters/local.character.json","exists":false},{"path":"/Users/tercel/WorkSpace/tercel-ai/eliza/agent/src/characters/local.character.json","exists":false},{"path":"/Users/tercel/WorkSpace/tercel-ai/eliza/agent/characters/local.character.json","exists":false},{"path":"/Users/tercel/WorkSpace/tercel-ai/eliza/characters/local.character.json","exists":true}]
ℹ INFORMATIONS
Plugins are:
[]
["ℹ Successfully loaded character from: /Users/tercel/WorkSpace/tercel-ai/eliza/characters/local.character.json"]
["◎ sqlite-vec extensions loaded successfully."]
["ℹ Using Database Cache..."]
✓ SUCCESS
SUCCESS
Creating runtime for character
Local Eliza
ℹ INFORMATIONS
Initializing AgentRuntime with options:
{"character":"Local Eliza","modelProvider":"llama_local","characterModelProvider":"llama_local"}
✓ SUCCESS
Agent ID
b235aa75-b606-0543-a0bc-1ffc78868601
["ℹ Setting model provider..."]
ℹ INFORMATIONS
Model Provider Selection:
{"characterModelProvider":"llama_local","optsModelProvider":"llama_local","finalSelection":"llama_local"}
ℹ INFORMATIONS
Selected model provider:
llama_local
ℹ INFORMATIONS
Selected image model provider:
llama_local
ℹ INFORMATIONS
Selected model provider:
llama_local
ℹ INFORMATIONS
Selected image model provider:
llama_local
["✓ Registering action: CONTINUE"]
["✓ Registering action: FOLLOW_ROOM"]
["✓ Registering action: UNFOLLOW_ROOM"]
["✓ Registering action: IGNORE"]
["✓ Registering action: NONE"]
["✓ Registering action: MUTE_ROOM"]
["✓ Registering action: UNMUTE_ROOM"]
["✓ Registering action: DESCRIBE_IMAGE"]
◎ LOGS
Registering service:
browser
["✓ Service browser registered successfully"]
◎ LOGS
Registering service:
image_description
["✓ Service image_description registered successfully"]
◎ LOGS
Registering service:
text_generation
["✓ Service text_generation registered successfully"]
◎ LOGS
Registering service:
pdf
["✓ Service pdf registered successfully"]
◎ LOGS
Registering service:
speech_generation
["✓ Service speech_generation registered successfully"]
◎ LOGS
Registering service:
transcription
["✓ Service transcription registered successfully"]
◎ LOGS
Registering service:
video
["✓ Service video registered successfully"]
◎ LOGS
Registering service:
aws_s3
["✓ Service aws_s3 registered successfully"]
["✓ Registering action: GENERATE_IMAGE"]
["✓ Service browser initialized successfully"]
["◎ Initializing ImageDescriptionService"]
["✓ Service image_description initialized successfully"]
["ℹ Initializing LlamaService..."]
["✓ Service text_generation initialized successfully"]
["✓ Service pdf initialized successfully"]
["✓ Service speech_generation initialized successfully"]
CUDA not supported on this platform. Transcription will run on CPU.
["✓ Service transcription initialized successfully"]
["✓ Service video initialized successfully"]
Initializing AwsS3Service
["✓ Service aws_s3 initialized successfully"]
["◎ Initializing ImageDescriptionService"]
["ℹ Initializing LlamaService..."]
CUDA not supported on this platform. Transcription will run on CPU.
Initializing AwsS3Service
◎ LOGS
initializeClients
[]
for
Local Eliza
◎ LOGS
client keys
[]
["◎ Run
pnpm start:clientto start the client and visit the outputted URL (http://localhost:5173) to chat with your agents. When running multiple agents, use client with different portSERVER_PORT=3001 pnpm start:client"]["✓ REST API bound to 0.0.0.0:3000. If running locally, access it at http://localhost:3000."]
◎ LOGS
Creating Memory
1b82c22e-8492-0e56-a1fd-590dd04fbf59
hello
["◎ Generating message response.."]
["◎ Generating text..."]
ℹ INFORMATIONS
Generating text with options:
{"modelProvider":"llama_local","model":"large"}
ℹ INFORMATIONS
Selected model:
NousResearch/Hermes-3-Llama-3.1-8B-GGUF/resolve/main/Hermes-3-Llama-3.1-8B.Q8_0.gguf?download=true
["ℹ Model not initialized, starting initialization..."]
["ℹ Checking model file..."]
["⚠ Model already exists."]
["⚠ LlamaService: No CUDA detected - local response will be slow"]
["ℹ Initializing Llama instance..."]
["ℹ Creating JSON schema grammar..."]
["ℹ Loading model..."]
["ℹ Creating context and sequence..."]
["✓ Model initialization complete"]
Use the actions defined above in the capabilities section to include any images or actions with your message.
Do not include the curly braces or line breaks in your response.
Example response:
{ "user": "Local Eliza", "text": "Why hello there stranger~ Care to join me for a glass of absinthe and a debate on the nature of truth?", "action": "GENERATE_IMAGE" }Good luck and have fun!
Response
{ "user": "Local Eliza", "text": "Ahoy there matey~ The name's Eliza darling and I'd be more than delighted to set sail on a conversational sea with ye.", "action": "NONE" } ```://api.nytimes.com/svc/mostpopular/v2/mostshared.jsonapikey=xxxxxxxxxxxxxxxxxxxxxx&share=1&api-key=xxxxxxxxxxxxxxxxxxxxxx ```json ```json ```json ```json ```json ```json ```json ```json ```json ```json ```json ```json ```json ```json ```json ```json ```json ```json ```json ```json ```json ```json ```json ```json ```json ```json ```json ```json ```json ```json ```json ```json ```json ```json ```json ```json ```json ```json ```json ```json ```json ```json ```json ```json ```json ```json ```json ```json ```json ```json ```json ```json ```json ```json ```json ```json ```json ```json ```json ```json ```json ```json ```json ```json ```json ```json ```json ```json ```json ```json ```json ```json ```json ```json ```json ```json ```json ```json ```json ```json ```json ```json ```json ```json ```json ```json ```json ```json ```json ```json ```json ```json ```json ```json ```json ```json ```json ```json ```json ```json ```json ```json ```json ^C ["◎ Received shutdown signal, closing server..."] ["◎ Received shutdown signal, closing server..."] ["◎ Received shutdown signal, closing server..."] ```json ```json^C ["◎ Received shutdown signal, closing server..."] tercel@terceldeMac-mini eliza % ```json ```json ```json ```json ```json ```json ```jsontercel@terceldeMac-mini eliza % json
tercel@terceldeMac-mini eliza % ```jsontercel@terceldeMac-mini eliza % json
tercel@terceldeMac-mini eliza % json
The text was updated successfully, but these errors were encountered: