Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

model type issue #439

Open
HaarishIrfan2171 opened this issue Apr 24, 2024 · 0 comments
Open

model type issue #439

HaarishIrfan2171 opened this issue Apr 24, 2024 · 0 comments

Comments

@HaarishIrfan2171
Copy link

I use the Qwen1.5-0.5B-Chat-AWQ model and i declare the model path as /home/administrator/KoboldAI-Client/models/qwen/Qwen1.5-0.5B-Chat-AWQ in linux server.

throw the Error like

Traceback (most recent call last):
File "aiserver.py", line 10290, in
load_model(initial_load=True)
File "aiserver.py", line 2251, in load_model
model_config = AutoConfig.from_pretrained(vars.custmodpth, revision=args.revision, cache_dir="cache")
File "/home/administrator/KoboldAI-Client/runtime/envs/koboldai/lib/python3.8/site-packages/transformers/models/auto/configuration_auto.py", line 796, in from_pretrained
config_class = CONFIG_MAPPING[config_dict["model_type"]]
File "/home/administrator/KoboldAI-Client/runtime/envs/koboldai/lib/python3.8/site-packages/transformers/models/auto/configuration_auto.py", line 503, in getitem
raise KeyError(key)
KeyError: 'qwen2'

how to resolve it

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant