You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
I am using CPU for execution. I am able to run python ingest.py --device_type cpu, but when I am using python run_localGPT.py --device_type cpu for executing chat bot in command prompt, I am getting ->
===================================BUG REPORT===================================
Welcome to bitsandbytes. For bug reports, please submit your error trace to: https://github.com/TimDettmers/bitsandbytes/issues
================================================================================
binary_path: C:\ProgramData\anaconda3\envs\local3\lib\site-packages\bitsandbytes\cuda_setup\libbitsandbytes_cuda116.dll
CUDA SETUP: Loading binary C:\ProgramData\anaconda3\envs\local3\lib\site-packages\bitsandbytes\cuda_setup\libbitsandbytes_cuda116.dll...
Could not find module 'C:\ProgramData\anaconda3\envs\local3\lib\site-packages\bitsandbytes\cuda_setup\libbitsandbytes_cuda116.dll' (or one of its dependencies). Try using the full path with constructor syntax.
CUDA SETUP: Loading binary C:\ProgramData\anaconda3\envs\local3\lib\site-packages\bitsandbytes\cuda_setup\libbitsandbytes_cuda116.dll...
Could not find module 'C:\ProgramData\anaconda3\envs\local3\lib\site-packages\bitsandbytes\cuda_setup\libbitsandbytes_cuda116.dll' (or one of its dependencies). Try using the full path with constructor syntax.
C:\ProgramData\anaconda3\envs\local3\lib\site-packages\bitsandbytes\cextension.py:31: UserWarning: The installed version of bitsandbytes was compiled without GPU support. 8-bit optimizers and GPU quantization are unavailable.
warn("The installed version of bitsandbytes was compiled without GPU support. "
CUDA extension not installed.
CUDA extension not installed.
2024-05-08 09:00:48,755 - INFO - run_localGPT.py:244 - Running on: cpu
2024-05-08 09:00:48,755 - INFO - run_localGPT.py:245 - Display Source Documents set to: False
2024-05-08 09:00:48,755 - INFO - run_localGPT.py:246 - Use history set to: False
2024-05-08 09:00:49,271 - INFO - SentenceTransformer.py:66 - Load pretrained SentenceTransformer: hkunlp/instructor-large
load INSTRUCTOR_Transformer
Anyone please can help me out with this issue?
The text was updated successfully, but these errors were encountered:
I am using CPU for execution. I am able to run
python ingest.py --device_type cpu
, but when I am usingpython run_localGPT.py --device_type cpu
for executing chat bot in command prompt, I am getting ->Anyone please can help me out with this issue?
The text was updated successfully, but these errors were encountered: