Tyring to setup Bitnet gets out of memory

[davidgfolch]

Hi,

I was trying to install and run Bitnet but terminal just disappears executing the setup, my machine is going outOfMemory (see picture):

huggingface-cli download HF1BitLLM/Llama3-8B-1.58-100B-tokens --local-dir models/Llama3-8B-1.58-100B-tokens
python setup_env.py -md models/Llama3-8B-1.58-100B-tokens -q i2_s

System & hardware:

• Ubuntu 22.04.5 64-bit
• 32GB memory
• Intel® Core™ i7-6700HQ CPU @ 2.60GHz × 8

Is there any trick to work-arround that problem?