bitsandbytes/libbitsandbytes_cpu.so: undefined symbol: cget_col_row_stats

[XixuHu]

Hi, I came across this problem when I try to use bitsandbytes to load a big model from huggingface, and I cannot fix it. My CUDA version is 12.0 and my torch version is 1.13.1+cu116. I would like to know if there is any way to solve this problem? Thanks!

[chris-aeviator]

facing the same issue when trying to resolve #134 with a downgrade to 0.35

[JanKalo]

Any news about this issue?

[Jacobsolawetz]

Hit it as well

(env) ubuntu@ip-172-31-7-128:~/uss-vision-deploy-demo$ pip list
Package                  Version    
------------------------ -----------
accelerate               0.16.0     
aiohttp                  3.8.4      
aiosignal                1.3.1      
async-timeout            4.0.2      
attrs                    22.2.0     
bitsandbytes             0.37.0     
boto3                    1.26.83    
botocore                 1.29.83    
certifi                  2022.12.7  
charset-normalizer       3.0.1      
click                    8.1.3      
datasets                 2.10.1     
deeplake                 3.2.12     
dill                     0.3.6      
entrypoints              0.4        
filelock                 3.9.0      
frozenlist               1.3.3      
fsspec                   2023.3.0   
hub                      3.0.1      
huggingface-hub          0.12.1     
humbug                   0.2.8      
idna                     3.4        
jmespath                 1.0.1      
loralib                  0.1.1      
multidict                6.0.4      
multiprocess             0.70.14    
numcodecs                0.11.0     
numpy                    1.24.2     
nvidia-cublas-cu11       11.10.3.66 
nvidia-cuda-nvrtc-cu11   11.7.99    
nvidia-cuda-runtime-cu11 11.7.99    
nvidia-cudnn-cu11        8.5.0.96   
packaging                23.0       
pandas                   1.5.3      
pathos                   0.3.0      
peft                     0.2.0.dev0 
Pillow                   9.4.0      
pip                      20.0.2     
pkg-resources            0.0.0      
pox                      0.3.2      
ppft                     1.7.6.6    
psutil                   5.9.4      
pyarrow                  11.0.0     
PyJWT                    2.6.0      
python-dateutil          2.8.2      
pytz                     2022.7.1   
PyYAML                   6.0        
regex                    2022.10.31 
requests                 2.28.2     
responses                0.18.0     
s3transfer               0.6.0      
setuptools               44.0.0     
six                      1.16.0     
tokenizers               0.13.2     
torch                    1.13.1     
tqdm                     4.64.1     
transformers             4.27.0.dev0
typing-extensions        4.5.0      
urllib3                  1.26.14    
wheel                    0.38.4     
xxhash                   3.2.0      
yarl                     1.8.2      

[silvacarl2]

I have the same problem, any ideas?

[zhangxianwei2015]

same issue

[jcharlet]

• I followed solution offered on Warning: "The installed version of bitsandbytes was compiled without GPU support." #112,
  replace lib/python3.9/site-packages/bitsandbytes/lib/bitsandbytes_cpu.so with lib/python3.9/site-packages/bitsandbytes/lib/bitsandbytes_cuda114.so (with my version of cuda)
• to solve following error 'CUDA SETUP: Problem: The main issue seems to be that the main CUDA runtime library was not detected', I followed that suggestion of installing conda toolkit in new env
  conda install cudatoolkit

[silvacarl2]

pip install -i https://test.pypi.org/simple/ bitsandbytes

that worked for me.

[leezjs]

• replace lib/python3.9/site-packages/bitsandbytes/lib/bitsandbytes_cpu.so with lib/python3.9/site-packages/bitsandbytes/lib/bitsandbytes_cuda114.so (with my version of cuda)

This works for me, thanks : )

[boersmamarcel]

Manual copy of the .so file worked. I have version cuda version 11.7 so the following command in the conda environment directory ensured that it worked correctly again.

cp libbitsandbytes_cuda117.so libbitsandbytes_cpu.so

[moorehousew]

Manual copy of the .so file worked. I have version cuda version 11.7 so the following command in the conda environment directory ensured that it worked correctly again.

cp libbitsandbytes_cuda117.so libbitsandbytes_cpu.so

This works without a conda env as well, fwiw.

[XuJianzhi]

• bitsandbytes_cpu.so

not work

[XuJianzhi]

thanks, it works !!

[lywinged]

Manual copy of the .so file worked. I have version cuda version 11.7 so the following command in the conda environment directory ensured that it worked correctly again.

cp libbitsandbytes_cuda117.so libbitsandbytes_cpu.so

It works!!! 😄

[sfxworks]

Yikes this also appears official anaconda image
edit: ..and the pytorch image
oh man

Adding that cp as a final run command solves this though yay

[sooftware]

• bitsandbytes_cpu.so

It works Thank you!