Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Error From BitsandBytes #36371

Open
nikithakriz opened this issue Feb 24, 2025 · 0 comments
Open

Error From BitsandBytes #36371

nikithakriz opened this issue Feb 24, 2025 · 0 comments
Labels

Comments

@nikithakriz
Copy link

System Info

Hi,
I tried to load model using bitsandbytesconfig, but am getting this error

.venv\Lib\site-packages\transformers\integrations\bitsandbytes.py:499, in _validate_bnb_multi_backend_availability(raise_exception)
    494     if find_spec("intel_extension_for_pytorch"):
    495         logger.warning(
    496             "You have Intel IPEX installed but if you're intending to use it for CPU, it might not have the right version. Be sure to double check that your PyTorch and IPEX installs are compatible."
    497         )
--> 499     available_devices.discard("cpu")  # Only Intel CPU is supported by BNB at the moment
    501 if not available_devices.intersection(bnb_supported_devices):
    502     if raise_exception:

AttributeError: 'frozenset' object has no attribute 'discard'




### Who can help?

_No response_

### Information

- [ ] The official example scripts
- [ ] My own modified scripts

### Tasks

- [ ] An officially supported task in the `examples` folder (such as GLUE/SQuAD, ...)
- [ ] My own task or dataset (give details below)

### Reproduction

transformers
Version: 4.49.0
bitsandbytes
Version: 0.44.1.dev0+9315692

### Expected behavior

Loading model with bitsandbytes config without any error
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Projects
None yet
Development

No branches or pull requests

1 participant