You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Hi,
I tried to load model using bitsandbytesconfig, but am getting this error
.venv\Lib\site-packages\transformers\integrations\bitsandbytes.py:499, in _validate_bnb_multi_backend_availability(raise_exception)
494 if find_spec("intel_extension_for_pytorch"):
495 logger.warning(
496 "You have Intel IPEX installed but if you're intending to use it for CPU, it might not have the right version. Be sure to double check that your PyTorch and IPEX installs are compatible."
497 )
--> 499 available_devices.discard("cpu") # Only Intel CPU is supported by BNB at the moment
501 if not available_devices.intersection(bnb_supported_devices):
502 if raise_exception:
AttributeError: 'frozenset' object has no attribute 'discard'
### Who can help?
_No response_
### Information
- [ ] The official example scripts
- [ ] My own modified scripts
### Tasks
- [ ] An officially supported task in the `examples` folder (such as GLUE/SQuAD, ...)
- [ ] My own task or dataset (give details below)
### Reproduction
transformers
Version: 4.49.0
bitsandbytes
Version: 0.44.1.dev0+9315692
### Expected behavior
Loading model with bitsandbytes config without any error
The text was updated successfully, but these errors were encountered:
System Info
Hi,
I tried to load model using bitsandbytesconfig, but am getting this error
The text was updated successfully, but these errors were encountered: