New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Support for Intel integrated Arc GPUs #498

Open

hanthor opened this issue Jan 24, 2025 · 0 comments

Labels

hanthor commented Jan 24, 2025 •

edited

Loading

Is your feature request related to a problem? Please describe.
I have a Meteor Lake Core Ultra processor (Core Ultra 5 125H)
utilizing the Arc integrated GPUs with Ollama is possible via docker with https://github.com/intel/ipex-llm/blob/main/docs/mddocs/Quickstart/ollama_quickstart.md

Describe the solution you'd like
It would be awesome to have Alpaca be able to use the NPU directly

Describe alternatives you've considered
I had a script to start the docker on boot and use it as a remote Ollama server in Alpaca

Additional context
Add any other context or screenshots about the feature request here.

I addition to this I'd like to narrow down the Copilot key binding so that Alpaca can be bound to it

hanthor added the enhancement label

hanthor changed the title ~~Support for Intel NPU~~ Support for Intel GPUs

hanthor changed the title ~~Support for Intel GPUs~~ Support for Intel integrated Arc GPUs

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment