Skip to content

Conversation

richiejp
Copy link
Collaborator

@richiejp richiejp commented Jun 27, 2025

  • fix(README): Add device flags for Intel/XPU
  • fix(diffusers/xpu): Set device to XPU and ignore CUDA request when on Intel

Description

Diffusers appears to just run on CPU when using Intel devices. This sets the XPU env var the same as the transformers backend and ignors the model if it requests CUDA.

Notes for Reviewers

Signed commits

  • Yes, I signed my commits.

Copy link

netlify bot commented Jun 27, 2025

Deploy Preview for localai ready!

Name Link
🔨 Latest commit d1a7a6a
🔍 Latest deploy log https://app.netlify.com/projects/localai/deploys/68618cc49bfede0008fdda75
😎 Deploy Preview https://deploy-preview-5737--localai.netlify.app
📱 Preview on mobile
Toggle QR Code...

QR Code

Use your smartphone camera to open QR code link.

To edit notification comments on pull requests, go to your Netlify project configuration.

@github-actions github-actions bot added the kind/documentation Improvements or additions to documentation label Jun 27, 2025
@richiejp richiejp marked this pull request as ready for review June 27, 2025 15:48
richiejp added 2 commits June 29, 2025 19:57
Signed-off-by: Richard Palethorpe <io@richiejp.com>
… Intel

Signed-off-by: Richard Palethorpe <io@richiejp.com>
@richiejp richiejp force-pushed the fix/xpu-diffusers branch from 2ace663 to d1a7a6a Compare June 29, 2025 18:58
@richiejp richiejp enabled auto-merge (rebase) June 29, 2025 18:58
@richiejp richiejp changed the title Diffusers and XPU fixes fix: Diffusers and XPU fixes Jul 1, 2025
@mudler mudler disabled auto-merge July 1, 2025 10:36
@mudler mudler merged commit b37cef3 into mudler:master Jul 1, 2025
26 of 28 checks passed
gmaOCR pushed a commit to gmaOCR/LocalAI that referenced this pull request Jul 2, 2025
* fix(README): Add device flags for Intel/XPU

Signed-off-by: Richard Palethorpe <io@richiejp.com>

* fix(diffusers/xpu): Set device to XPU and ignore CUDA request when on Intel

Signed-off-by: Richard Palethorpe <io@richiejp.com>

---------

Signed-off-by: Richard Palethorpe <io@richiejp.com>
@mudler mudler added bug Something isn't working and removed kind/documentation Improvements or additions to documentation labels Jul 24, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Something isn't working
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants