Skip to content

[ICS] Feature request to support multiple GPUs with OpenVINO Backend for llama.cpp. #255

Description

@haarika-madaka

Customer's Question:

I have a dual Intel Arc Pro B70 setup. When using OpenVINO docker image, it works with either one of the GPUs exposed into the container, but not both. SYCL docker works with both.

Intel Support Reply:

_Multi GPUs with OpenVINO backend is not supported.

If the system has multiple GPUs, use GPU.0 or GPU.1 to explicitly target a specific GPU._

@ravi9 Customer has requested to explore this as a feature request to enable multi GPU environment.

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Projects

    Status
    Backlog

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions