feat: add a new docker image tag cuda-cu126 #5419

New Issue

GiteaMirror · 2025-11-11T16:20:31-06:00

GiteaMirror commented

2025-11-11 16:20:31 -06:00

Originally created by @ER-EPR on GitHub (Jun 2, 2025).

Check Existing Issues

I have searched the existing issues and discussions.
related to https://github.com/open-webui/open-webui/discussions/13654#discussion-8291452

Problem Description

Since PyTorch drop support for cuda capability 7.0 and below in their 2.7-cu128 release, in https://github.com/pytorch/pytorch/blob/v2.7.0/.ci/manywheel/build_cuda.sh

TORCH_CUDA_ARCH_LIST="5.0;6.0;7.0;7.5;8.0;8.6"
case ${CUDA_VERSION} in
    12.8)
        TORCH_CUDA_ARCH_LIST="7.5;8.0;8.6;9.0;10.0;12.0+PTX" #removing sm_50-sm_70 as these architectures are deprecated in CUDA 12.8 and will be removed in future releases
        EXTRA_CAFFE2_CMAKE_FLAGS+=("-DATEN_NO_TEST=ON")
        ;;
    12.6)
        TORCH_CUDA_ARCH_LIST="${TORCH_CUDA_ARCH_LIST};9.0"
        EXTRA_CAFFE2_CMAKE_FLAGS+=("-DATEN_NO_TEST=ON")
        ;;

and open webui change the PyTorch version accordingly. I think for many people still using 'old' cards (only 8 years for V100 with cuda capability 7.0) a separate docker tag will be convenient.

Desired Solution you'd like

the only thing needs to change is the github action, just copy the current cuda tag workflow, and add a build arg: --build-arg="USE_CUDA_VER=cu126" and name it with a new tag e.g. cuda-cu126

Alternatives Considered

none

Additional Context

No response

Originally created by @ER-EPR on GitHub (Jun 2, 2025). ### Check Existing Issues - [x] I have searched the existing issues and discussions. related to https://github.com/open-webui/open-webui/discussions/13654#discussion-8291452 ### Problem Description Since PyTorch drop support for cuda capability 7.0 and below in their 2.7-cu128 release, in https://github.com/pytorch/pytorch/blob/v2.7.0/.ci/manywheel/build_cuda.sh ``` TORCH_CUDA_ARCH_LIST="5.0;6.0;7.0;7.5;8.0;8.6" case ${CUDA_VERSION} in 12.8) TORCH_CUDA_ARCH_LIST="7.5;8.0;8.6;9.0;10.0;12.0+PTX" #removing sm_50-sm_70 as these architectures are deprecated in CUDA 12.8 and will be removed in future releases EXTRA_CAFFE2_CMAKE_FLAGS+=("-DATEN_NO_TEST=ON") ;; 12.6) TORCH_CUDA_ARCH_LIST="${TORCH_CUDA_ARCH_LIST};9.0" EXTRA_CAFFE2_CMAKE_FLAGS+=("-DATEN_NO_TEST=ON") ;; ``` and open webui change the PyTorch version accordingly. I think for many people still using 'old' cards (only 8 years for V100 with cuda capability 7.0) a separate docker tag will be convenient. ### Desired Solution you'd like the only thing needs to change is the github action, just copy the current cuda tag workflow, and add a build arg: ` --build-arg="USE_CUDA_VER=cu126" ` and name it with a new tag e.g. cuda-cu126 ### Alternatives Considered none ### Additional Context _No response_

GiteaMirror closed this issue

2025-11-11 16:20:31 -06:00

GiteaMirror commented

2025-11-11 16:20:32 -06:00

@tjbck commented on GitHub (Jun 2, 2025):

PR welcome.

@tjbck commented on GitHub (Jun 2, 2025): PR welcome.

GiteaMirror referenced this issue

2025-11-11 17:57:43 -06:00

[PR #5419] [MERGED] fix: remove unsupported .doc file ingest #8481

Sign in to join this conversation.