Dependabot will resolve any conflicts with this PR as long as you don't alter it yourself. You can also trigger a rebase manually by commenting @dependabot rebase.
Dependabot commands and options
You can trigger Dependabot actions by commenting on this PR:
@dependabot rebase will rebase this PR
@dependabot recreate will recreate this PR, overwriting any edits that have been made to it
@dependabot show <dependency name> ignore conditions will show all of the ignore conditions of the specified dependency
@dependabot ignore this major version will close this PR and stop Dependabot creating any more for this major version (unless you reopen the PR or upgrade to it yourself)
@dependabot ignore this minor version will close this PR and stop Dependabot creating any more for this minor version (unless you reopen the PR or upgrade to it yourself)
@dependabot ignore this dependency will close this PR and stop Dependabot creating any more for this dependency (unless you reopen the PR or upgrade to it yourself)
🔄 This issue represents a GitHub Pull Request. It cannot be merged through Gitea due to API limitations.
## 📋 Pull Request Information
**Original PR:** https://github.com/open-webui/open-webui/pull/22026
**Author:** [@dependabot[bot]](https://github.com/apps/dependabot)
**Created:** 3/1/2026
**Status:** ❌ Closed
**Base:** `dev` ← **Head:** `dependabot/uv/dev/accelerate-1.12.0`
---
### 📝 Commits (1)
- [`5140fa0`](https://github.com/open-webui/open-webui/commit/5140fa04843adcefded95e84facf77980234c50b) chore(deps): bump accelerate from 1.8.1 to 1.12.0
### 📊 Changes
**1 file changed** (+1365 additions, -1010 deletions)
<details>
<summary>View changed files</summary>
📝 `uv.lock` (+1365 -1010)
</details>
### 📄 Description
Bumps [accelerate](https://github.com/huggingface/accelerate) from 1.8.1 to 1.12.0.
<details>
<summary>Release notes</summary>
<p><em>Sourced from <a href="https://github.com/huggingface/accelerate/releases">accelerate's releases</a>.</em></p>
<blockquote>
<h2>v1.12.0: Deepspeed Ulysses/ALST</h2>
<h2>Deepspeed Ulysses/ALST integration</h2>
<p>Deepspeed Ulysses/ALST is an efficient way of training on long sequences by employing sequence parallelism and attention head parallelism. You can learn more about this technology in this paper <a href="https://arxiv.org/abs/2506.13996">https://arxiv.org/abs/2506.13996</a> or this deepspeed tutorial <a href="https://www.deepspeed.ai/tutorials/ulysses-alst-sequence-parallelism/">https://www.deepspeed.ai/tutorials/ulysses-alst-sequence-parallelism/</a>.</p>
<!-- raw HTML omitted -->
<p>To enable Deepspeed Ulysses, you first need to create <code>ParallelismConfig</code> and setting <code>sp</code> related args:</p>
<pre lang="python"><code>parallelism_config = ParallelismConfig(
sp_backend="deepspeed",
sp_size=2,
sp_handler=DeepSpeedSequenceParallelConfig(...),
)
</code></pre>
<p>Then, you need to make sure to compute the correct loss as described on our <a href="https://huggingface.co/docs/accelerate/main/en/concept_guides/sequence_parallelism">docs</a></p>
<pre lang="python"><code> ...
losses_per_rank = torch.distributed.nn.functional.all_gather(loss, group=sp_group)
good_tokens = (shift_labels != -100).view(-1).sum()
good_tokens_per_rank = torch.distributed.nn.functional.all_gather(good_tokens, group=sp_group)
total_loss = sum(
losses_per_rank[rank] * good_tokens_per_rank[rank]
for rank in range(sp_world_size)
if good_tokens_per_rank[rank] > 0
)
total_good_tokens = sum(good_tokens_per_rank)
loss = total_loss / max(total_good_tokens, 1)
</code></pre>
<p>Thanks <a href="https://github.com/S1ro1"><code>@S1ro1</code></a> for starting this work and for <a href="https://github.com/stas00"><code>@stas00</code></a> for finishing this work. Also thanks <a href="https://github.com/kashif"><code>@kashif</code></a> for adding docs and reviewing/testing this PR !</p>
<p>This feature will also be available in HF Trainer thanks for this PR from <a href="https://github.com/stas00"><code>@stas00</code></a>: <a href="https://redirect.github.com/huggingface/transformers/pull/41832">huggingface/transformers#41832</a></p>
<h2>Minor changes</h2>
<ul>
<li>Remove warning for <code>cpu_ram_efficient_loading</code> by <a href="https://github.com/SunMarc"><code>@SunMarc</code></a> in <a href="https://redirect.github.com/huggingface/accelerate/pull/3816">huggingface/accelerate#3816</a></li>
<li>update typo in bnb quantisation 4bit flag docstring by <a href="https://github.com/hbraith"><code>@hbraith</code></a> in <a href="https://redirect.github.com/huggingface/accelerate/pull/3828">huggingface/accelerate#3828</a></li>
<li>ArXiv -> HF Papers by <a href="https://github.com/qgallouedec"><code>@qgallouedec</code></a> in <a href="https://redirect.github.com/huggingface/accelerate/pull/3834">huggingface/accelerate#3834</a></li>
<li>Fix typo in broadcast_object_list docstring by <a href="https://github.com/wsntxxn"><code>@wsntxxn</code></a> in <a href="https://redirect.github.com/huggingface/accelerate/pull/3823">huggingface/accelerate#3823</a></li>
<li>[Bug] Update torch.optim.Optimizer parameter states after tensor parallelism by <a href="https://github.com/naomili0924"><code>@naomili0924</code></a> in <a href="https://redirect.github.com/huggingface/accelerate/pull/3835">huggingface/accelerate#3835</a></li>
<li>use self hosted runner by <a href="https://github.com/SunMarc"><code>@SunMarc</code></a> in <a href="https://redirect.github.com/huggingface/accelerate/pull/3841">huggingface/accelerate#3841</a></li>
<li>device type helper by <a href="https://github.com/kashif"><code>@kashif</code></a> in <a href="https://redirect.github.com/huggingface/accelerate/pull/3843">huggingface/accelerate#3843</a></li>
</ul>
<h2>New Contributors</h2>
<ul>
<li><a href="https://github.com/hbraith"><code>@hbraith</code></a> made their first contribution in <a href="https://redirect.github.com/huggingface/accelerate/pull/3828">huggingface/accelerate#3828</a></li>
</ul>
<!-- raw HTML omitted -->
</blockquote>
<p>... (truncated)</p>
</details>
<details>
<summary>Commits</summary>
<ul>
<li><a href="https://github.com/huggingface/accelerate/commit/61ff83394592db1052be9e64ab46beb21d794d69"><code>61ff833</code></a> Release: v1.12.0</li>
<li><a href="https://github.com/huggingface/accelerate/commit/e3655b932cfb7992d7c453af51e9eda752807c39"><code>e3655b9</code></a> device type helper (<a href="https://redirect.github.com/huggingface/accelerate/issues/3843">#3843</a>)</li>
<li><a href="https://github.com/huggingface/accelerate/commit/c7e59dd7b3ae20c876cf277808620cf52ad716f9"><code>c7e59dd</code></a> Deepspeed Ulysses/ALST integration (<a href="https://redirect.github.com/huggingface/accelerate/issues/3817">#3817</a>)</li>
<li><a href="https://github.com/huggingface/accelerate/commit/e8f241f8784580784b2e88099d6687942879ed43"><code>e8f241f</code></a> use self hosted runner (<a href="https://redirect.github.com/huggingface/accelerate/issues/3841">#3841</a>)</li>
<li><a href="https://github.com/huggingface/accelerate/commit/00b1b1810944a5422330522a46e3044f1e6d1529"><code>00b1b18</code></a> [Bug] Update torch.optim.Optimizer parameter states after tensor parallelism ...</li>
<li><a href="https://github.com/huggingface/accelerate/commit/a73fd3a19652dc61c3a8da6d33032f85f309370c"><code>a73fd3a</code></a> Fix typo in broadcast_object_list docstring (<a href="https://redirect.github.com/huggingface/accelerate/issues/3823">#3823</a>)</li>
<li><a href="https://github.com/huggingface/accelerate/commit/a08fb323904e1c1947258cf75d498b81ff7af801"><code>a08fb32</code></a> Change arxiv to hf papers (<a href="https://redirect.github.com/huggingface/accelerate/issues/3834">#3834</a>)</li>
<li><a href="https://github.com/huggingface/accelerate/commit/61bcdaa45d35a77478decc78ce204b54dc108812"><code>61bcdaa</code></a> update bnb quantisation 4bit flag (<a href="https://redirect.github.com/huggingface/accelerate/issues/3828">#3828</a>)</li>
<li><a href="https://github.com/huggingface/accelerate/commit/a12beee389f6bd37cfae0aba233db03f375f7f80"><code>a12beee</code></a> Remove warning for <code>cpu_ram_efficient_loading</code> (<a href="https://redirect.github.com/huggingface/accelerate/issues/3816">#3816</a>)</li>
<li><a href="https://github.com/huggingface/accelerate/commit/0a0c9895bd71a8df48f59b383e02c926b7409ce6"><code>0a0c989</code></a> v1.12.0dev</li>
<li>Additional commits viewable in <a href="https://github.com/huggingface/accelerate/compare/v1.8.1...v1.12.0">compare view</a></li>
</ul>
</details>
<br />
[](https://docs.github.com/en/github/managing-security-vulnerabilities/about-dependabot-security-updates#about-compatibility-scores)
Dependabot will resolve any conflicts with this PR as long as you don't alter it yourself. You can also trigger a rebase manually by commenting `@dependabot rebase`.
[//]: # (dependabot-automerge-start)
[//]: # (dependabot-automerge-end)
---
<details>
<summary>Dependabot commands and options</summary>
<br />
You can trigger Dependabot actions by commenting on this PR:
- `@dependabot rebase` will rebase this PR
- `@dependabot recreate` will recreate this PR, overwriting any edits that have been made to it
- `@dependabot show <dependency name> ignore conditions` will show all of the ignore conditions of the specified dependency
- `@dependabot ignore this major version` will close this PR and stop Dependabot creating any more for this major version (unless you reopen the PR or upgrade to it yourself)
- `@dependabot ignore this minor version` will close this PR and stop Dependabot creating any more for this minor version (unless you reopen the PR or upgrade to it yourself)
- `@dependabot ignore this dependency` will close this PR and stop Dependabot creating any more for this dependency (unless you reopen the PR or upgrade to it yourself)
</details>
---
<sub>🔄 This issue represents a GitHub Pull Request. It cannot be merged through Gitea due to API limitations.</sub>
Blocking a user prevents them from interacting with repositories, such as opening or commenting on pull requests or issues. Learn more about blocking a user.
📋 Pull Request Information
Original PR: https://github.com/open-webui/open-webui/pull/22026
Author: @dependabot[bot]
Created: 3/1/2026
Status: ❌ Closed
Base:
dev← Head:dependabot/uv/dev/accelerate-1.12.0📝 Commits (1)
5140fa0chore(deps): bump accelerate from 1.8.1 to 1.12.0📊 Changes
1 file changed (+1365 additions, -1010 deletions)
View changed files
📝
uv.lock(+1365 -1010)📄 Description
Bumps accelerate from 1.8.1 to 1.12.0.
Release notes
Sourced from accelerate's releases.
... (truncated)
Commits
61ff833Release: v1.12.0e3655b9device type helper (#3843)c7e59ddDeepspeed Ulysses/ALST integration (#3817)e8f241fuse self hosted runner (#3841)00b1b18[Bug] Update torch.optim.Optimizer parameter states after tensor parallelism ...a73fd3aFix typo in broadcast_object_list docstring (#3823)a08fb32Change arxiv to hf papers (#3834)61bcdaaupdate bnb quantisation 4bit flag (#3828)a12beeeRemove warning forcpu_ram_efficient_loading(#3816)0a0c989v1.12.0devDependabot will resolve any conflicts with this PR as long as you don't alter it yourself. You can also trigger a rebase manually by commenting
@dependabot rebase.Dependabot commands and options
You can trigger Dependabot actions by commenting on this PR:
@dependabot rebasewill rebase this PR@dependabot recreatewill recreate this PR, overwriting any edits that have been made to it@dependabot show <dependency name> ignore conditionswill show all of the ignore conditions of the specified dependency@dependabot ignore this major versionwill close this PR and stop Dependabot creating any more for this major version (unless you reopen the PR or upgrade to it yourself)@dependabot ignore this minor versionwill close this PR and stop Dependabot creating any more for this minor version (unless you reopen the PR or upgrade to it yourself)@dependabot ignore this dependencywill close this PR and stop Dependabot creating any more for this dependency (unless you reopen the PR or upgrade to it yourself)🔄 This issue represents a GitHub Pull Request. It cannot be merged through Gitea due to API limitations.