feat: Support Rotating API Keys #4414

New Issue

2025-11-11T15:53:36-06:00

GiteaMirror commented

2025-11-11 15:53:36 -06:00

Originally created by @squinn1 on GitHub (Mar 13, 2025).

Check Existing Issues

I have searched the existing issues and discussions.

Problem Description

Hi,
I am having an issue where my calls to LLM live behind a proxy which you must supply an access token retrieved from an identity provider in order to authenticate to the proxy (and therefore make calls to LLM's).

These access tokens expire after 24 hours which means I only get a days use before having to generate a new one.

Desired Solution you'd like

I believe the most general solution for this would be as follows:

add an env var OPENAI_API_KEY_FILE
the env var would point to a file (e.g. /foo/token.txt) which contains the token
the app would then poll the file, and update the api key if it has changed

on my side I can then configure a sidecar with a shared volume which can write out access tokens to the required file.

Alternatives Considered

No response

Additional Context

No response

Originally created by @squinn1 on GitHub (Mar 13, 2025). ### Check Existing Issues - [x] I have searched the existing issues and discussions. ### Problem Description Hi, I am having an issue where my calls to LLM live behind a proxy which you must supply an access token retrieved from an identity provider in order to authenticate to the proxy (and therefore make calls to LLM's). These access tokens expire after 24 hours which means I only get a days use before having to generate a new one. ### Desired Solution you'd like I believe the most general solution for this would be as follows: - add an env var OPENAI_API_KEY_FILE - the env var would point to a file (e.g. /foo/token.txt) which contains the token - the app would then poll the file, and update the api key if it has changed on my side I can then configure a sidecar with a shared volume which can write out access tokens to the required file. ### Alternatives Considered _No response_ ### Additional Context _No response_

GiteaMirror closed this issue

2025-11-11 15:53:36 -06:00

GiteaMirror referenced this issue

2026-04-19 20:17:02 -05:00

[GH-ISSUE #4414] Title auto-generation does not respect keep_alive setting #13600

GiteaMirror referenced this issue

2026-04-25 03:34:56 -05:00

[GH-ISSUE #4414] Title auto-generation does not respect keep_alive setting #29128

GiteaMirror referenced this issue

2026-05-05 13:25:01 -05:00

[GH-ISSUE #4414] Title auto-generation does not respect keep_alive setting #52266

GiteaMirror referenced this issue