feat: set default model for image description #4687

New Issue

2025-11-11T16:00:40-06:00

GiteaMirror commented

2025-11-11 16:00:40 -06:00

Originally created by @space192 on GitHub (Apr 3, 2025).

Check Existing Issues

I have searched the existing issues and discussions.

Problem Description

when chatting with a LLM with no vision capabilities, switching to a vision LLM to describe the image can create issue due to the previous context, could be nice to auto switch to just describe the image

Desired Solution you'd like

The idea would be that the user / admin can set a default model for image understanding such that when chatting with a LLM with no vision capabilities, if an image is submitted by the user it automatically described by the choosed vision LLM and then the original LLM continues with it's work

Alternatives Considered

create a tool where the image is sent to the other LLM

Additional Context

No response

Originally created by @space192 on GitHub (Apr 3, 2025). ### Check Existing Issues - [x] I have searched the existing issues and discussions. ### Problem Description when chatting with a LLM with no vision capabilities, switching to a vision LLM to describe the image can create issue due to the previous context, could be nice to auto switch to just describe the image ### Desired Solution you'd like The idea would be that the user / admin can set a default model for image understanding such that when chatting with a LLM with no vision capabilities, if an image is submitted by the user it automatically described by the choosed vision LLM and then the original LLM continues with it's work ### Alternatives Considered create a tool where the image is sent to the other LLM ### Additional Context _No response_

GiteaMirror closed this issue

2025-11-11 16:00:40 -06:00

GiteaMirror commented

2025-11-11 16:00:41 -06:00

@spammenotinoz commented on GitHub (Apr 3, 2025):

Another option is not to send to the LLM at all.
This might be a feature to hold-off and see where she lands. LLM models now are starting to generate and modify their own images. So perhaps a separate image model \ function no longer makes as much sense as it did previously.

@spammenotinoz commented on GitHub (Apr 3, 2025): Another option is not to send to the LLM at all. This might be a feature to hold-off and see where she lands. LLM models now are starting to generate and modify their own images. So perhaps a separate image model \ function no longer makes as much sense as it did previously.

GiteaMirror commented

2025-11-11 16:00:41 -06:00