mirror of
https://github.com/Shubhamsaboo/awesome-llm-apps.git
synced 2026-03-19 05:22:12 -05:00
base_url #1
Reference in New Issue
Block a user
Delete Branch "%!s()"
Deleting a branch is permanent. Although the deleted branch may continue to exist for a short time before it actually gets removed, it CANNOT be undone in most cases. Continue?
Originally created by @comeback01 on GitHub (May 1, 2024).
Originally assigned to: @Shubhamsaboo on GitHub.
Hello,
I would like to know how to change the base URL. The idea is to be able to use OpenRouter, which is compatible with OpenAI, and they offer free models.
Thank you very much!
@Shubhamsaboo commented on GitHub (May 4, 2024):
Can you please elaborate on this?
Which example exactly you are referring to?
@comeback01 commented on GitHub (May 4, 2024):
There are suppliers that offer APIs that are 100% compatible with OpenAI, such as:
I particularly like https://openrouter.ai because it provides models like Claude 4, GPT-4, Meta: Llama 3 70B Instruct, etc.
This provider also offers completely free models, such as Mistral 7B Instruct.
To use these models, there is no need to modify the code. However, you need to specify:
As in your program, you must also provide a base URL (baseURL), which could be:
I hope this makes things clearer.
Thank you for your help.
@Shubhamsaboo commented on GitHub (May 5, 2024):
Gotcha.
Embedchain supports the use of following LLM and support the providers listed here: https://docs.embedchain.ai/components/llms
All you need to do is to change the config of your embedchain app. You can find the instructions on how to use them on the above link.
I hope this solves your problem.
@Shubhamsaboo commented on GitHub (May 17, 2024):
Closing this as there is no response for a while.