github-starred/ollama
2
0
Fork 0
mirror of https://github.com/ollama/ollama.git synced 2026-07-17 13:47:08 -05:00
Code Issues 16.9k Packages Projects Releases 122 Wiki Activity

[GH-ISSUE #4662] Can Ollama be ran with Nemo Guardrails #2930

New Issue
Closed
opened 2026-04-12 13:18:07 -05:00 by GiteaMirror · 3 comments
GiteaMirror commented 2026-04-12 13:18:07 -05:00
Owner
Copy Link

Originally created by @ShreyasChhetri on GitHub (May 27, 2024).
Original GitHub issue: https://github.com/ollama/ollama/issues/4662

What is the issue?

I want to run ollama Mistral 7B model with Nemo Guardrails but when I'm using it in my config file models:

  • type: main
    engine: ollama
    model: mistral
    parameters:
    base_url: http://127.0.0.1:11434
    like this I'm not able to access it
    Error while execution self_check_input: Ollama call failed with status code 404.
    I'm sorry, an internal error has occurred.
    this error is giving can anyone help me with it ??

OS

Windows

GPU

No response

CPU

Intel

Ollama version

latest

Originally created by @ShreyasChhetri on GitHub (May 27, 2024). Original GitHub issue: https://github.com/ollama/ollama/issues/4662 ### What is the issue? I want to run ollama Mistral 7B model with Nemo Guardrails but when I'm using it in my config file models: - type: main engine: ollama model: mistral parameters: base_url: http://127.0.0.1:11434 like this I'm not able to access it Error while execution self_check_input: Ollama call failed with status code 404. I'm sorry, an internal error has occurred. this error is giving can anyone help me with it ?? ### OS Windows ### GPU _No response_ ### CPU Intel ### Ollama version latest
GiteaMirror added the bugneeds more info labels 2026-04-12 13:18:07 -05:00
GiteaMirror commented 2026-04-12 13:18:09 -05:00
Author
Owner
Copy Link

@faisnain commented on GitHub (May 27, 2024):

I guess this error is from Ollama side not from the guardrails side. make sure if the endpoints are accessible and are able to handle multiple requests as Nemoguardrails hits LLM with 3-4 calls for intents and response calculation.

<!-- gh-comment-id:2133796805 --> @faisnain commented on GitHub (May 27, 2024): I guess this error is from Ollama side not from the guardrails side. make sure if the endpoints are accessible and are able to handle multiple requests as Nemoguardrails hits LLM with 3-4 calls for intents and response calculation.
GiteaMirror commented 2026-04-12 13:18:09 -05:00
Author
Owner
Copy Link

@pdevine commented on GitHub (Sep 14, 2024):

Sorry for the slow response. Is this something you're still trying to do? Were you able to get it to work?

<!-- gh-comment-id:2351068306 --> @pdevine commented on GitHub (Sep 14, 2024): Sorry for the slow response. Is this something you're still trying to do? Were you able to get it to work?
GiteaMirror commented 2026-04-12 13:18:09 -05:00
Author
Owner
Copy Link

@pdevine commented on GitHub (Oct 23, 2024):

I'm going to go ahead and close this, but we can reopen it if this is something you're still trying to do.

<!-- gh-comment-id:2430749931 --> @pdevine commented on GitHub (Oct 23, 2024): I'm going to go ahead and close this, but we can reopen it if this is something you're still trying to do.
Sign in to join this conversation.
No Branch/Tag Specified
Branches Tags
Labels
Clear labels
amd
api
app
bug
build
cli
cloud
compatibility
context-length
create
docker
documentation
embeddings
feature request
feedback wanted
good first issue
gpt-oss
gpu
harmony
help wanted
image
install
intel
js
launch
linux
macos
memory
mlx
model
needs more info
networking
nvidia
ollama.com
performance
pull-request
Mirrored from GitHub Pull Request
 python
question
registry
rendering
thinking
tools
top
vulkan
windows
wsl
No Label bug needs more info
Milestone
No items
No Milestone
Projects
Clear projects
No project
Assignees
Clear assignees
GiteaMirror ninjasurge
No Assignees
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: github-starred/ollama#2930
Delete Branch "%!s()"

Deleting a branch is permanent. Although the deleted branch may continue to exist for a short time before it actually gets removed, it CANNOT be undone in most cases. Continue?