github-starred/ollama
2
0
Fork 0
mirror of https://github.com/ollama/ollama.git synced 2026-05-07 00:22:43 -05:00
Code Issues 14.5k Packages Projects Releases 120 Wiki Activity

[GH-ISSUE #3071] Unable to get ollama serve working #48401

New Issue
Closed
opened 2026-04-28 08:05:08 -05:00 by GiteaMirror · 1 comment
GiteaMirror commented 2026-04-28 08:05:08 -05:00
Owner
Copy Link

Originally created by @harsham05 on GitHub (Mar 12, 2024).
Original GitHub issue: https://github.com/ollama/ollama/issues/3071

I have installed Ollama and the Ollama python client on Ubuntu. I am unable to interact with it using the Ollama Python client.

$ ollama list
NAME            ID              SIZE    MODIFIED
llama2:70b      e7f6c06ffef4    38 GB   2 hours ago
llama2:latest   78e26419b446    3.8 GB  4 days ago

$ OLLAMA_HOST=127.0.0.1:7656 ollama serve

When I try to interact with ollama in Python, I get a ResponseError. Thank you in advance.

import ollama
response = ollama.chat(model='llama2', messages=[
  {
    'role': 'user',
    'content': 'Why is the sky blue?',
  },
])
print(response['message']['content'])
image
Originally created by @harsham05 on GitHub (Mar 12, 2024). Original GitHub issue: https://github.com/ollama/ollama/issues/3071 I have installed Ollama and the Ollama python client on Ubuntu. I am unable to interact with it using the Ollama Python client. ``` $ ollama list NAME ID SIZE MODIFIED llama2:70b e7f6c06ffef4 38 GB 2 hours ago llama2:latest 78e26419b446 3.8 GB 4 days ago ``` ``` $ OLLAMA_HOST=127.0.0.1:7656 ollama serve ``` When I try to interact with ollama in Python, I get a ResponseError. Thank you in advance. ``` import ollama response = ollama.chat(model='llama2', messages=[ { 'role': 'user', 'content': 'Why is the sky blue?', }, ]) print(response['message']['content']) ``` <img width="1214" alt="image" src="https://github.com/ollama/ollama/assets/8755540/b5bbdcc9-845f-477d-9b3d-22f56d977be1">
GiteaMirror commented 2026-04-28 08:05:10 -05:00
Author
Owner
Copy Link

@pdevine commented on GitHub (Mar 12, 2024):

@harsham05 if you want to connect to ollama on a custom port, you'll have to create a custom client to do this (this is in the ollama-python readme ).

An example:

from ollama import Client
client = Client(host='http://127.0.0.1:7656')
response = client.chat(model='llama2', messages=[
  {
    'role': 'user',
    'content': 'Why is the sky blue?',
  },
])

I'm going to go ahead and close the issue, but feel free to keep commenting.

<!-- gh-comment-id:1989709300 --> @pdevine commented on GitHub (Mar 12, 2024): @harsham05 if you want to connect to ollama on a custom port, you'll have to create a custom client to do this (this is in the [ollama-python readme](https://github.com/ollama/ollama-python) ). An example: ``` from ollama import Client client = Client(host='http://127.0.0.1:7656') response = client.chat(model='llama2', messages=[ { 'role': 'user', 'content': 'Why is the sky blue?', }, ]) ``` I'm going to go ahead and close the issue, but feel free to keep commenting.
Sign in to join this conversation.
No Branch/Tag Specified
Branches Tags
Labels
Clear labels
amd
api
app
bug
build
cli
cloud
compatibility
context-length
create
docker
documentation
embeddings
feature request
feedback wanted
good first issue
gpt-oss
gpu
harmony
help wanted
image
install
intel
js
launch
linux
macos
memory
mlx
model
needs more info
networking
nvidia
ollama.com
performance
pull-request
Mirrored from GitHub Pull Request
 python
question
registry
rendering
thinking
tools
top
vulkan
windows
wsl
No Label
Milestone
No items
No Milestone
Projects
Clear projects
No project
Assignees
Clear assignees
GiteaMirror ninjasurge
No Assignees
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: github-starred/ollama#48401
Delete Branch "%!s()"

Deleting a branch is permanent. Although the deleted branch may continue to exist for a short time before it actually gets removed, it CANNOT be undone in most cases. Continue?