[GH-ISSUE #6677] VG #4203

Closed
opened 2026-04-12 15:08:07 -05:00 by GiteaMirror · 2 comments
Owner

Originally created by @vioricavg on GitHub (Sep 6, 2024).
Original GitHub issue: https://github.com/ollama/ollama/issues/6677

Use a pipeline as a high-level helper

from transformers import pipeline

messages = [
{"role": "user", "content": "Who are you?"},
]
pipe = pipeline("text-generation", model="LGAI-EXAONE/EXAONE-3.0-7.8B-Instruct", trust_remote_code=True)
pipe(messages)

Originally created by @vioricavg on GitHub (Sep 6, 2024). Original GitHub issue: https://github.com/ollama/ollama/issues/6677 # Use a pipeline as a high-level helper from transformers import pipeline messages = [ {"role": "user", "content": "Who are you?"}, ] pipe = pipeline("text-generation", model="LGAI-EXAONE/EXAONE-3.0-7.8B-Instruct", trust_remote_code=True) pipe(messages)
Author
Owner

@jmorganca commented on GitHub (Sep 6, 2024):

Hi @vioricavg! Thanks for the issue. I'm not quite sure this is for Ollama – but let me know if you need any help

<!-- gh-comment-id:2334822063 --> @jmorganca commented on GitHub (Sep 6, 2024): Hi @vioricavg! Thanks for the issue. I'm not quite sure this is for Ollama – but let me know if you need any help
Author
Owner

@vioricavg commented on GitHub (Sep 9, 2024):

Use a pipeline as a high-level helper

from transformers import pipeline

messages = [
{"role": "user", "content": "Who are you?"},
]
pipe = pipeline("text-generation", model="LGAI-EXAONE/EXAONE-3.0-7.8B-Instruct", trust_remote_code=True)
pipe(messages)

<!-- gh-comment-id:2338826305 --> @vioricavg commented on GitHub (Sep 9, 2024): > # Use a pipeline as a high-level helper > from transformers import pipeline > > messages = [ > {"role": "user", "content": "Who are you?"}, > ] > pipe = pipeline("text-generation", model="LGAI-EXAONE/EXAONE-3.0-7.8B-Instruct", trust_remote_code=True) > pipe(messages)
Sign in to join this conversation.
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: github-starred/ollama#4203