[GH-ISSUE #4908] integration with microsoft/aici for deterministic prompt outputs #28861

Open
opened 2026-04-22 07:24:59 -05:00 by GiteaMirror · 0 comments
Owner

Originally created by @bvelker on GitHub (Jun 7, 2024).
Original GitHub issue: https://github.com/ollama/ollama/issues/4908

Is there a roadmap for combining with microsoft's open source AI Control Interface(AICI) project? AICI affords arbitrary deterministic prompt outputs constrained by a regex expression(and/or other techniques). When developers are deciding between proprietary and open source llm solutions, prompt control seems like it's one of the foremost issues(this is why people choose the "smarter" llms). The advantages to the AICI approach to prompting seems like it's ideas will make AICI(or something else like it) a clear long term winning move for the open source space, affording greater output control and enabling very focused problem solving.

https://github.com/microsoft/aici

As an aside, I think the Agents are currently an overhyped workflow. Even current sota llms can't be consistently trusted to generally solve problems recursively. Given this glaring issue, we need to craft workflows that can reliably squeeze every bit of problem solving out of these models. The AICI approach seems to REALLY help with the reliability. It's like function calling, but even more flexible. Just some thoughts...

Originally created by @bvelker on GitHub (Jun 7, 2024). Original GitHub issue: https://github.com/ollama/ollama/issues/4908 Is there a roadmap for combining with microsoft's open source AI Control Interface(AICI) project? AICI affords arbitrary deterministic prompt outputs constrained by a regex expression(and/or other techniques). When developers are deciding between proprietary and open source llm solutions, prompt control seems like it's one of the foremost issues(this is why people choose the "smarter" llms). The advantages to the AICI approach to prompting seems like it's ideas will make AICI(or something else like it) a clear long term winning move for the open source space, affording greater output control and enabling very focused problem solving. https://github.com/microsoft/aici As an aside, I think the Agents are currently an overhyped workflow. Even current sota llms can't be consistently trusted to generally solve problems recursively. Given this glaring issue, we need to craft workflows that can reliably squeeze every bit of problem solving out of these models. The AICI approach seems to REALLY help with the reliability. It's like function calling, but even more flexible. Just some thoughts...
GiteaMirror added the feature request label 2026-04-22 07:24:59 -05:00
Sign in to join this conversation.
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: github-starred/ollama#28861