[GH-ISSUE #13606] IQuest-Coder (40B / 40B-Loop) Support #34716

Open
opened 2026-04-22 18:29:23 -05:00 by GiteaMirror · 6 comments
Owner

Originally created by @muhammad-fiaz on GitHub (Jan 2, 2026).
Original GitHub issue: https://github.com/ollama/ollama/issues/13606

Support for new IQuest-Coder models ( 40B / 40B-Loop), including quantized weight variants (2B / 7B / 13B), if applicable.

Model website: https://iquestlab.github.io/
Hugging Face collection: https://huggingface.co/collections/IQuestLab/iquest-coder
GitHub repository: https://github.com/IQuestLab/IQuest-Coder-V1

Originally created by @muhammad-fiaz on GitHub (Jan 2, 2026). Original GitHub issue: https://github.com/ollama/ollama/issues/13606 **Support for new IQuest-Coder models ( 40B / 40B-Loop), including quantized weight variants (2B / 7B / 13B), if applicable.** Model website: [https://iquestlab.github.io/](https://iquestlab.github.io/) Hugging Face collection: [https://huggingface.co/collections/IQuestLab/iquest-coder](https://huggingface.co/collections/IQuestLab/iquest-coder) GitHub repository: [https://github.com/IQuestLab/IQuest-Coder-V1](https://github.com/IQuestLab/IQuest-Coder-V1)
GiteaMirror added the model label 2026-04-22 18:29:23 -05:00
Author
Owner

@rick-github commented on GitHub (Jan 2, 2026):

The non-Loop model appears to be a llama variant so should be importable. The Loop model has new architecture features.

<!-- gh-comment-id:3705358007 --> @rick-github commented on GitHub (Jan 2, 2026): The non-Loop model appears to be a llama variant so should be importable. The Loop model has new [architecture features]( https://github.com/ggml-org/llama.cpp/pull/18524).
Author
Owner

@muhammad-fiaz commented on GitHub (Jan 2, 2026):

@rick-github does it supported in current ollama release v0.13.5??

also it seems looped variant is still in work in progress

<!-- gh-comment-id:3705370599 --> @muhammad-fiaz commented on GitHub (Jan 2, 2026): @rick-github does it supported in current ollama release v0.13.5?? also it seems looped variant is still in work in progress
Author
Owner

@rick-github commented on GitHub (Jan 2, 2026):

Llama variants have been supported since v0.0.1.

<!-- gh-comment-id:3705380189 --> @rick-github commented on GitHub (Jan 2, 2026): Llama variants have been supported since v0.0.1.
Author
Owner

@rick-github commented on GitHub (Jan 2, 2026):

The template needs updating for thinking support but it otherwise seems to work.

$ ollama run hf.co/mradermacher/IQuest-Coder-V1-40B-Instruct-GGUF:Q4_K_M write a golang function that prints hello world
pulling manifest 
pulling 305353aa6b3b: 100% ▕██████████▏  24 GB                         
pulling 2d54db2b9bb2: 100% ▕██████████▏ 1.5 KB                         
pulling 4a6ce91d86a8: 100% ▕██████████▏   99 B                         
pulling 86c982698a1f: 100% ▕██████████▏  550 B                         
verifying sha256 digest 
writing manifest 
success 
Thinking...
```go
package main

import "fmt"

func main() {
    fmt.Println("Hello World")
}
```

This Go program prints "Hello World" to the console. When executed, it will display:

```
Hello World
```

<!-- gh-comment-id:3705449070 --> @rick-github commented on GitHub (Jan 2, 2026): The template needs updating for thinking support but it otherwise seems to work. ````console $ ollama run hf.co/mradermacher/IQuest-Coder-V1-40B-Instruct-GGUF:Q4_K_M write a golang function that prints hello world pulling manifest pulling 305353aa6b3b: 100% ▕██████████▏ 24 GB pulling 2d54db2b9bb2: 100% ▕██████████▏ 1.5 KB pulling 4a6ce91d86a8: 100% ▕██████████▏ 99 B pulling 86c982698a1f: 100% ▕██████████▏ 550 B verifying sha256 digest writing manifest success Thinking... ```go package main import "fmt" func main() { fmt.Println("Hello World") } ``` This Go program prints "Hello World" to the console. When executed, it will display: ``` Hello World ``` ````
Author
Owner

@rick-github commented on GitHub (Jan 3, 2026):

echo FROM hf.co/mradermacher/IQuest-Coder-V1-40B-Instruct-GGUF:Q4_K_M > Modelfile
ollama show --modelfile hf.co/mradermacher/IQuest-Coder-V1-40B-Instruct-GGUF:Q4_K_M | egrep -v "^(FROM |<think>$)" >> Modelfile
ollama create iquest-coder:40b-instruct-q4_K_M
$ ollama run iquest-coder:40b-instruct-q4_K_M write a golang function that prints hello world
Here's a simple Go function that prints "Hello, World!":

```go
package main

import "fmt"

func printHelloWorld() {
    fmt.Println("Hello, World!")
}

func main() {
    printHelloWorld()
}
```

This code includes:
- A `printHelloWorld()` function that prints the message using `fmt.Println()`
- A `main()` function that calls it (required for Go programs)

To run this:
1. Save it to a file (e.g., `hello.go`)
2. Run `go run hello.go`

Or if you just want the function without the main wrapper:

```go
func printHelloWorld() {
    fmt.Println("Hello, World!")
}
```
<!-- gh-comment-id:3706581306 --> @rick-github commented on GitHub (Jan 3, 2026): ``` echo FROM hf.co/mradermacher/IQuest-Coder-V1-40B-Instruct-GGUF:Q4_K_M > Modelfile ollama show --modelfile hf.co/mradermacher/IQuest-Coder-V1-40B-Instruct-GGUF:Q4_K_M | egrep -v "^(FROM |<think>$)" >> Modelfile ollama create iquest-coder:40b-instruct-q4_K_M ``` ````console $ ollama run iquest-coder:40b-instruct-q4_K_M write a golang function that prints hello world Here's a simple Go function that prints "Hello, World!": ```go package main import "fmt" func printHelloWorld() { fmt.Println("Hello, World!") } func main() { printHelloWorld() } ``` This code includes: - A `printHelloWorld()` function that prints the message using `fmt.Println()` - A `main()` function that calls it (required for Go programs) To run this: 1. Save it to a file (e.g., `hello.go`) 2. Run `go run hello.go` Or if you just want the function without the main wrapper: ```go func printHelloWorld() { fmt.Println("Hello, World!") } ``` ````
Author
Owner

@rick-github commented on GitHub (Jan 15, 2026):

https://github.com/ggml-org/llama.cpp/issues/18525 for work on the Loop variant.

<!-- gh-comment-id:3753786025 --> @rick-github commented on GitHub (Jan 15, 2026): https://github.com/ggml-org/llama.cpp/issues/18525 for work on the Loop variant.
Sign in to join this conversation.
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: github-starred/ollama#34716