github-starred/ollama-ollama
2
0
Fork 0
mirror of https://github.com/ollama/ollama.git synced 2025-12-05 18:46:22 -06:00
Code Issues 2.2k Packages Projects Releases 100 Wiki Activity

[PR #7318] [CLOSED] Add tensors for bitnet/triLMs, Q4_0_x_x #11119

New Issue
Closed
opened 2025-11-12 16:06:45 -06:00 by GiteaMirror · 0 comments
GiteaMirror commented 2025-11-12 16:06:45 -06:00
Owner
Copy Link

📋 Pull Request Information

Original PR: https://github.com/ollama/ollama/pull/7318
Author: @rick-github
Created: 10/22/2024
Status: ❌ Closed

Base: main ← Head: magic

📝 Commits (2)

  • ad03422 Add tensors for bitnet/triLMs, Q4_x_x
  • c24c79c Fix whitespace.

📊 Changes

2 files changed (+36 additions, -1 deletions)

View changed files

📝 llm/filetype.go (+25 -0)
📝 llm/ggml.go (+11 -1)

📄 Description

Fixes: https://github.com/ollama/ollama/issues/2821
Fixes: https://github.com/ollama/ollama/issues/6125

$ huggingface-cli download --local-dir . 1bitLLM/bitnet_b1_58-large
$ docker run --rm -it -v .:/app/models ghcr.io/ggerganov/llama.cpp:full -c --outtype tq1_0 /app/models
$ docker run --rm -it -v .:/app/models --entrypoint ./llama-quantize ghcr.io/ggerganov/llama.cpp:full /app/models/bitnet_b1_58-large-TQ1_0.gguf /app/models/bitnet_b1_58-large-TQ1_0-requant.gguf tq1_0
$ echo FROM bitnet_b1_58-large-TQ1_0-requant.gguf > Modelfile
$ ollama create bitnet_b1_58:large-TQ1_0
$ ollama run bitnet_b1_58:large-TQ1_0 the sky is blue due to
  the earth’s atmosphere, and so our sunlight will get reflected in the atmosphere and reach the earth and burn it.
The Earth’s atmosphere is made of two main elements: nitrogen and oxygen. Nitrogen atoms have a positive charge and an electron (the positively charged nucleus), while oxygen atoms have a negative charge and a electron (the negatively charged 
nucleus). When the two are in equilibrium, we experience a light that is mostly blue to violet and has a slight flicker when exposed to ultraviolet radiation.
We’ll be doing a lot of astronomy over here at our house over the next few weeks. As always, feel free to contact us if you have any questions or comments.

$ huggingface-cli download --local-dir . pipilok/Llama-3.2-3B-Instruct-Q4_0_4_8-GGUF
$ echo FROM Llama-3.2-3B-Instruct-q4_0_4_8.gguf > Modelfile
$ ollama create llama-3.2:3b-instruct-q4_0_4_8
$ ollama run llama-3.2:3b-instruct-q4_0_4_8 the sky is blue due to
 a phenomenon called Rayleigh scattering, which favors shorter wavelengths. This scattering effect causes the red light from sunlight to scatter in all directions, while blue and violet light are scattered more intensely, giving them a more 
dispersed appearance.
In addition, the atmosphere contains aerosols like dust, water droplets, and pollutants, which can also interact with light and contribute to its scattering. These interactions can enhance or modify the Rayleigh scattering effect, but they do not 
fundamentally change the underlying physics.

So, why does our sky appear blue? It's because of a combination of two main factors:

1.  **Rayleigh scattering**: The shorter wavelengths of light (like blue and violet) are scattered more intensely than longer wavelengths (like red), which is why we see a predominantly blue color in the sky.
2.  **Aerosols in the atmosphere**: Dust, water droplets, and pollutants can scatter light, contributing to its dispersion and affecting the apparent color of the sky.

Now that you know the science behind the blue sky, appreciate it even more on your next clear day out!

🔄 This issue represents a GitHub Pull Request. It cannot be merged through Gitea due to API limitations.

## 📋 Pull Request Information **Original PR:** https://github.com/ollama/ollama/pull/7318 **Author:** [@rick-github](https://github.com/rick-github) **Created:** 10/22/2024 **Status:** ❌ Closed **Base:** `main` ← **Head:** `magic` --- ### 📝 Commits (2) - [`ad03422`](https://github.com/ollama/ollama/commit/ad0342257170fd6d63998ca524dd6ebcba445f8c) Add tensors for bitnet/triLMs, Q4_x_x - [`c24c79c`](https://github.com/ollama/ollama/commit/c24c79c7d08ff0ec29608c1baaf2769772f1c7e2) Fix whitespace. ### 📊 Changes **2 files changed** (+36 additions, -1 deletions) <details> <summary>View changed files</summary> 📝 `llm/filetype.go` (+25 -0) 📝 `llm/ggml.go` (+11 -1) </details> ### 📄 Description Fixes: https://github.com/ollama/ollama/issues/2821 Fixes: https://github.com/ollama/ollama/issues/6125 ```console $ huggingface-cli download --local-dir . 1bitLLM/bitnet_b1_58-large $ docker run --rm -it -v .:/app/models ghcr.io/ggerganov/llama.cpp:full -c --outtype tq1_0 /app/models $ docker run --rm -it -v .:/app/models --entrypoint ./llama-quantize ghcr.io/ggerganov/llama.cpp:full /app/models/bitnet_b1_58-large-TQ1_0.gguf /app/models/bitnet_b1_58-large-TQ1_0-requant.gguf tq1_0 $ echo FROM bitnet_b1_58-large-TQ1_0-requant.gguf > Modelfile $ ollama create bitnet_b1_58:large-TQ1_0 $ ollama run bitnet_b1_58:large-TQ1_0 the sky is blue due to the earth’s atmosphere, and so our sunlight will get reflected in the atmosphere and reach the earth and burn it. The Earth’s atmosphere is made of two main elements: nitrogen and oxygen. Nitrogen atoms have a positive charge and an electron (the positively charged nucleus), while oxygen atoms have a negative charge and a electron (the negatively charged nucleus). When the two are in equilibrium, we experience a light that is mostly blue to violet and has a slight flicker when exposed to ultraviolet radiation. We’ll be doing a lot of astronomy over here at our house over the next few weeks. As always, feel free to contact us if you have any questions or comments. ``` ```console $ huggingface-cli download --local-dir . pipilok/Llama-3.2-3B-Instruct-Q4_0_4_8-GGUF $ echo FROM Llama-3.2-3B-Instruct-q4_0_4_8.gguf > Modelfile $ ollama create llama-3.2:3b-instruct-q4_0_4_8 $ ollama run llama-3.2:3b-instruct-q4_0_4_8 the sky is blue due to a phenomenon called Rayleigh scattering, which favors shorter wavelengths. This scattering effect causes the red light from sunlight to scatter in all directions, while blue and violet light are scattered more intensely, giving them a more dispersed appearance. In addition, the atmosphere contains aerosols like dust, water droplets, and pollutants, which can also interact with light and contribute to its scattering. These interactions can enhance or modify the Rayleigh scattering effect, but they do not fundamentally change the underlying physics. So, why does our sky appear blue? It's because of a combination of two main factors: 1. **Rayleigh scattering**: The shorter wavelengths of light (like blue and violet) are scattered more intensely than longer wavelengths (like red), which is why we see a predominantly blue color in the sky. 2. **Aerosols in the atmosphere**: Dust, water droplets, and pollutants can scatter light, contributing to its dispersion and affecting the apparent color of the sky. Now that you know the science behind the blue sky, appreciate it even more on your next clear day out! ``` --- <sub>🔄 This issue represents a GitHub Pull Request. It cannot be merged through Gitea due to API limitations.</sub>
GiteaMirror added the
pull-request
 label 2025-11-12 16:06:45 -06:00
Sign in to join this conversation.
No Branch/Tag Specified
Branches Tags
Labels
Clear labels
amd
api
app
bug
build
cli
client2
cloud
compatibility
context-length
create
docker
documentation
embeddings
engine
feature request
feedback wanted
good first issue
gpt-oss
gpu
harmony
help wanted
install
integration
intel
js
linux
macos
memory
model
needs more info
networking
nvidia
ollama.com
performance
pull-request
Mirrored from GitHub Pull Request
python
question
registry
rendering
thinking
tools
top
windows
wsl
No Label
pull-request
Milestone
No items
No Milestone
Projects
Clear projects
No project
Assignees
Clear assignees
GiteaMirror ninjasurge
No Assignees
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: github-starred/ollama-ollama#11119
No description provided.
Delete Branch "%!s()"

Deleting a branch is permanent. Although the deleted branch may continue to exist for a short time before it actually gets removed, it CANNOT be undone in most cases. Continue?