[GH-ISSUE #10434] Ollama 0.6.6 memory leak #84544

New Issue

Closed

opened 2026-05-09 21:02:21 -05:00 by GiteaMirror · 12 comments

GiteaMirror commented 2026-05-09 21:02:21 -05:00

Owner

Copy Link

Originally created by @moonflash on GitHub (Apr 28, 2025).
Original GitHub issue: https://github.com/ollama/ollama/issues/10434

Originally assigned to: @jessegross on GitHub.

What is the issue?

Runnning:

• ollama inside Docker
• Linux host
• one dedicated RTX-3090 per instance
• using gemma3:27b-it-qat model that fits on a single RTX3090 (21G/24G)

at the beginning I have 21G of VRAM and less than 1G of RAM usage after an hour i have the same on VRAM but all RAM (30G) used up to 40G of used swap memory.

docker-compose:

ollama-1:
    image: ollama/ollama:0.6.6
    container_name: ollama-inference1
    restart: unless-stopped
    runtime: nvidia
    volumes:
      - /usr/share/ollama/.ollama/models:/root/.ollama/models
    ports:
      - "11435:11434"
    environment:
      - OLLAMA_PORT=11434
      - OLLAMA_TIMEOUT=120
      - OLLAMA_LOAD_TIMEOUT=30m
      - CUDA_VISIBLE_DEVICES=0
      - NVIDIA_DRIVER_CAPABILITIES=compute,utility,graphics
      - OLLAMA_DEBUG=true  
   

Was using ollama 0.5.* prior to switching to 0.6.6 (other models though) and never experienced anything similar.
NOTE:
I'm using large num_ctx=24000 (was using it with and 0.5.* never had any memory leaks)
One big difference is that previously I was not inferencing multimodal models (it was either phi4:14b-q8_0 or llama...)

Linux ollama-1 5.10.0-28-amd64 #1 SMP Debian 5.10.209-2 (2024-01-31) x86_64 GNU/Linux

free -h
               total        used        free      shared  buff/cache   available
Mem:            31Gi        30Gi       560Mi        41Mi       421Mi       500Mi
Swap:           79Gi        51Gi        28Gi

+-----------------------------------------------------------------------------------------+
| NVIDIA-SMI 560.35.03              Driver Version: 560.35.03      CUDA Version: 12.6     |
|-----------------------------------------+------------------------+----------------------+
| GPU  Name                 Persistence-M | Bus-Id          Disp.A | Volatile Uncorr. ECC |
| Fan  Temp   Perf          Pwr:Usage/Cap |           Memory-Usage | GPU-Util  Compute M. |
|                                         |                        |               MIG M. |
|=========================================+========================+======================|
|   0  NVIDIA GeForce RTX 3090        On  |   00000000:02:00.0 Off |                  N/A |
|  0%   49C    P8             27W /  370W |   21754MiB /  24576MiB |      0%      Default |
|                                         |                        |                  N/A |

ollama ps
NAME                 ID              SIZE     PROCESSOR    UNTIL
gemma3:27b-it-qat    29eb0b9aeda3    24 GB    100% GPU     Forever

Relevant log output

[GIN] 2025/04/28 - 15:44:23 | 200 |  3.897563719s |      172.19.0.3 | POST     "/api/generate"
time=2025-04-28T15:44:23.300Z level=DEBUG source=sched.go:409 msg="context for request finished"
time=2025-04-28T15:44:23.301Z level=DEBUG source=sched.go:341 msg="runner with non-zero duration has gone idle, adding timer" modelPath=/root/.ollama/models/blobs/sha256-ccc0cddac56136ef0969cf2e3e9ac051124c937be42503b47ec570dead85ff87 duration=2562047h47m16.854775807s
time=2025-04-28T15:44:23.301Z level=DEBUG source=sched.go:359 msg="after processing request finished event" modelPath=/root/.ollama/models/blobs/sha256-ccc0cddac56136ef0969cf2e3e9ac051124c937be42503b47ec570dead85ff87 refCount=0
time=2025-04-28T15:44:24.512Z level=WARN source=ggml.go:152 msg="key not found" key=general.alignment default=32
time=2025-04-28T15:44:24.516Z level=DEBUG source=sched.go:577 msg="evaluating already loaded" model=/root/.ollama/models/blobs/sha256-ccc0cddac56136ef0969cf2e3e9ac051124c937be42503b47ec570dead85ff87
time=2025-04-28T15:44:24.516Z level=DEBUG source=routes.go:297 msg="generate request" images=1 prompt="<start_of_turn>user\nYou act as a web-shop expert reaponsible to properly classify any given product. You carefully examine image of the product (if provided), product-data and categories-data. Then decide if it fits into any given category and if it does, which category is the best fit for the product. You also provide a short explanation of your choice.\nPlease return response in following JSON format:<end_of_turn>\n<start_of_turn>user\n[img-0]\n\n[text beginning] Read about the product from:[product-data start] [\\\"Product_name: Sharkoon tg5 pro rgb full glass atx case.\\\", \\\"Description: Gaming case with addressable rgb lighting and full glass side panel..\\\", \\\"Brand is SHARKOON.\\\", \\\"Fan_size is 120mm.\\\", \\\"Case_type is ATX Full Tower.\\\", \\\"Fan_quantity is 4.\\\", \\\"Intended_use is Gaming.\\\", \\\"Rgb_lighting is Addressable RGB.\\\", \\\"Side_panel_material is Tempered Glass.\\\", \\\"Suggested_category is PC Cases.\\\"] [product-data end] and decide which category product fits the best:[categories-data start][{\\\"category_name\\\":\\\"Computer Cases\\\",\\\"description\\\":\\\"Computer cases provide housing and support for internal components, impacting cooling, aesthetics, and overall system functionality.\\\",\\\"id\\\":9366},{\\\"category_name\\\":\\\"Gaming PC Cases\\\",\\\"description\\\":\\\"Cases specifically designed for gaming PCs, offering enhanced cooling, expandability, and aesthetics.\\\",\\\"id\\\":9367},{\\\"category_name\\\":\\\"Computer Cooling\\\",\\\"description\\\":\\\"This category includes CPU coolers and case fans for efficient computer cooling.\\\",\\\"id\\\":9379},{\\\"category_name\\\":\\\"Computer Case Accessories\\\",\\\"description\\\":\\\"Accessories for enhancing, protecting, and customizing computer cases.\\\",\\\"id\\\":9518}][categories-data end]\\n if it does not fit into any given category than set category_id as 0 and describe why. \\n Please return response in proper JSON format [text end]<end_of_turn>\n<start_of_turn>model\n\n"
time=2025-04-28T15:44:24.519Z level=DEBUG source=process_text_spm.go:184 msg="adding bos token to prompt" id=2
time=2025-04-28T15:44:24.736Z level=DEBUG source=cache.go:136 msg="loading cache slot" id=0 cache=755 prompt=688 used=91 remaining=597
[GIN] 2025/04/28 - 15:44:27 | 200 |  3.294044404s |      172.19.0.3 | POST     "/api/generate"
time=2025-04-28T15:44:27.729Z level=DEBUG source=sched.go:409 msg="context for request finished"
time=2025-04-28T15:44:27.730Z level=DEBUG source=sched.go:341 msg="runner with non-zero duration has gone idle, adding timer" modelPath=/root/.ollama/models/blobs/sha256-ccc0cddac56136ef0969cf2e3e9ac051124c937be42503b47ec570dead85ff87 duration=2562047h47m16.854775807s
time=2025-04-28T15:44:27.730Z level=DEBUG source=sched.go:359 msg="after processing request finished event" modelPath=/root/.ollama/models/blobs/sha256-ccc0cddac56136ef0969cf2e3e9ac051124c937be42503b47ec570dead85ff87 refCount=0
time=2025-04-28T15:44:28.509Z level=WARN source=ggml.go:152 msg="key not found" key=general.alignment default=32
time=2025-04-28T15:44:28.514Z level=DEBUG source=sched.go:577 msg="evaluating already loaded" model=/root/.ollama/models/blobs/sha256-ccc0cddac56136ef0969cf2e3e9ac051124c937be42503b47ec570dead85ff87
time=2025-04-28T15:44:28.514Z level=DEBUG source=routes.go:297 msg="generate request" images=1 prompt="<start_of_turn>user\nYou act as a web-shop expert reaponsible to properly classify any given product. You carefully examine image of the product (if provided), product-data and categories-data. Then decide if it fits into any given category and if it does, which category is the best fit for the product. You also provide a short explanation of your choice.\nPlease return response in following JSON format:<end_of_turn>\n<start_of_turn>user\n[img-0]\n\n[text beginning] Read about the product from:[product-data start] [\\\"Product_name: Notebook aspire one.\\\", \\\"Description: Extended warranty to 3 years.\\\", \\\"Warranty_type is Extended Warranty.\\\", \\\"Warranty_period is 3 years.\\\", \\\"Suggested_category is Laptops.\\\"] [product-data end] and decide which category product fits the best:[categories-data start][{\\\"category_name\\\":\\\"Software Warranties\\\",\\\"description\\\":\\\"This category covers warranties offered with software products, detailing different types and their conditions.\\\",\\\"id\\\":9398},{\\\"category_name\\\":\\\"Laptops\\\",\\\"description\\\":\\\"Portable computers for work, education, and entertainment.\\\",\\\"id\\\":9562},{\\\"category_name\\\":\\\"Laptops for Everyday Use\\\",\\\"description\\\":\\\"Laptops designed for general everyday tasks like browsing, office work, and entertainment.\\\",\\\"id\\\":9563},{\\\"category_name\\\":\\\"Business Laptops\\\",\\\"description\\\":\\\"Business laptops are portable, reliable, and secure devices designed for professional use.\\\",\\\"id\\\":9565},{\\\"category_name\\\":\\\"School Laptops\\\",\\\"description\\\":\\\"Affordable and portable laptops ideal for students and school use.\\\",\\\"id\\\":9566},{\\\"category_name\\\":\\\"Laptop Batteries\\\",\\\"description\\\":\\\"Replacement batteries for laptops, including OEM and aftermarket options.\\\",\\\"id\\\":9582},{\\\"category_name\\\":\\\"Laptop Chargers\\\",\\\"description\\\":\\\"This category contains chargers for laptops, ensuring safe and efficient power delivery.\\\",\\\"id\\\":9583},{\\\"category_name\\\":\\\"Laptop Accessories - Cleaning and Maintenance\\\",\\\"description\\\":\\\"Products for keeping laptops clean and functioning optimally.\\\",\\\"id\\\":9586},{\\\"category_name\\\":\\\"Gaming Laptops\\\",\\\"description\\\":\\\"High-performance laptops designed specifically for gaming, offering powerful hardware and immersive experiences.\\\",\\\"id\\\":9564}][categories-data end]\\n if it does not fit into any given category than set category_id as 0 and describe why. \\n Please return response in proper JSON format [text end]<end_of_turn>\n<start_of_turn>model\n\n"
time=2025-04-28T15:44:28.516Z level=DEBUG source=process_text_spm.go:184 msg="adding bos token to prompt" id=2
time=2025-04-28T15:44:28.703Z level=DEBUG source=cache.go:136 msg="loading cache slot" id=0 cache=749 prompt=782 used=91 remaining=691
[GIN] 2025/04/28 - 15:44:32 | 200 |  4.036546946s |      172.19.0.3 | POST     "/api/generate"
time=2025-04-28T15:44:32.460Z level=DEBUG source=sched.go:409 msg="context for request finished"
time=2025-04-28T15:44:32.461Z level=DEBUG source=sched.go:341 msg="runner with non-zero duration has gone idle, adding timer" modelPath=/root/.ollama/models/blobs/sha256-ccc0cddac56136ef0969cf2e3e9ac051124c937be42503b47ec570dead85ff87 duration=2562047h47m16.854775807s
time=2025-04-28T15:44:32.461Z level=DEBUG source=sched.go:359 msg="after processing request finished event" modelPath=/root/.ollama/models/blobs/sha256-ccc0cddac56136ef0969cf2e3e9ac051124c937be42503b47ec570dead85ff87 refCount=0
time=2025-04-28T15:44:33.482Z level=WARN source=ggml.go:152 msg="key not found" key=general.alignment default=32
time=2025-04-28T15:44:33.487Z level=DEBUG source=sched.go:577 msg="evaluating already loaded" model=/root/.ollama/models/blobs/sha256-ccc0cddac56136ef0969cf2e3e9ac051124c937be42503b47ec570dead85ff87
time=2025-04-28T15:44:33.488Z level=DEBUG source=routes.go:297 msg="generate request" images=1 prompt="<start_of_turn>user\nYou act as a web-shop expert reaponsible to properly classify any given product. You carefully examine image of the product (if provided), product-data and categories-data. Then decide if it fits into any given category and if it does, which category is the best fit for the product. You also provide a short explanation of your choice.\nPlease return response in following JSON format:<end_of_turn>\n<start_of_turn>user\n[img-0]\n\n[text beginning] Read about the product from:[product-data start] [\\\"Product_name: Usb-c to vga adapter.\\\", \\\"Description: Usb-c to vga adapter with support for 1920x1200 and 1080p resolutions..\\\", \\\"Output_type is VGA.\\\", \\\"Interface_type is USB-C.\\\", \\\"Output_resolution includes 1920x1200, 1080p.\\\", \\\"Suggested_category is Adapters \\u0026 Cables.\\\"] [product-data end] and decide which category product fits the best:[categories-data start][{\\\"category_name\\\":\\\"Adapters and Connectors\\\",\\\"description\\\":\\\"This category contains various adapters and connectors for audio and video equipment.\\\",\\\"id\\\":6220},{\\\"category_name\\\":\\\"Camera Cables \\\\u0026 Adapters\\\",\\\"description\\\":\\\"Cables and adapters for connecting cameras to computers, monitors, and other devices.\\\",\\\"id\\\":7105},{\\\"category_name\\\":\\\"DisplayPort Cables\\\",\\\"description\\\":\\\"DisplayPort cables transmit high-definition audio and video signals, commonly used in computers and professional displays.\\\",\\\"id\\\":9510},{\\\"category_name\\\":\\\"Computer Cables and Adapters\\\",\\\"description\\\":\\\"Essential cables and adapters for connecting and enhancing computer and multimedia devices.\\\",\\\"id\\\":9511},{\\\"category_name\\\":\\\"Laptop Accessories - Adapters and Connectors\\\",\\\"description\\\":\\\"This category contains adapters and connectors for laptops, enabling compatibility between various devices and adding functionality like Bluetooth or network access.\\\",\\\"id\\\":9584},{\\\"category_name\\\":\\\"Mobile Phone Cables and Adapters\\\",\\\"description\\\":\\\"This category includes all types of cables and adapters used for charging and data transfer with mobile phones.\\\",\\\"id\\\":10112},{\\\"category_name\\\":\\\"Mobile Phone Cables and Adapters\\\",\\\"description\\\":\\\"Adapters for charging mobile phones while traveling internationally.\\\",\\\"id\\\":10113},{\\\"category_name\\\":\\\"Mobile Phone Cables \\\\u0026 Adapters\\\",\\\"description\\\":\\\"Data cables and OTG adapters for mobile phones, used for charging, data transfer and backup.\\\",\\\"id\\\":10114},{\\\"category_name\\\":\\\"Mobile Phone Cables\\\",\\\"description\\\":\\\"This category includes charging and data transfer cables for mobile phones and other compatible devices.\\\",\\\"id\\\":10115}][categories-data end]\\n if it does not fit into any given category than set category_id as 0 and describe why. \\n Please return response in proper JSON format [text end]<end_of_turn>\n<start_of_turn>model\n\n"
time=2025-04-28T15:44:33.490Z level=DEBUG source=process_text_spm.go:184 msg="adding bos token to prompt" id=2
time=2025-04-28T15:44:33.743Z level=DEBUG source=cache.go:136 msg="loading cache slot" id=0 cache=865 prompt=902 used=91 remaining=811
[GIN] 2025/04/28 - 15:44:37 | 200 |  4.159372497s |      172.19.0.3 | POST     "/api/generate"
time=2025-04-28T15:44:37.577Z level=DEBUG source=sched.go:409 msg="context for request finished"
time=2025-04-28T15:44:37.577Z level=DEBUG source=sched.go:341 msg="runner with non-zero duration has gone idle, adding timer" modelPath=/root/.ollama/models/blobs/sha256-ccc0cddac56136ef0969cf2e3e9ac051124c937be42503b47ec570dead85ff87 duration=2562047h47m16.854775807s
time=2025-04-28T15:44:37.577Z level=DEBUG source=sched.go:359 msg="after processing request finished event" modelPath=/root/.ollama/models/blobs/sha256-ccc0cddac56136ef0969cf2e3e9ac051124c937be42503b47ec570dead85ff87 refCount=0
time=2025-04-28T15:44:38.502Z level=WARN source=ggml.go:152 msg="key not found" key=general.alignment default=32
time=2025-04-28T15:44:38.508Z level=DEBUG source=sched.go:577 msg="evaluating already loaded" model=/root/.ollama/models/blobs/sha256-ccc0cddac56136ef0969cf2e3e9ac051124c937be42503b47ec570dead85ff87
time=2025-04-28T15:44:38.509Z level=DEBUG source=routes.go:297 msg="generate request" images=1 prompt="<start_of_turn>user\nYou act as a web-shop expert reaponsible to properly classify any given product. You carefully examine image of the product (if provided), product-data and categories-data. Then decide if it fits into any given category and if it does, which category is the best fit for the product. You also provide a short explanation of your choice.\nPlease return response in following JSON format:<end_of_turn>\n<start_of_turn>user\n[img-0]\n\n[text beginning] Read about the product from:[product-data start] [\\\"Product_name: Asus tuf gaming 750g power supply.\\\", \\\"Description: Asus tuf gaming 750g, 750w, 80 plus gold certified power supply..\\\", \\\"Series is TUF GAMING.\\\", \\\"Wattage is 750W.\\\", \\\"Certification is 80 Plus Gold.\\\", \\\"Power_supply_type is ATX.\\\", \\\"Suggested_category is Computer Power Supplies.\\\"] [product-data end] and decide which category product fits the best:[categories-data start][{\\\"category_name\\\":\\\"Power Cables\\\",\\\"description\\\":\\\"This category contains various power cables for connecting devices to a power source.\\\",\\\"id\\\":6227},{\\\"category_name\\\":\\\"Gaming PC Cases\\\",\\\"description\\\":\\\"Cases specifically designed for gaming PCs, offering enhanced cooling, expandability, and aesthetics.\\\",\\\"id\\\":9367},{\\\"category_name\\\":\\\"Power Supplies\\\",\\\"description\\\":\\\"Power supplies provide the necessary electrical power for a computer system to function.\\\",\\\"id\\\":9371},{\\\"category_name\\\":\\\"Uninterruptible Power Supplies (UPS)\\\",\\\"description\\\":\\\"UPS devices provide backup power to protect electronics during outages and voltage fluctuations.\\\",\\\"id\\\":9396},{\\\"category_name\\\":\\\"Computer Accessories/Miscellaneous | Power Surge Protection\\\",\\\"description\\\":\\\"This category includes devices that protect electronic equipment from power surges and voltage spikes.\\\",\\\"id\\\":9512},{\\\"category_name\\\":\\\"Computer Cleaning Supplies\\\",\\\"description\\\":\\\"Supplies for maintaining the cleanliness and optimal performance of computers.\\\",\\\"id\\\":9517},{\\\"category_name\\\":\\\"Gaming Desktops\\\",\\\"description\\\":\\\"High-performance desktop computers designed for demanding gaming experiences.\\\",\\\"id\\\":9571}][categories-data end]\\n if it does not fit into any given category than set category_id as 0 and describe why. \\n Please return response in proper JSON format [text end]<end_of_turn>\n<start_of_turn>model\n\n"
time=2025-04-28T15:44:38.512Z level=DEBUG source=process_text_spm.go:184 msg="adding bos token to prompt" id=2
time=2025-04-28T15:44:38.740Z level=DEBUG source=cache.go:136 msg="loading cache slot" id=0 cache=984 prompt=774 used=91 remaining=683
[GIN] 2025/04/28 - 15:44:42 | 200 |  3.920623427s |      172.19.0.3 | POST     "/api/generate"
time=2025-04-28T15:44:42.265Z level=DEBUG source=sched.go:409 msg="context for request finished"
time=2025-04-28T15:44:42.265Z level=DEBUG source=sched.go:341 msg="runner with non-zero duration has gone idle, adding timer" modelPath=/root/.ollama/models/blobs/sha256-ccc0cddac56136ef0969cf2e3e9ac051124c937be42503b47ec570dead85ff87 duration=2562047h47m16.854775807s
time=2025-04-28T15:44:42.265Z level=DEBUG source=sched.go:359 msg="after processing request finished event" modelPath=/root/.ollama/models/blobs/sha256-ccc0cddac56136ef0969cf2e3e9ac051124c937be42503b47ec570dead85ff87 refCount=0
time=2025-04-28T15:44:42.893Z level=WARN source=ggml.go:152 msg="key not found" key=general.alignment default=32
time=2025-04-28T15:44:42.898Z level=DEBUG source=sched.go:577 msg="evaluating already loaded" model=/root/.ollama/models/blobs/sha256-ccc0cddac56136ef0969cf2e3e9ac051124c937be42503b47ec570dead85ff87
time=2025-04-28T15:44:42.899Z level=DEBUG source=routes.go:297 msg="generate request" images=1 prompt="<start_of_turn>user\nYou act as a web-shop expert reaponsible to properly classify any given product. You carefully examine image of the product (if provided), product-data and categories-data. Then decide if it fits into any given category and if it does, which category is the best fit for the product. You also provide a short explanation of your choice.\nPlease return response in following JSON format:<end_of_turn>\n<start_of_turn>user\n[img-0]\n\n[text beginning] Read about the product from:[product-data start] [\\\"Product_name: Gts 3 graphite black.\\\", \\\"Description: Smartwatch with 1.75 inch display, 1000 nits brightness, 341 ppi resolution, 5 atm water resistance, and 12 days of battery life..\\\", \\\"Brightness is 1000 nit.\\\", \\\"Battery_life is 12 days.\\\", \\\"Display_size is 1.75\\\\\\\".\\\", \\\"Pixel_density is 341 ppi.\\\", \\\"Water_resistance is 5 ATM.\\\", \\\"Suggested_category is Smartwatch.\\\"] [product-data end] and decide which category product fits the best:[categories-data start][{\\\"category_name\\\":\\\"Men's Wristwatches\\\",\\\"description\\\":\\\"A wide selection of men's wristwatches, including analog, digital, and smartwatches.\\\",\\\"id\\\":6974},{\\\"category_name\\\":\\\"Smartwatches\\\",\\\"description\\\":\\\"Smartwatches combine functionality, technology, and style for health tracking, notifications, and more.\\\",\\\"id\\\":6983},{\\\"category_name\\\":\\\"Smartwatches\\\",\\\"description\\\":\\\"Smartwatches are technologically advanced watches with smartphone-like features.\\\",\\\"id\\\":6984},{\\\"category_name\\\":\\\"Sports Watches\\\",\\\"description\\\":\\\"This category features durable and stylish sports watches for active individuals and those who appreciate the sporty look.\\\",\\\"id\\\":6987},{\\\"category_name\\\":\\\"Sports Watches with GPS\\\",\\\"description\\\":\\\"Sports watches with built-in GPS for independent route tracking and analysis.\\\",\\\"id\\\":6988},{\\\"category_name\\\":\\\"Men's Analog Watches\\\",\\\"description\\\":\\\"Classic and elegant timepieces for men, featuring traditional analog displays.\\\",\\\"id\\\":6975},{\\\"category_name\\\":\\\"Men's Digital Wristwatches\\\",\\\"description\\\":\\\"This category features men's digital wristwatches, combining style, technology, and practical features.\\\",\\\"id\\\":6976},{\\\"category_name\\\":\\\"Fitness Trackers\\\",\\\"description\\\":\\\"Fitness trackers help monitor health and activity levels, motivating users to achieve their fitness goals.\\\",\\\"id\\\":6985}][categories-data end]\\n if it does not fit into any given category than set category_id as 0 and describe why. \\n Please return response in proper JSON format [text end]<end_of_turn>\n<start_of_turn>model\n\n"
time=2025-04-28T15:44:42.901Z level=DEBUG source=process_text_spm.go:184 msg="adding bos token to prompt" id=2
time=2025-04-28T15:44:42.996Z level=DEBUG source=cache.go:136 msg="loading cache slot" id=0 cache=847 prompt=855 used=91 remaining=764
[GIN] 2025/04/28 - 15:44:46 | 200 |  4.038629499s |      172.19.0.3 | POST     "/api/generate"
time=2025-04-28T15:44:46.881Z level=DEBUG source=sched.go:409 msg="context for request finished"
time=2025-04-28T15:44:46.881Z level=DEBUG source=sched.go:341 msg="runner with non-zero duration has gone idle, adding timer" modelPath=/root/.ollama/models/blobs/sha256-ccc0cddac56136ef0969cf2e3e9ac051124c937be42503b47ec570dead85ff87 duration=2562047h47m16.854775807s
time=2025-04-28T15:44:46.881Z level=DEBUG source=sched.go:359 msg="after processing request finished event" modelPath=/root/.ollama/models/blobs/sha256-ccc0cddac56136ef0969cf2e3e9ac051124c937be42503b47ec570dead85ff87 refCount=0
time=2025-04-28T15:44:48.275Z level=WARN source=ggml.go:152 msg="key not found" key=general.alignment default=32
time=2025-04-28T15:44:48.281Z level=DEBUG source=sched.go:577 msg="evaluating already loaded" model=/root/.ollama/models/blobs/sha256-ccc0cddac56136ef0969cf2e3e9ac051124c937be42503b47ec570dead85ff87
time=2025-04-28T15:44:48.282Z level=DEBUG source=routes.go:297 msg="generate request" images=1 prompt="<start_of_turn>user\nYou act as a web-shop expert reaponsible to properly classify any given product. You carefully examine image of the product (if provided), product-data and categories-data. Then decide if it fits into any given category and if it does, which category is the best fit for the product. You also provide a short explanation of your choice.\nPlease return response in following JSON format:<end_of_turn>\n<start_of_turn>user\n[img-0]\n\n[text beginning] Read about the product from:[product-data start] [\\\"Product_name: Ryzen 3 4100.\\\", \\\"Description: 4 cores, 8 threads, 3.8ghz, 4mb l3 cache, am4 socket.\\\", \\\"Suggested_category is CPU.\\\"] [product-data end] and decide which category product fits the best:[categories-data start][{\\\"category_name\\\":\\\"Processors\\\",\\\"description\\\":\\\"Processors are the central processing units that power computers, responsible for executing instructions and performing calculations.\\\",\\\"id\\\":9363},{\\\"category_name\\\":\\\"Computer Cooling\\\",\\\"description\\\":\\\"This category includes all types of cooling solutions for computer components.\\\",\\\"id\\\":9378},{\\\"category_name\\\":\\\"Computer Cooling\\\",\\\"description\\\":\\\"This category includes CPU coolers and case fans for efficient computer cooling.\\\",\\\"id\\\":9379},{\\\"category_name\\\":\\\"PC Modification\\\",\\\"description\\\":\\\"This category includes components and accessories used for customizing and enhancing the appearance and performance of personal computers.\\\",\\\"id\\\":9388},{\\\"category_name\\\":\\\"Computers\\\",\\\"description\\\":\\\"This category includes all types of computers, from standard desktops to high-end gaming rigs and specialized embedded systems.\\\",\\\"id\\\":9567},{\\\"category_name\\\":\\\"Thermal Paste\\\",\\\"description\\\":\\\"Thermal paste enhances heat transfer between computer components and their coolers.\\\",\\\"id\\\":9380},{\\\"category_name\\\":\\\"Water Cooling\\\",\\\"description\\\":\\\"Components for liquid cooling systems used to maintain optimal computer temperatures.\\\",\\\"id\\\":9381},{\\\"category_name\\\":\\\"All-in-One Computers\\\",\\\"description\\\":\\\"All-in-One computers integrate the monitor and central processing unit into a single unit, offering a space-saving and convenient computing solution.\\\",\\\"id\\\":9568},{\\\"category_name\\\":\\\"Computer Kits\\\",\\\"description\\\":\\\"Bundled sets of computer hardware and software, offering a complete computing solution.\\\",\\\"id\\\":9569},{\\\"category_name\\\":\\\"Desktop Computers (PC Computers)\\\",\\\"description\\\":\\\"Desktop computers designed for general everyday tasks and use in homes and offices.\\\",\\\"id\\\":9570},{\\\"category_name\\\":\\\"Gaming Desktops\\\",\\\"description\\\":\\\"High-performance desktop computers designed for demanding gaming experiences.\\\",\\\"id\\\":9571},{\\\"category_name\\\":\\\"Business Desktop Computers\\\",\\\"description\\\":\\\"Desktop computers designed for business use, offering a balance of performance, security, and affordability.\\\",\\\"id\\\":9572},{\\\"category_name\\\":\\\"Mini Computers - Nettops\\\",\\\"description\\\":\\\"Mini PCs, often fanless and ruggedized, designed for industrial, military, and general-purpose applications requiring small size and reliability.\\\",\\\"id\\\":9573}][categories-data end]\\n if it does not fit into any given category than set category_id as 0 and describe why. \\n Please return response in proper JSON format [text end]<end_of_turn>\n<start_of_turn>model\n\n"
time=2025-04-28T15:44:48.284Z level=DEBUG source=process_text_spm.go:184 msg="adding bos token to prompt" id=2
time=2025-04-28T15:44:48.443Z level=DEBUG source=cache.go:136 msg="loading cache slot" id=0 cache=936 prompt=968 used=91 remaining=877
[GIN] 2025/04/28 - 15:44:52 | 200 |  4.294356701s |      172.19.0.3 | POST     "/api/generate"
time=2025-04-28T15:44:52.268Z level=DEBUG source=sched.go:409 msg="context for request finished"
time=2025-04-28T15:44:52.268Z level=DEBUG source=sched.go:341 msg="runner with non-zero duration has gone idle, adding timer" modelPath=/root/.ollama/models/blobs/sha256-ccc0cddac56136ef0969cf2e3e9ac051124c937be42503b47ec570dead85ff87 duration=2562047h47m16.854775807s
time=2025-04-28T15:44:52.268Z level=DEBUG source=sched.go:359 msg="after processing request finished event" modelPath=/root/.ollama/models/blobs/sha256-ccc0cddac56136ef0969cf2e3e9ac051124c937be42503b47ec570dead85ff87 refCount=0
time=2025-04-28T15:44:53.267Z level=WARN source=ggml.go:152 msg="key not found" key=general.alignment default=32
time=2025-04-28T15:44:53.270Z level=DEBUG source=sched.go:577 msg="evaluating already loaded" model=/root/.ollama/models/blobs/sha256-ccc0cddac56136ef0969cf2e3e9ac051124c937be42503b47ec570dead85ff87
time=2025-04-28T15:44:53.271Z level=DEBUG source=routes.go:297 msg="generate request" images=1 prompt="<start_of_turn>user\nYou act as a web-shop expert reaponsible to properly classify any given product. You carefully examine image of the product (if provided), product-data and categories-data. Then decide if it fits into any given category and if it does, which category is the best fit for the product. You also provide a short explanation of your choice.\nPlease return response in following JSON format:<end_of_turn>\n<start_of_turn>user\n[img-0]\n\n[text beginning] Read about the product from:[product-data start] [\\\"Product_name: Ryzen 3 3200g.\\\", \\\"Description: 4 cores, 4 threads, 3.6ghz base clock, 4mb l3 cache, 65w tdp, integrated radeon vega 8 graphics.\\\", \\\"Suggested_category is CPU.\\\"] [product-data end] and decide which category product fits the best:[categories-data start][{\\\"category_name\\\":\\\"Processors\\\",\\\"description\\\":\\\"Processors are the central processing units that power computers, responsible for executing instructions and performing calculations.\\\",\\\"id\\\":9363},{\\\"category_name\\\":\\\"Computer Cooling\\\",\\\"description\\\":\\\"This category includes all types of cooling solutions for computer components.\\\",\\\"id\\\":9378},{\\\"category_name\\\":\\\"Computer Cooling\\\",\\\"description\\\":\\\"This category includes CPU coolers and case fans for efficient computer cooling.\\\",\\\"id\\\":9379},{\\\"category_name\\\":\\\"Other Computer Components\\\",\\\"description\\\":\\\"This category includes all computer components that are not core parts like the CPU, motherboard, or RAM.\\\",\\\"id\\\":9383},{\\\"category_name\\\":\\\"PC Modification\\\",\\\"description\\\":\\\"This category includes components and accessories used for customizing and enhancing the appearance and performance of personal computers.\\\",\\\"id\\\":9388},{\\\"category_name\\\":\\\"Computers\\\",\\\"description\\\":\\\"This category includes all types of computers, from standard desktops to high-end gaming rigs and specialized embedded systems.\\\",\\\"id\\\":9567},{\\\"category_name\\\":\\\"Thermal Paste\\\",\\\"description\\\":\\\"Thermal paste enhances heat transfer between computer components and their coolers.\\\",\\\"id\\\":9380},{\\\"category_name\\\":\\\"Water Cooling\\\",\\\"description\\\":\\\"Components for liquid cooling systems used to maintain optimal computer temperatures.\\\",\\\"id\\\":9381},{\\\"category_name\\\":\\\"TV/Video Capture Cards\\\",\\\"description\\\":\\\"These cards allow computers to receive and process TV signals, enabling TV viewing and video capture.\\\",\\\"id\\\":9384},{\\\"category_name\\\":\\\"Cables and Connectors\\\",\\\"description\\\":\\\"This category includes cables and adapters necessary for connecting computer components and peripherals.\\\",\\\"id\\\":9385},{\\\"category_name\\\":\\\"Expansion Cards\\\",\\\"description\\\":\\\"Expansion cards add functionality to a computer by plugging into expansion slots on the motherboard.\\\",\\\"id\\\":9386},{\\\"category_name\\\":\\\"External Sound Cards\\\",\\\"description\\\":\\\"External sound cards provide enhanced audio quality and connectivity for computers and other devices.\\\",\\\"id\\\":9387},{\\\"category_name\\\":\\\"Drive Holders and Adapters\\\",\\\"description\\\":\\\"These adapters help efficiently manage free space inside a computer case while expanding its data storage.\\\",\\\"id\\\":9389},{\\\"category_name\\\":\\\"PC Lighting\\\",\\\"description\\\":\\\"Components and peripherals that add customizable lighting effects to a PC.\\\",\\\"id\\\":9390},{\\\"category_name\\\":\\\"All-in-One Computers\\\",\\\"description\\\":\\\"All-in-One computers integrate the monitor and central processing unit into a single unit, offering a space-saving and convenient computing solution.\\\",\\\"id\\\":9568},{\\\"category_name\\\":\\\"Computer Kits\\\",\\\"description\\\":\\\"Bundled sets of computer hardware and software, offering a complete computing solution.\\\",\\\"id\\\":9569},{\\\"category_name\\\":\\\"Desktop Computers (PC Computers)\\\",\\\"description\\\":\\\"Desktop computers designed for general everyday tasks and use in homes and offices.\\\",\\\"id\\\":9570},{\\\"category_name\\\":\\\"Gaming Desktops\\\",\\\"description\\\":\\\"High-performance desktop computers designed for demanding gaming experiences.\\\",\\\"id\\\":9571},{\\\"category_name\\\":\\\"Business Desktop Computers\\\",\\\"description\\\":\\\"Desktop computers designed for business use, offering a balance of performance, security, and affordability.\\\",\\\"id\\\":9572},{\\\"category_name\\\":\\\"Mini Computers - Nettops\\\",\\\"description\\\":\\\"Mini PCs, often fanless and ruggedized, designed for industrial, military, and general-purpose applications requiring small size and reliability.\\\",\\\"id\\\":9573}][categories-data end]\\n if it does not fit into any given category than set category_id as 0 and describe why. \\n Please return response in proper JSON format [text end]<end_of_turn>\n<start_of_turn>model\n\n"
time=2025-04-28T15:44:53.273Z level=DEBUG source=process_text_spm.go:184 msg="adding bos token to prompt" id=2
time=2025-04-28T15:44:53.438Z level=DEBUG source=cache.go:136 msg="loading cache slot" id=0 cache=1044 prompt=1238 used=0 remaining=1238
[GIN] 2025/04/28 - 15:44:57 | 200 |  4.180067608s |      172.19.0.3 | POST     "/api/generate"
time=2025-04-28T15:44:57.347Z level=DEBUG source=sched.go:409 msg="context for request finished"
time=2025-04-28T15:44:57.347Z level=DEBUG source=sched.go:341 msg="runner with non-zero duration has gone idle, adding timer" modelPath=/root/.ollama/models/blobs/sha256-ccc0cddac56136ef0969cf2e3e9ac051124c937be42503b47ec570dead85ff87 duration=2562047h47m16.854775807s
time=2025-04-28T15:44:57.347Z level=DEBUG source=sched.go:359 msg="after processing request finished event" modelPath=/root/.ollama/models/blobs/sha256-ccc0cddac56136ef0969cf2e3e9ac051124c937be42503b47ec570dead85ff87 refCount=0
time=2025-04-28T15:44:58.361Z level=WARN source=ggml.go:152 msg="key not found" key=general.alignment default=32
time=2025-04-28T15:44:58.364Z level=DEBUG source=sched.go:577 msg="evaluating already loaded" model=/root/.ollama/models/blobs/sha256-ccc0cddac56136ef0969cf2e3e9ac051124c937be42503b47ec570dead85ff87
time=2025-04-28T15:44:58.364Z level=DEBUG source=routes.go:297 msg="generate request" images=1 prompt="<start_of_turn>user\nYou act as a web-shop expert reaponsible to properly classify any given product. You carefully examine image of the product (if provided), product-data and categories-data. Then decide if it fits into any given category and if it does, which category is the best fit for the product. You also provide a short explanation of your choice.\nPlease return response in following JSON format:<end_of_turn>\n<start_of_turn>user\n[img-0]\n\n[text beginning] Read about the product from:[product-data start] [\\\"Product_name: Gembird virtus plus sound card.\\\", \\\"Description: Usb 2.0 sound card.\\\", \\\"Type is Sound Card.\\\", \\\"Brand is GEMBIRD.\\\", \\\"Model is Virtus Plus.\\\", \\\"Interface is USB 2.0.\\\", \\\"Suggested_category is Sound Cards.\\\"] [product-data end] and decide which category product fits the best:[categories-data start][{\\\"category_name\\\":\\\"Memory Cards and Readers\\\",\\\"description\\\":\\\"This category includes various memory cards and card readers for different devices.\\\",\\\"id\\\":7115},{\\\"category_name\\\":\\\"Memory Cards and Readers\\\",\\\"description\\\":\\\"This category includes various types of memory cards and card readers for storing and transferring digital data.\\\",\\\"id\\\":7116},{\\\"category_name\\\":\\\"Graphics Cards\\\",\\\"description\\\":\\\"Graphics cards process and display images, videos, and graphics on a computer monitor.\\\",\\\"id\\\":9364},{\\\"category_name\\\":\\\"Sound Cards\\\",\\\"description\\\":\\\"Sound cards enhance audio input and output capabilities of a computer system.\\\",\\\"id\\\":9372},{\\\"category_name\\\":\\\"TV/Video Capture Cards\\\",\\\"description\\\":\\\"These cards allow computers to receive and process TV signals, enabling TV viewing and video capture.\\\",\\\"id\\\":9384},{\\\"category_name\\\":\\\"External Sound Cards\\\",\\\"description\\\":\\\"External sound cards provide enhanced audio quality and connectivity for computers and other devices.\\\",\\\"id\\\":9387}][categories-data end]\\n if it does not fit into any given category than set category_id as 0 and describe why. \\n Please return response in proper JSON format [text end]<end_of_turn>\n<start_of_turn>model\n\n"
time=2025-04-28T15:44:58.366Z level=DEBUG source=process_text_spm.go:184 msg="adding bos token to prompt" id=2
time=2025-04-28T15:44:58.477Z level=DEBUG source=cache.go:136 msg="loading cache slot" id=0 cache=1311 prompt=717 used=0 remaining=717
[GIN] 2025/04/28 - 15:45:02 | 200 |  3.888141147s |      172.19.0.3 | POST     "/api/generate"
time=2025-04-28T15:45:02.163Z level=DEBUG source=sched.go:409 msg="context for request finished"
time=2025-04-28T15:45:02.163Z level=DEBUG source=sched.go:341 msg="runner with non-zero duration has gone idle, adding timer" modelPath=/root/.ollama/models/blobs/sha256-ccc0cddac56136ef0969cf2e3e9ac051124c937be42503b47ec570dead85ff87 duration=2562047h47m16.854775807s
time=2025-04-28T15:45:02.163Z level=DEBUG source=sched.go:359 msg="after processing request finished event" modelPath=/root/.ollama/models/blobs/sha256-ccc0cddac56136ef0969cf2e3e9ac051124c937be42503b47ec570dead85ff87 refCount=0
time=2025-04-28T15:45:02.893Z level=WARN source=ggml.go:152 msg="key not found" key=general.alignment default=32
time=2025-04-28T15:45:02.898Z level=DEBUG source=sched.go:577 msg="evaluating already loaded" model=/root/.ollama/models/blobs/sha256-ccc0cddac56136ef0969cf2e3e9ac051124c937be42503b47ec570dead85ff87
time=2025-04-28T15:45:02.898Z level=DEBUG source=routes.go:297 msg="generate request" images=1 prompt="<start_of_turn>user\nYou act as a web-shop expert reaponsible to properly classify any given product. You carefully examine image of the product (if provided), product-data and categories-data. Then decide if it fits into any given category and if it does, which category is the best fit for the product. You also provide a short explanation of your choice.\nPlease return response in following JSON format:<end_of_turn>\n<start_of_turn>user\n[img-0]\n\n[text beginning] Read about the product from:[product-data start] [\\\"Product_name: Smart-ups 2200va/1980w.\\\", \\\"Description: Smart-ups 2200va/1980w.\\\", \\\"Wattage is 1980 W.\\\", \\\"Va_rating is 2200 VA.\\\", \\\"Form_factor is Rackmount.\\\", \\\"Product_type is Rack Mount UPS.\\\", \\\"Suggested_category is UPS.\\\"] [product-data end] and decide which category product fits the best:[categories-data start][{\\\"category_name\\\":\\\"Power Cables\\\",\\\"description\\\":\\\"This category contains various power cables for connecting devices to a power source.\\\",\\\"id\\\":6227},{\\\"category_name\\\":\\\"Car Upholstery\\\",\\\"description\\\":\\\"Materials for durable and aesthetically pleasing car interior upholstery.\\\",\\\"id\\\":6261},{\\\"category_name\\\":\\\"Forklifts and Carts\\\",\\\"description\\\":\\\"Forklifts and carts for material handling in various industries and construction.\\\",\\\"id\\\":9090},{\\\"category_name\\\":\\\"Uninterruptible Power Supplies (UPS)\\\",\\\"description\\\":\\\"UPS devices provide backup power to protect electronics during outages and voltage fluctuations.\\\",\\\"id\\\":9396},{\\\"category_name\\\":\\\"Smart Plugs (Powerline)\\\",\\\"description\\\":\\\"Smart plugs allow remote control and monitoring of electrical appliances for convenience and energy savings.\\\",\\\"id\\\":9506},{\\\"category_name\\\":\\\"Computer Accessories/Miscellaneous | Power Surge Protection\\\",\\\"description\\\":\\\"This category includes devices that protect electronic equipment from power surges and voltage spikes.\\\",\\\"id\\\":9512},{\\\"category_name\\\":\\\"SUP Bags and Transport\\\",\\\"description\\\":\\\"Bags and systems for transporting and storing Stand-Up Paddleboards (SUPs) and accessories.\\\",\\\"id\\\":9734}][categories-data end]\\n if it does not fit into any given category than set category_id as 0 and describe why. \\n Please return response in proper JSON format [text end]<end_of_turn>\n<start_of_turn>model\n\n"
time=2025-04-28T15:45:02.900Z level=DEBUG source=process_text_spm.go:184 msg="adding bos token to prompt" id=2
time=2025-04-28T15:45:03.096Z level=DEBUG source=cache.go:136 msg="loading cache slot" id=0 cache=797 prompt=787 used=91 remaining=696
[GIN] 2025/04/28 - 15:45:07 | 200 |  4.232392469s |      172.19.0.3 | POST     "/api/generate"
time=2025-04-28T15:45:07.010Z level=DEBUG source=sched.go:409 msg="context for request finished"
time=2025-04-28T15:45:07.010Z level=DEBUG source=sched.go:341 msg="runner with non-zero duration has gone idle, adding timer" modelPath=/root/.ollama/models/blobs/sha256-ccc0cddac56136ef0969cf2e3e9ac051124c937be42503b47ec570dead85ff87 duration=2562047h47m16.854775807s
time=2025-04-28T15:45:07.010Z level=DEBUG source=sched.go:359 msg="after processing request finished event" modelPath=/root/.ollama/models/blobs/sha256-ccc0cddac56136ef0969cf2e3e9ac051124c937be42503b47ec570dead85ff87 refCount=0
time=2025-04-28T15:45:07.917Z level=WARN source=ggml.go:152 msg="key not found" key=general.alignment default=32
time=2025-04-28T15:45:07.922Z level=DEBUG source=sched.go:577 msg="evaluating already loaded" model=/root/.ollama/models/blobs/sha256-ccc0cddac56136ef0969cf2e3e9ac051124c937be42503b47ec570dead85ff87
time=2025-04-28T15:45:07.922Z level=DEBUG source=routes.go:297 msg="generate request" images=1 prompt="<start_of_turn>user\nYou act as a web-shop expert reaponsible to properly classify any given product. You carefully examine image of the product (if provided), product-data and categories-data. Then decide if it fits into any given category and if it does, which category is the best fit for the product. You also provide a short explanation of your choice.\nPlease return response in following JSON format:<end_of_turn>\n<start_of_turn>user\n[img-0]\n\n[text beginning] Read about the product from:[product-data start] [\\\"Product_name: Macbook air 15.3 2023 mqkw3ll/a.\\\", \\\"Description: Macbook air 15.3 2023 m2 8gb 256gb midnight.\\\", \\\"Ram is 8GB.\\\", \\\"Year is 2023.\\\", \\\"Color is Midnight.\\\", \\\"Model is MQKW3LL/A.\\\", \\\"Storage is 256GB.\\\", \\\"Processor is M2.\\\", \\\"Screen_size is 15.3 inches.\\\", \\\"Product_type is MacBook Air.\\\", \\\"Suggested_category is Laptops.\\\"] [product-data end] and decide which category product fits the best:[categories-data start][{\\\"category_name\\\":\\\"Laptops\\\",\\\"description\\\":\\\"Portable computers for work, education, and entertainment.\\\",\\\"id\\\":9562},{\\\"category_name\\\":\\\"Laptops for Everyday Use\\\",\\\"description\\\":\\\"Laptops designed for general everyday tasks like browsing, office work, and entertainment.\\\",\\\"id\\\":9563},{\\\"category_name\\\":\\\"Gaming Laptops\\\",\\\"description\\\":\\\"High-performance laptops designed specifically for gaming, offering powerful hardware and immersive experiences.\\\",\\\"id\\\":9564},{\\\"category_name\\\":\\\"Business Laptops\\\",\\\"description\\\":\\\"Business laptops are portable, reliable, and secure devices designed for professional use.\\\",\\\"id\\\":9565},{\\\"category_name\\\":\\\"School Laptops\\\",\\\"description\\\":\\\"Affordable and portable laptops ideal for students and school use.\\\",\\\"id\\\":9566},{\\\"category_name\\\":\\\"Computers\\\",\\\"description\\\":\\\"This category includes all types of computers, from standard desktops to high-end gaming rigs and specialized embedded systems.\\\",\\\"id\\\":9567},{\\\"category_name\\\":\\\"Laptop Chargers\\\",\\\"description\\\":\\\"This category contains chargers for laptops, ensuring safe and efficient power delivery.\\\",\\\"id\\\":9583},{\\\"category_name\\\":\\\"Laptop Accessories - Cleaning and Maintenance\\\",\\\"description\\\":\\\"Products for keeping laptops clean and functioning optimally.\\\",\\\"id\\\":9586},{\\\"category_name\\\":\\\"All-in-One Computers\\\",\\\"description\\\":\\\"All-in-One computers integrate the monitor and central processing unit into a single unit, offering a space-saving and convenient computing solution.\\\",\\\"id\\\":9568},{\\\"category_name\\\":\\\"Computer Kits\\\",\\\"description\\\":\\\"Bundled sets of computer hardware and software, offering a complete computing solution.\\\",\\\"id\\\":9569},{\\\"category_name\\\":\\\"Desktop Computers (PC Computers)\\\",\\\"description\\\":\\\"Desktop computers designed for general everyday tasks and use in homes and offices.\\\",\\\"id\\\":9570},{\\\"category_name\\\":\\\"Gaming Desktops\\\",\\\"description\\\":\\\"High-performance desktop computers designed for demanding gaming experiences.\\\",\\\"id\\\":9571},{\\\"category_name\\\":\\\"Business Desktop Computers\\\",\\\"description\\\":\\\"Desktop computers designed for business use, offering a balance of performance, security, and affordability.\\\",\\\"id\\\":9572},{\\\"category_name\\\":\\\"Mini Computers - Nettops\\\",\\\"description\\\":\\\"Mini PCs, often fanless and ruggedized, designed for industrial, military, and general-purpose applications requiring small size and reliability.\\\",\\\"id\\\":9573}][categories-data end]\\n if it does not fit into any given category than set category_id as 0 and describe why. \\n Please return response in proper JSON format [text end]<end_of_turn>\n<start_of_turn>model\n\n"
time=2025-04-28T15:45:07.924Z level=DEBUG source=process_text_spm.go:184 msg="adding bos token to prompt" id=2
time=2025-04-28T15:45:08.110Z level=DEBUG source=cache.go:136 msg="loading cache slot" id=0 cache=871 prompt=1085 used=91 remaining=994
[GIN] 2025/04/28 - 15:45:12 | 200 |  4.661316982s |      172.19.0.3 | POST     "/api/generate"
time=2025-04-28T15:45:12.486Z level=DEBUG source=sched.go:409 msg="context for request finished"
time=2025-04-28T15:45:12.486Z level=DEBUG source=sched.go:341 msg="runner with non-zero duration has gone idle, adding timer" modelPath=/root/.ollama/models/blobs/sha256-ccc0cddac56136ef0969cf2e3e9ac051124c937be42503b47ec570dead85ff87 duration=2562047h47m16.854775807s
time=2025-04-28T15:45:12.486Z level=DEBUG source=sched.go:359 msg="after processing request finished event" modelPath=/root/.ollama/models/blobs/sha256-ccc0cddac56136ef0969cf2e3e9ac051124c937be42503b47ec570dead85ff87 refCount=0
time=2025-04-28T15:45:13.208Z level=WARN source=ggml.go:152 msg="key not found" key=general.alignment default=32
time=2025-04-28T15:45:13.212Z level=DEBUG source=sched.go:577 msg="evaluating already loaded" model=/root/.ollama/models/blobs/sha256-ccc0cddac56136ef0969cf2e3e9ac051124c937be42503b47ec570dead85ff87
time=2025-04-28T15:45:13.213Z level=DEBUG source=routes.go:297 msg="generate request" images=1 prompt="<start_of_turn>user\nYou act as a web-shop expert reaponsible to properly classify any given product. You carefully examine image of the product (if provided), product-data and categories-data. Then decide if it fits into any given category and if it does, which category is the best fit for the product. You also provide a short explanation of your choice.\nPlease return response in following JSON format:<end_of_turn>\n<start_of_turn>user\n[img-0]\n\n[text beginning] Read about the product from:[product-data start] [\\\"Product_name: Iphone 14 128gb purple.\\\", \\\"Description: Iphone 14 with 128gb storage and purple color..\\\", \\\"Color is Purple.\\\", \\\"Model is iPhone 14.\\\", \\\"Display_size is 6.1\\\\\\\".\\\", \\\"Storage_capacity is 128 GB.\\\", \\\"Display_technology is Super Retina XDR OLED.\\\", \\\"Suggested_category is Smartphones.\\\"] [product-data end] and decide which category product fits the best:[categories-data start][{\\\"category_name\\\":\\\"Smartwatches\\\",\\\"description\\\":\\\"Smartwatches combine functionality, technology, and style for health tracking, notifications, and more.\\\",\\\"id\\\":6983},{\\\"category_name\\\":\\\"Smartwatches\\\",\\\"description\\\":\\\"Smartwatches are technologically advanced watches with smartphone-like features.\\\",\\\"id\\\":6984},{\\\"category_name\\\":\\\"Mobile Phones\\\",\\\"description\\\":\\\"This category contains a wide selection of mobile phones and related accessories.\\\",\\\"id\\\":10087},{\\\"category_name\\\":\\\"iPhones\\\",\\\"description\\\":\\\"This category contains Apple iPhones, known for their innovation, performance, and user experience.\\\",\\\"id\\\":10088},{\\\"category_name\\\":\\\"Mobile Phone Screens\\\",\\\"description\\\":\\\"Find replacement screens and repair kits for your smartphone.\\\",\\\"id\\\":10098},{\\\"category_name\\\":\\\"Phone Cases, Covers \\\\u0026 Pouches\\\",\\\"description\\\":\\\"Protective and decorative covers for mobile phones, including cases, pouches, and flip covers.\\\",\\\"id\\\":10116},{\\\"category_name\\\":\\\"Phone Cases, Covers \\\\u0026 Sleeves\\\",\\\"description\\\":\\\"This category includes protective cases, covers, and sleeves for mobile phones.\\\",\\\"id\\\":10117},{\\\"category_name\\\":\\\"Mobile Phone Cases, Pouches \\\\u0026 Bags\\\",\\\"description\\\":\\\"This category includes protective and stylish cases, pouches, and bags for mobile phones, particularly geared towards women's fashion.\\\",\\\"id\\\":10119},{\\\"category_name\\\":\\\"Fitness Trackers\\\",\\\"description\\\":\\\"Fitness trackers help monitor health and activity levels, motivating users to achieve their fitness goals.\\\",\\\"id\\\":6985},{\\\"category_name\\\":\\\"Samsung Galaxy Smartphones\\\",\\\"description\\\":\\\"This category includes Samsung Galaxy smartphones known for their innovative features, high performance, and advanced camera technology.\\\",\\\"id\\\":10089},{\\\"category_name\\\":\\\"Xiaomi Mi Smartphones\\\",\\\"description\\\":\\\"Xiaomi Mi smartphones offer premium features and performance at competitive prices.\\\",\\\"id\\\":10090},{\\\"category_name\\\":\\\"Xiaomi Redmi Smartphones\\\",\\\"description\\\":\\\"Xiaomi Redmi smartphones offer a balance of innovation, performance, and affordability.\\\",\\\"id\\\":10091},{\\\"category_name\\\":\\\"OnePlus Nord Smartphones\\\",\\\"description\\\":\\\"OnePlus Nord smartphones offer high-end features and performance at a more affordable price point.\\\",\\\"id\\\":10092},{\\\"category_name\\\":\\\"Mobile Phone Cases\\\",\\\"description\\\":\\\"Protective cases, including flip and book-style covers, for mobile phones.\\\",\\\"id\\\":10118},{\\\"category_name\\\":\\\"Running Phone Holders\\\",\\\"description\\\":\\\"Holders and straps designed to securely carry a phone while running.\\\",\\\"id\\\":10120}][categories-data end]\\n if it does not fit into any given category than set category_id as 0 and describe why. \\n Please return response in proper JSON format [text end]<end_of_turn>\n<start_of_turn>model\n\n"
time=2025-04-28T15:45:13.214Z level=DEBUG source=process_text_spm.go:184 msg="adding bos token to prompt" id=2
time=2025-04-28T15:45:13.388Z level=DEBUG source=cache.go:136 msg="loading cache slot" id=0 cache=1175 prompt=1100 used=0 remaining=1100
[GIN] 2025/04/28 - 15:45:17 | 200 |  4.227742024s |      172.19.0.3 | POST     "/api/generate"
time=2025-04-28T15:45:17.281Z level=DEBUG source=sched.go:409 msg="context for request finished"
time=2025-04-28T15:45:17.281Z level=DEBUG source=sched.go:341 msg="runner with non-zero duration has gone idle, adding timer" modelPath=/root/.ollama/models/blobs/sha256-ccc0cddac56136ef0969cf2e3e9ac051124c937be42503b47ec570dead85ff87 duration=2562047h47m16.854775807s
time=2025-04-28T15:45:17.281Z level=DEBUG source=sched.go:359 msg="after processing request finished event" modelPath=/root/.ollama/models/blobs/sha256-ccc0cddac56136ef0969cf2e3e9ac051124c937be42503b47ec570dead85ff87 refCount=0
time=2025-04-28T15:45:18.080Z level=WARN source=ggml.go:152 msg="key not found" key=general.alignment default=32
time=2025-04-28T15:45:18.094Z level=DEBUG source=sched.go:577 msg="evaluating already loaded" model=/root/.ollama/models/blobs/sha256-ccc0cddac56136ef0969cf2e3e9ac051124c937be42503b47ec570dead85ff87
time=2025-04-28T15:45:18.095Z level=DEBUG source=routes.go:297 msg="generate request" images=0 prompt="<start_of_turn>user\nYou act as a web-shop expert reaponsible to properly classify any given product. You carefully examine image of the product (if provided), product-data and categories-data. Then decide if it fits into any given category and if it does, which category is the best fit for the product. You also provide a short explanation of your choice.\nPlease return response in following JSON format:<end_of_turn>\n<start_of_turn>user\n[text beginning] Read about the product from:[product-data start] [\\\"Product_name: Asus tuf gaming 850w 80+ gold power supply.\\\", \\\"Description: 850w power supply with 80+ gold certification and full modular cabling..\\\", \\\"Wattage is 850W.\\\", \\\"Modularity is Full Modular.\\\", \\\"Certification is 80+ Gold.\\\", \\\"8pin_connector_count is 3.\\\", \\\"Sata_connector_count is 5.\\\", \\\"16pin_connector_count is 1.\\\", \\\"Suggested_category is PC Power Supplies.\\\"] [product-data end] and decide which category product fits the best:[categories-data start][{\\\"category_name\\\":\\\"Power Cables\\\",\\\"description\\\":\\\"This category contains various power cables for connecting devices to a power source.\\\",\\\"id\\\":6227},{\\\"category_name\\\":\\\"Gaming PC Cases\\\",\\\"description\\\":\\\"Cases specifically designed for gaming PCs, offering enhanced cooling, expandability, and aesthetics.\\\",\\\"id\\\":9367},{\\\"category_name\\\":\\\"Power Supplies\\\",\\\"description\\\":\\\"Power supplies provide the necessary electrical power for a computer system to function.\\\",\\\"id\\\":9371},{\\\"category_name\\\":\\\"Computer Cooling\\\",\\\"description\\\":\\\"This category includes CPU coolers and case fans for efficient computer cooling.\\\",\\\"id\\\":9379},{\\\"category_name\\\":\\\"Cables and Connectors\\\",\\\"description\\\":\\\"This category includes cables and adapters necessary for connecting computer components and peripherals.\\\",\\\"id\\\":9385},{\\\"category_name\\\":\\\"Uninterruptible Power Supplies (UPS)\\\",\\\"description\\\":\\\"UPS devices provide backup power to protect electronics during outages and voltage fluctuations.\\\",\\\"id\\\":9396}][categories-data end]\\n if it does not fit into any given category than set category_id as 0 and describe why. \\n Please return response in proper JSON format [text end]<end_of_turn>\n<start_of_turn>model\n\n"
time=2025-04-28T15:45:18.100Z level=DEBUG source=process_text_spm.go:184 msg="adding bos token to prompt" id=2
time=2025-04-28T15:45:18.101Z level=DEBUG source=cache.go:136 msg="loading cache slot" id=0 cache=1178 prompt=503 used=0 remaining=503
[GIN] 2025/04/28 - 15:45:20 | 200 |   2.84079761s |      172.19.0.3 | POST     "/api/generate"
time=2025-04-28T15:45:20.845Z level=DEBUG source=sched.go:409 msg="context for request finished"
time=2025-04-28T15:45:20.845Z level=DEBUG source=sched.go:341 msg="runner with non-zero duration has gone idle, adding timer" modelPath=/root/.ollama/models/blobs/sha256-ccc0cddac56136ef0969cf2e3e9ac051124c937be42503b47ec570dead85ff87 duration=2562047h47m16.854775807s
time=2025-04-28T15:45:20.845Z level=DEBUG source=sched.go:359 msg="after processing request finished event" modelPath=/root/.ollama/models/blobs/sha256-ccc0cddac56136ef0969cf2e3e9ac051124c937be42503b47ec570dead85ff87 refCount=0
time=2025-04-28T15:45:22.357Z level=WARN source=ggml.go:152 msg="key not found" key=general.alignment default=32
time=2025-04-28T15:45:22.361Z level=DEBUG source=sched.go:577 msg="evaluating already loaded" model=/root/.ollama/models/blobs/sha256-ccc0cddac56136ef0969cf2e3e9ac051124c937be42503b47ec570dead85ff87
time=2025-04-28T15:45:22.362Z level=DEBUG source=routes.go:297 msg="generate request" images=1 prompt="<start_of_turn>user\nYou act as a web-shop expert reaponsible to properly classify any given product. You carefully examine image of the product (if provided), product-data and categories-data. Then decide if it fits into any given category and if it does, which category is the best fit for the product. You also provide a short explanation of your choice.\nPlease return response in following JSON format:<end_of_turn>\n<start_of_turn>user\n[img-0]\n\n[text beginning] Read about the product from:[product-data start] [\\\"Product_name: Back 4 blood special day 1 edition.\\\", \\\"Description: Shooter game for ps5.\\\", \\\"Genre is Shooter.\\\", \\\"Edition is Special Day 1.\\\", \\\"Platform is PS5.\\\", \\\"Suggested_category is Shooter.\\\"] [product-data end] and decide which category product fits the best:[categories-data start][{\\\"category_name\\\":\\\"PlayStation Consoles (PS5)\\\",\\\"description\\\":\\\"This category includes PlayStation gaming consoles, accessories, and related virtual reality products.\\\",\\\"id\\\":9432},{\\\"category_name\\\":\\\"Gamepads / Controllers\\\",\\\"description\\\":\\\"Controllers and gamepads for various gaming platforms, enhancing the gaming experience.\\\",\\\"id\\\":9437},{\\\"category_name\\\":\\\"Computer Games\\\",\\\"description\\\":\\\"Video games for computers, covering a wide range of genres.\\\",\\\"id\\\":9440},{\\\"category_name\\\":\\\"PlayStation Games\\\",\\\"description\\\":\\\"Video games designed for PlayStation consoles.\\\",\\\"id\\\":9442},{\\\"category_name\\\":\\\"XBOX Games\\\",\\\"description\\\":\\\"This category contains video games designed for Xbox consoles.\\\",\\\"id\\\":9443},{\\\"category_name\\\":\\\"Nintendo Games\\\",\\\"description\\\":\\\"Video games for the Nintendo Switch console.\\\",\\\"id\\\":9444},{\\\"category_name\\\":\\\"Digital Game Codes\\\",\\\"description\\\":\\\"This category contains digital codes for activating and downloading computer games.\\\",\\\"id\\\":9446},{\\\"category_name\\\":\\\"Sports and Recreation / Sports Games and Hobby Equipment\\\",\\\"description\\\":\\\"A variety of sports equipment and accessories for active lifestyles.\\\",\\\"id\\\":9701},{\\\"category_name\\\":\\\"Game Subscriptions\\\",\\\"description\\\":\\\"Prepaid cards and subscriptions for various gaming platforms like Steam, Xbox, PlayStation, and Nintendo.\\\",\\\"id\\\":9441},{\\\"category_name\\\":\\\"PC Games\\\",\\\"description\\\":\\\"This category includes computer games designed to be played on PCs.\\\",\\\"id\\\":9445}][categories-data end]\\n if it does not fit into any given category than set category_id as 0 and describe why. \\n Please return response in proper JSON format [text end]<end_of_turn>\n<start_of_turn>model\n\n"
time=2025-04-28T15:45:22.365Z level=DEBUG source=process_text_spm.go:184 msg="adding bos token to prompt" id=2
time=2025-04-28T15:45:22.496Z level=DEBUG source=cache.go:136 msg="loading cache slot" id=0 cache=572 prompt=818 used=89 remaining=729
[GIN] 2025/04/28 - 15:45:26 | 200 |   4.41542636s |      172.19.0.3 | POST     "/api/generate"
time=2025-04-28T15:45:26.430Z level=DEBUG source=sched.go:409 msg="context for request finished"
time=2025-04-28T15:45:26.430Z level=DEBUG source=sched.go:341 msg="runner with non-zero duration has gone idle, adding timer" modelPath=/root/.ollama/models/blobs/sha256-ccc0cddac56136ef0969cf2e3e9ac051124c937be42503b47ec570dead85ff87 duration=2562047h47m16.854775807s
time=2025-04-28T15:45:26.430Z level=DEBUG source=sched.go:359 msg="after processing request finished event" modelPath=/root/.ollama/models/blobs/sha256-ccc0cddac56136ef0969cf2e3e9ac051124c937be42503b47ec570dead85ff87 refCount=0
time=2025-04-28T15:45:27.169Z level=WARN source=ggml.go:152 msg="key not found" key=general.alignment default=32
time=2025-04-28T15:45:27.173Z level=DEBUG source=sched.go:577 msg="evaluating already loaded" model=/root/.ollama/models/blobs/sha256-ccc0cddac56136ef0969cf2e3e9ac051124c937be42503b47ec570dead85ff87
time=2025-04-28T15:45:27.177Z level=DEBUG source=routes.go:297 msg="generate request" images=1 prompt="<start_of_turn>user\nYou act as a web-shop expert reaponsible to properly classify any given product. You carefully examine image of the product (if provided), product-data and categories-data. Then decide if it fits into any given category and if it does, which category is the best fit for the product. You also provide a short explanation of your choice.\nPlease return response in following JSON format:<end_of_turn>\n<start_of_turn>user\n[img-0]\n\n[text beginning] Read about the product from:[product-data start] [\\\"Product_name: Xo x26 black earbuds.\\\", \\\"Description: Earbuds xo x26 black.\\\", \\\"Type is Earbuds.\\\", \\\"Brand is XO.\\\", \\\"Color is Black.\\\", \\\"Model is X26.\\\", \\\"Suggested_category is Earbuds.\\\"] [product-data end] and decide which category product fits the best:[categories-data start][{\\\"category_name\\\":\\\"In-Ear Monitors\\\",\\\"description\\\":\\\"Professional earphones designed for musicians and audio professionals, providing high-quality, isolated sound for live performance and critical listening.\\\",\\\"id\\\":6128},{\\\"category_name\\\":\\\"Headphones \\\\u0026 Accessories\\\",\\\"description\\\":\\\"Wireless and in-ear headphones offering freedom, comfort, and high-quality sound.\\\",\\\"id\\\":6199},{\\\"category_name\\\":\\\"Sports Headphones\\\",\\\"description\\\":\\\"Headphones specifically designed for use during sports and physical activities.\\\",\\\"id\\\":6200},{\\\"category_name\\\":\\\"Headphone Cases \\\\u0026 Accessories\\\",\\\"description\\\":\\\"Protective cases and accessories for headphones, including hard and soft cases, earcup covers, and cable protectors.\\\",\\\"id\\\":6203},{\\\"category_name\\\":\\\"Headphone Earpads\\\",\\\"description\\\":\\\"Replacement earpads for headphones, available in various materials for comfort and sound quality.\\\",\\\"id\\\":6204},{\\\"category_name\\\":\\\"Earplugs\\\",\\\"description\\\":\\\"Earplugs are used to protect ears from noise and water.\\\",\\\"id\\\":8732}][categories-data end]\\n if it does not fit into any given category than set category_id as 0 and describe why. \\n Please return response in proper JSON format [text end]<end_of_turn>\n<start_of_turn>model\n\n"
time=2025-04-28T15:45:27.179Z level=DEBUG source=process_text_spm.go:184 msg="adding bos token to prompt" id=2
time=2025-04-28T15:45:27.330Z level=DEBUG source=cache.go:136 msg="loading cache slot" id=0 cache=904 prompt=734 used=91 remaining=643
[GIN] 2025/04/28 - 15:45:32 | 200 |  5.371758844s |      172.19.0.3 | POST     "/api/generate"
time=2025-04-28T15:45:32.465Z level=DEBUG source=sched.go:409 msg="context for request finished"
time=2025-04-28T15:45:32.465Z level=DEBUG source=sched.go:341 msg="runner with non-zero duration has gone idle, adding timer" modelPath=/root/.ollama/models/blobs/sha256-ccc0cddac56136ef0969cf2e3e9ac051124c937be42503b47ec570dead85ff87 duration=2562047h47m16.854775807s
time=2025-04-28T15:45:32.465Z level=DEBUG source=sched.go:359 msg="after processing request finished event" modelPath=/root/.ollama/models/blobs/sha256-ccc0cddac56136ef0969cf2e3e9ac051124c937be42503b47ec570dead85ff87 refCount=0
time=2025-04-28T15:45:33.303Z level=WARN source=ggml.go:152 msg="key not found" key=general.alignment default=32

OS

Linux, Docker

GPU

Nvidia

CPU

Intel

Ollama version

0.6.6

Originally created by @moonflash on GitHub (Apr 28, 2025). Original GitHub issue: https://github.com/ollama/ollama/issues/10434 Originally assigned to: @jessegross on GitHub. ### What is the issue? Runnning: - ollama inside Docker - Linux host - one dedicated RTX-3090 per instance - using `gemma3:27b-it-qat` model that fits on a single RTX3090 (21G/24G) at the beginning I have 21G of VRAM and less than 1G of RAM usage after an hour i have the same on VRAM but all RAM (30G) used up to 40G of used swap memory. docker-compose: ``` ollama-1: image: ollama/ollama:0.6.6 container_name: ollama-inference1 restart: unless-stopped runtime: nvidia volumes: - /usr/share/ollama/.ollama/models:/root/.ollama/models ports: - "11435:11434" environment: - OLLAMA_PORT=11434 - OLLAMA_TIMEOUT=120 - OLLAMA_LOAD_TIMEOUT=30m - CUDA_VISIBLE_DEVICES=0 - NVIDIA_DRIVER_CAPABILITIES=compute,utility,graphics - OLLAMA_DEBUG=true ``` Was using ollama 0.5.* prior to switching to 0.6.6 (other models though) and never experienced anything similar. NOTE: I'm using large num_ctx=24000 (was using it with and 0.5.* never had any memory leaks) One big difference is that previously I was not inferencing multimodal models (it was either `phi4:14b-q8_0` or llama...) `Linux ollama-1 5.10.0-28-amd64 #1 SMP Debian 5.10.209-2 (2024-01-31) x86_64 GNU/Linux` ``` free -h total used free shared buff/cache available Mem: 31Gi 30Gi 560Mi 41Mi 421Mi 500Mi Swap: 79Gi 51Gi 28Gi ``` ``` +-----------------------------------------------------------------------------------------+ | NVIDIA-SMI 560.35.03 Driver Version: 560.35.03 CUDA Version: 12.6 | |-----------------------------------------+------------------------+----------------------+ | GPU Name Persistence-M | Bus-Id Disp.A | Volatile Uncorr. ECC | | Fan Temp Perf Pwr:Usage/Cap | Memory-Usage | GPU-Util Compute M. | | | | MIG M. | |=========================================+========================+======================| | 0 NVIDIA GeForce RTX 3090 On | 00000000:02:00.0 Off | N/A | | 0% 49C P8 27W / 370W | 21754MiB / 24576MiB | 0% Default | | | | N/A | ``` ``` ollama ps NAME ID SIZE PROCESSOR UNTIL gemma3:27b-it-qat 29eb0b9aeda3 24 GB 100% GPU Forever ``` ### Relevant log output ```shell [GIN] 2025/04/28 - 15:44:23 | 200 | 3.897563719s | 172.19.0.3 | POST "/api/generate" time=2025-04-28T15:44:23.300Z level=DEBUG source=sched.go:409 msg="context for request finished" time=2025-04-28T15:44:23.301Z level=DEBUG source=sched.go:341 msg="runner with non-zero duration has gone idle, adding timer" modelPath=/root/.ollama/models/blobs/sha256-ccc0cddac56136ef0969cf2e3e9ac051124c937be42503b47ec570dead85ff87 duration=2562047h47m16.854775807s time=2025-04-28T15:44:23.301Z level=DEBUG source=sched.go:359 msg="after processing request finished event" modelPath=/root/.ollama/models/blobs/sha256-ccc0cddac56136ef0969cf2e3e9ac051124c937be42503b47ec570dead85ff87 refCount=0 time=2025-04-28T15:44:24.512Z level=WARN source=ggml.go:152 msg="key not found" key=general.alignment default=32 time=2025-04-28T15:44:24.516Z level=DEBUG source=sched.go:577 msg="evaluating already loaded" model=/root/.ollama/models/blobs/sha256-ccc0cddac56136ef0969cf2e3e9ac051124c937be42503b47ec570dead85ff87 time=2025-04-28T15:44:24.516Z level=DEBUG source=routes.go:297 msg="generate request" images=1 prompt="<start_of_turn>user\nYou act as a web-shop expert reaponsible to properly classify any given product. You carefully examine image of the product (if provided), product-data and categories-data. Then decide if it fits into any given category and if it does, which category is the best fit for the product. You also provide a short explanation of your choice.\nPlease return response in following JSON format:<end_of_turn>\n<start_of_turn>user\n[img-0]\n\n[text beginning] Read about the product from:[product-data start] [\\\"Product_name: Sharkoon tg5 pro rgb full glass atx case.\\\", \\\"Description: Gaming case with addressable rgb lighting and full glass side panel..\\\", \\\"Brand is SHARKOON.\\\", \\\"Fan_size is 120mm.\\\", \\\"Case_type is ATX Full Tower.\\\", \\\"Fan_quantity is 4.\\\", \\\"Intended_use is Gaming.\\\", \\\"Rgb_lighting is Addressable RGB.\\\", \\\"Side_panel_material is Tempered Glass.\\\", \\\"Suggested_category is PC Cases.\\\"] [product-data end] and decide which category product fits the best:[categories-data start][{\\\"category_name\\\":\\\"Computer Cases\\\",\\\"description\\\":\\\"Computer cases provide housing and support for internal components, impacting cooling, aesthetics, and overall system functionality.\\\",\\\"id\\\":9366},{\\\"category_name\\\":\\\"Gaming PC Cases\\\",\\\"description\\\":\\\"Cases specifically designed for gaming PCs, offering enhanced cooling, expandability, and aesthetics.\\\",\\\"id\\\":9367},{\\\"category_name\\\":\\\"Computer Cooling\\\",\\\"description\\\":\\\"This category includes CPU coolers and case fans for efficient computer cooling.\\\",\\\"id\\\":9379},{\\\"category_name\\\":\\\"Computer Case Accessories\\\",\\\"description\\\":\\\"Accessories for enhancing, protecting, and customizing computer cases.\\\",\\\"id\\\":9518}][categories-data end]\\n if it does not fit into any given category than set category_id as 0 and describe why. \\n Please return response in proper JSON format [text end]<end_of_turn>\n<start_of_turn>model\n\n" time=2025-04-28T15:44:24.519Z level=DEBUG source=process_text_spm.go:184 msg="adding bos token to prompt" id=2 time=2025-04-28T15:44:24.736Z level=DEBUG source=cache.go:136 msg="loading cache slot" id=0 cache=755 prompt=688 used=91 remaining=597 [GIN] 2025/04/28 - 15:44:27 | 200 | 3.294044404s | 172.19.0.3 | POST "/api/generate" time=2025-04-28T15:44:27.729Z level=DEBUG source=sched.go:409 msg="context for request finished" time=2025-04-28T15:44:27.730Z level=DEBUG source=sched.go:341 msg="runner with non-zero duration has gone idle, adding timer" modelPath=/root/.ollama/models/blobs/sha256-ccc0cddac56136ef0969cf2e3e9ac051124c937be42503b47ec570dead85ff87 duration=2562047h47m16.854775807s time=2025-04-28T15:44:27.730Z level=DEBUG source=sched.go:359 msg="after processing request finished event" modelPath=/root/.ollama/models/blobs/sha256-ccc0cddac56136ef0969cf2e3e9ac051124c937be42503b47ec570dead85ff87 refCount=0 time=2025-04-28T15:44:28.509Z level=WARN source=ggml.go:152 msg="key not found" key=general.alignment default=32 time=2025-04-28T15:44:28.514Z level=DEBUG source=sched.go:577 msg="evaluating already loaded" model=/root/.ollama/models/blobs/sha256-ccc0cddac56136ef0969cf2e3e9ac051124c937be42503b47ec570dead85ff87 time=2025-04-28T15:44:28.514Z level=DEBUG source=routes.go:297 msg="generate request" images=1 prompt="<start_of_turn>user\nYou act as a web-shop expert reaponsible to properly classify any given product. You carefully examine image of the product (if provided), product-data and categories-data. Then decide if it fits into any given category and if it does, which category is the best fit for the product. You also provide a short explanation of your choice.\nPlease return response in following JSON format:<end_of_turn>\n<start_of_turn>user\n[img-0]\n\n[text beginning] Read about the product from:[product-data start] [\\\"Product_name: Notebook aspire one.\\\", \\\"Description: Extended warranty to 3 years.\\\", \\\"Warranty_type is Extended Warranty.\\\", \\\"Warranty_period is 3 years.\\\", \\\"Suggested_category is Laptops.\\\"] [product-data end] and decide which category product fits the best:[categories-data start][{\\\"category_name\\\":\\\"Software Warranties\\\",\\\"description\\\":\\\"This category covers warranties offered with software products, detailing different types and their conditions.\\\",\\\"id\\\":9398},{\\\"category_name\\\":\\\"Laptops\\\",\\\"description\\\":\\\"Portable computers for work, education, and entertainment.\\\",\\\"id\\\":9562},{\\\"category_name\\\":\\\"Laptops for Everyday Use\\\",\\\"description\\\":\\\"Laptops designed for general everyday tasks like browsing, office work, and entertainment.\\\",\\\"id\\\":9563},{\\\"category_name\\\":\\\"Business Laptops\\\",\\\"description\\\":\\\"Business laptops are portable, reliable, and secure devices designed for professional use.\\\",\\\"id\\\":9565},{\\\"category_name\\\":\\\"School Laptops\\\",\\\"description\\\":\\\"Affordable and portable laptops ideal for students and school use.\\\",\\\"id\\\":9566},{\\\"category_name\\\":\\\"Laptop Batteries\\\",\\\"description\\\":\\\"Replacement batteries for laptops, including OEM and aftermarket options.\\\",\\\"id\\\":9582},{\\\"category_name\\\":\\\"Laptop Chargers\\\",\\\"description\\\":\\\"This category contains chargers for laptops, ensuring safe and efficient power delivery.\\\",\\\"id\\\":9583},{\\\"category_name\\\":\\\"Laptop Accessories - Cleaning and Maintenance\\\",\\\"description\\\":\\\"Products for keeping laptops clean and functioning optimally.\\\",\\\"id\\\":9586},{\\\"category_name\\\":\\\"Gaming Laptops\\\",\\\"description\\\":\\\"High-performance laptops designed specifically for gaming, offering powerful hardware and immersive experiences.\\\",\\\"id\\\":9564}][categories-data end]\\n if it does not fit into any given category than set category_id as 0 and describe why. \\n Please return response in proper JSON format [text end]<end_of_turn>\n<start_of_turn>model\n\n" time=2025-04-28T15:44:28.516Z level=DEBUG source=process_text_spm.go:184 msg="adding bos token to prompt" id=2 time=2025-04-28T15:44:28.703Z level=DEBUG source=cache.go:136 msg="loading cache slot" id=0 cache=749 prompt=782 used=91 remaining=691 [GIN] 2025/04/28 - 15:44:32 | 200 | 4.036546946s | 172.19.0.3 | POST "/api/generate" time=2025-04-28T15:44:32.460Z level=DEBUG source=sched.go:409 msg="context for request finished" time=2025-04-28T15:44:32.461Z level=DEBUG source=sched.go:341 msg="runner with non-zero duration has gone idle, adding timer" modelPath=/root/.ollama/models/blobs/sha256-ccc0cddac56136ef0969cf2e3e9ac051124c937be42503b47ec570dead85ff87 duration=2562047h47m16.854775807s time=2025-04-28T15:44:32.461Z level=DEBUG source=sched.go:359 msg="after processing request finished event" modelPath=/root/.ollama/models/blobs/sha256-ccc0cddac56136ef0969cf2e3e9ac051124c937be42503b47ec570dead85ff87 refCount=0 time=2025-04-28T15:44:33.482Z level=WARN source=ggml.go:152 msg="key not found" key=general.alignment default=32 time=2025-04-28T15:44:33.487Z level=DEBUG source=sched.go:577 msg="evaluating already loaded" model=/root/.ollama/models/blobs/sha256-ccc0cddac56136ef0969cf2e3e9ac051124c937be42503b47ec570dead85ff87 time=2025-04-28T15:44:33.488Z level=DEBUG source=routes.go:297 msg="generate request" images=1 prompt="<start_of_turn>user\nYou act as a web-shop expert reaponsible to properly classify any given product. You carefully examine image of the product (if provided), product-data and categories-data. Then decide if it fits into any given category and if it does, which category is the best fit for the product. You also provide a short explanation of your choice.\nPlease return response in following JSON format:<end_of_turn>\n<start_of_turn>user\n[img-0]\n\n[text beginning] Read about the product from:[product-data start] [\\\"Product_name: Usb-c to vga adapter.\\\", \\\"Description: Usb-c to vga adapter with support for 1920x1200 and 1080p resolutions..\\\", \\\"Output_type is VGA.\\\", \\\"Interface_type is USB-C.\\\", \\\"Output_resolution includes 1920x1200, 1080p.\\\", \\\"Suggested_category is Adapters \\u0026 Cables.\\\"] [product-data end] and decide which category product fits the best:[categories-data start][{\\\"category_name\\\":\\\"Adapters and Connectors\\\",\\\"description\\\":\\\"This category contains various adapters and connectors for audio and video equipment.\\\",\\\"id\\\":6220},{\\\"category_name\\\":\\\"Camera Cables \\\\u0026 Adapters\\\",\\\"description\\\":\\\"Cables and adapters for connecting cameras to computers, monitors, and other devices.\\\",\\\"id\\\":7105},{\\\"category_name\\\":\\\"DisplayPort Cables\\\",\\\"description\\\":\\\"DisplayPort cables transmit high-definition audio and video signals, commonly used in computers and professional displays.\\\",\\\"id\\\":9510},{\\\"category_name\\\":\\\"Computer Cables and Adapters\\\",\\\"description\\\":\\\"Essential cables and adapters for connecting and enhancing computer and multimedia devices.\\\",\\\"id\\\":9511},{\\\"category_name\\\":\\\"Laptop Accessories - Adapters and Connectors\\\",\\\"description\\\":\\\"This category contains adapters and connectors for laptops, enabling compatibility between various devices and adding functionality like Bluetooth or network access.\\\",\\\"id\\\":9584},{\\\"category_name\\\":\\\"Mobile Phone Cables and Adapters\\\",\\\"description\\\":\\\"This category includes all types of cables and adapters used for charging and data transfer with mobile phones.\\\",\\\"id\\\":10112},{\\\"category_name\\\":\\\"Mobile Phone Cables and Adapters\\\",\\\"description\\\":\\\"Adapters for charging mobile phones while traveling internationally.\\\",\\\"id\\\":10113},{\\\"category_name\\\":\\\"Mobile Phone Cables \\\\u0026 Adapters\\\",\\\"description\\\":\\\"Data cables and OTG adapters for mobile phones, used for charging, data transfer and backup.\\\",\\\"id\\\":10114},{\\\"category_name\\\":\\\"Mobile Phone Cables\\\",\\\"description\\\":\\\"This category includes charging and data transfer cables for mobile phones and other compatible devices.\\\",\\\"id\\\":10115}][categories-data end]\\n if it does not fit into any given category than set category_id as 0 and describe why. \\n Please return response in proper JSON format [text end]<end_of_turn>\n<start_of_turn>model\n\n" time=2025-04-28T15:44:33.490Z level=DEBUG source=process_text_spm.go:184 msg="adding bos token to prompt" id=2 time=2025-04-28T15:44:33.743Z level=DEBUG source=cache.go:136 msg="loading cache slot" id=0 cache=865 prompt=902 used=91 remaining=811 [GIN] 2025/04/28 - 15:44:37 | 200 | 4.159372497s | 172.19.0.3 | POST "/api/generate" time=2025-04-28T15:44:37.577Z level=DEBUG source=sched.go:409 msg="context for request finished" time=2025-04-28T15:44:37.577Z level=DEBUG source=sched.go:341 msg="runner with non-zero duration has gone idle, adding timer" modelPath=/root/.ollama/models/blobs/sha256-ccc0cddac56136ef0969cf2e3e9ac051124c937be42503b47ec570dead85ff87 duration=2562047h47m16.854775807s time=2025-04-28T15:44:37.577Z level=DEBUG source=sched.go:359 msg="after processing request finished event" modelPath=/root/.ollama/models/blobs/sha256-ccc0cddac56136ef0969cf2e3e9ac051124c937be42503b47ec570dead85ff87 refCount=0 time=2025-04-28T15:44:38.502Z level=WARN source=ggml.go:152 msg="key not found" key=general.alignment default=32 time=2025-04-28T15:44:38.508Z level=DEBUG source=sched.go:577 msg="evaluating already loaded" model=/root/.ollama/models/blobs/sha256-ccc0cddac56136ef0969cf2e3e9ac051124c937be42503b47ec570dead85ff87 time=2025-04-28T15:44:38.509Z level=DEBUG source=routes.go:297 msg="generate request" images=1 prompt="<start_of_turn>user\nYou act as a web-shop expert reaponsible to properly classify any given product. You carefully examine image of the product (if provided), product-data and categories-data. Then decide if it fits into any given category and if it does, which category is the best fit for the product. You also provide a short explanation of your choice.\nPlease return response in following JSON format:<end_of_turn>\n<start_of_turn>user\n[img-0]\n\n[text beginning] Read about the product from:[product-data start] [\\\"Product_name: Asus tuf gaming 750g power supply.\\\", \\\"Description: Asus tuf gaming 750g, 750w, 80 plus gold certified power supply..\\\", \\\"Series is TUF GAMING.\\\", \\\"Wattage is 750W.\\\", \\\"Certification is 80 Plus Gold.\\\", \\\"Power_supply_type is ATX.\\\", \\\"Suggested_category is Computer Power Supplies.\\\"] [product-data end] and decide which category product fits the best:[categories-data start][{\\\"category_name\\\":\\\"Power Cables\\\",\\\"description\\\":\\\"This category contains various power cables for connecting devices to a power source.\\\",\\\"id\\\":6227},{\\\"category_name\\\":\\\"Gaming PC Cases\\\",\\\"description\\\":\\\"Cases specifically designed for gaming PCs, offering enhanced cooling, expandability, and aesthetics.\\\",\\\"id\\\":9367},{\\\"category_name\\\":\\\"Power Supplies\\\",\\\"description\\\":\\\"Power supplies provide the necessary electrical power for a computer system to function.\\\",\\\"id\\\":9371},{\\\"category_name\\\":\\\"Uninterruptible Power Supplies (UPS)\\\",\\\"description\\\":\\\"UPS devices provide backup power to protect electronics during outages and voltage fluctuations.\\\",\\\"id\\\":9396},{\\\"category_name\\\":\\\"Computer Accessories/Miscellaneous | Power Surge Protection\\\",\\\"description\\\":\\\"This category includes devices that protect electronic equipment from power surges and voltage spikes.\\\",\\\"id\\\":9512},{\\\"category_name\\\":\\\"Computer Cleaning Supplies\\\",\\\"description\\\":\\\"Supplies for maintaining the cleanliness and optimal performance of computers.\\\",\\\"id\\\":9517},{\\\"category_name\\\":\\\"Gaming Desktops\\\",\\\"description\\\":\\\"High-performance desktop computers designed for demanding gaming experiences.\\\",\\\"id\\\":9571}][categories-data end]\\n if it does not fit into any given category than set category_id as 0 and describe why. \\n Please return response in proper JSON format [text end]<end_of_turn>\n<start_of_turn>model\n\n" time=2025-04-28T15:44:38.512Z level=DEBUG source=process_text_spm.go:184 msg="adding bos token to prompt" id=2 time=2025-04-28T15:44:38.740Z level=DEBUG source=cache.go:136 msg="loading cache slot" id=0 cache=984 prompt=774 used=91 remaining=683 [GIN] 2025/04/28 - 15:44:42 | 200 | 3.920623427s | 172.19.0.3 | POST "/api/generate" time=2025-04-28T15:44:42.265Z level=DEBUG source=sched.go:409 msg="context for request finished" time=2025-04-28T15:44:42.265Z level=DEBUG source=sched.go:341 msg="runner with non-zero duration has gone idle, adding timer" modelPath=/root/.ollama/models/blobs/sha256-ccc0cddac56136ef0969cf2e3e9ac051124c937be42503b47ec570dead85ff87 duration=2562047h47m16.854775807s time=2025-04-28T15:44:42.265Z level=DEBUG source=sched.go:359 msg="after processing request finished event" modelPath=/root/.ollama/models/blobs/sha256-ccc0cddac56136ef0969cf2e3e9ac051124c937be42503b47ec570dead85ff87 refCount=0 time=2025-04-28T15:44:42.893Z level=WARN source=ggml.go:152 msg="key not found" key=general.alignment default=32 time=2025-04-28T15:44:42.898Z level=DEBUG source=sched.go:577 msg="evaluating already loaded" model=/root/.ollama/models/blobs/sha256-ccc0cddac56136ef0969cf2e3e9ac051124c937be42503b47ec570dead85ff87 time=2025-04-28T15:44:42.899Z level=DEBUG source=routes.go:297 msg="generate request" images=1 prompt="<start_of_turn>user\nYou act as a web-shop expert reaponsible to properly classify any given product. You carefully examine image of the product (if provided), product-data and categories-data. Then decide if it fits into any given category and if it does, which category is the best fit for the product. You also provide a short explanation of your choice.\nPlease return response in following JSON format:<end_of_turn>\n<start_of_turn>user\n[img-0]\n\n[text beginning] Read about the product from:[product-data start] [\\\"Product_name: Gts 3 graphite black.\\\", \\\"Description: Smartwatch with 1.75 inch display, 1000 nits brightness, 341 ppi resolution, 5 atm water resistance, and 12 days of battery life..\\\", \\\"Brightness is 1000 nit.\\\", \\\"Battery_life is 12 days.\\\", \\\"Display_size is 1.75\\\\\\\".\\\", \\\"Pixel_density is 341 ppi.\\\", \\\"Water_resistance is 5 ATM.\\\", \\\"Suggested_category is Smartwatch.\\\"] [product-data end] and decide which category product fits the best:[categories-data start][{\\\"category_name\\\":\\\"Men's Wristwatches\\\",\\\"description\\\":\\\"A wide selection of men's wristwatches, including analog, digital, and smartwatches.\\\",\\\"id\\\":6974},{\\\"category_name\\\":\\\"Smartwatches\\\",\\\"description\\\":\\\"Smartwatches combine functionality, technology, and style for health tracking, notifications, and more.\\\",\\\"id\\\":6983},{\\\"category_name\\\":\\\"Smartwatches\\\",\\\"description\\\":\\\"Smartwatches are technologically advanced watches with smartphone-like features.\\\",\\\"id\\\":6984},{\\\"category_name\\\":\\\"Sports Watches\\\",\\\"description\\\":\\\"This category features durable and stylish sports watches for active individuals and those who appreciate the sporty look.\\\",\\\"id\\\":6987},{\\\"category_name\\\":\\\"Sports Watches with GPS\\\",\\\"description\\\":\\\"Sports watches with built-in GPS for independent route tracking and analysis.\\\",\\\"id\\\":6988},{\\\"category_name\\\":\\\"Men's Analog Watches\\\",\\\"description\\\":\\\"Classic and elegant timepieces for men, featuring traditional analog displays.\\\",\\\"id\\\":6975},{\\\"category_name\\\":\\\"Men's Digital Wristwatches\\\",\\\"description\\\":\\\"This category features men's digital wristwatches, combining style, technology, and practical features.\\\",\\\"id\\\":6976},{\\\"category_name\\\":\\\"Fitness Trackers\\\",\\\"description\\\":\\\"Fitness trackers help monitor health and activity levels, motivating users to achieve their fitness goals.\\\",\\\"id\\\":6985}][categories-data end]\\n if it does not fit into any given category than set category_id as 0 and describe why. \\n Please return response in proper JSON format [text end]<end_of_turn>\n<start_of_turn>model\n\n" time=2025-04-28T15:44:42.901Z level=DEBUG source=process_text_spm.go:184 msg="adding bos token to prompt" id=2 time=2025-04-28T15:44:42.996Z level=DEBUG source=cache.go:136 msg="loading cache slot" id=0 cache=847 prompt=855 used=91 remaining=764 [GIN] 2025/04/28 - 15:44:46 | 200 | 4.038629499s | 172.19.0.3 | POST "/api/generate" time=2025-04-28T15:44:46.881Z level=DEBUG source=sched.go:409 msg="context for request finished" time=2025-04-28T15:44:46.881Z level=DEBUG source=sched.go:341 msg="runner with non-zero duration has gone idle, adding timer" modelPath=/root/.ollama/models/blobs/sha256-ccc0cddac56136ef0969cf2e3e9ac051124c937be42503b47ec570dead85ff87 duration=2562047h47m16.854775807s time=2025-04-28T15:44:46.881Z level=DEBUG source=sched.go:359 msg="after processing request finished event" modelPath=/root/.ollama/models/blobs/sha256-ccc0cddac56136ef0969cf2e3e9ac051124c937be42503b47ec570dead85ff87 refCount=0 time=2025-04-28T15:44:48.275Z level=WARN source=ggml.go:152 msg="key not found" key=general.alignment default=32 time=2025-04-28T15:44:48.281Z level=DEBUG source=sched.go:577 msg="evaluating already loaded" model=/root/.ollama/models/blobs/sha256-ccc0cddac56136ef0969cf2e3e9ac051124c937be42503b47ec570dead85ff87 time=2025-04-28T15:44:48.282Z level=DEBUG source=routes.go:297 msg="generate request" images=1 prompt="<start_of_turn>user\nYou act as a web-shop expert reaponsible to properly classify any given product. You carefully examine image of the product (if provided), product-data and categories-data. Then decide if it fits into any given category and if it does, which category is the best fit for the product. You also provide a short explanation of your choice.\nPlease return response in following JSON format:<end_of_turn>\n<start_of_turn>user\n[img-0]\n\n[text beginning] Read about the product from:[product-data start] [\\\"Product_name: Ryzen 3 4100.\\\", \\\"Description: 4 cores, 8 threads, 3.8ghz, 4mb l3 cache, am4 socket.\\\", \\\"Suggested_category is CPU.\\\"] [product-data end] and decide which category product fits the best:[categories-data start][{\\\"category_name\\\":\\\"Processors\\\",\\\"description\\\":\\\"Processors are the central processing units that power computers, responsible for executing instructions and performing calculations.\\\",\\\"id\\\":9363},{\\\"category_name\\\":\\\"Computer Cooling\\\",\\\"description\\\":\\\"This category includes all types of cooling solutions for computer components.\\\",\\\"id\\\":9378},{\\\"category_name\\\":\\\"Computer Cooling\\\",\\\"description\\\":\\\"This category includes CPU coolers and case fans for efficient computer cooling.\\\",\\\"id\\\":9379},{\\\"category_name\\\":\\\"PC Modification\\\",\\\"description\\\":\\\"This category includes components and accessories used for customizing and enhancing the appearance and performance of personal computers.\\\",\\\"id\\\":9388},{\\\"category_name\\\":\\\"Computers\\\",\\\"description\\\":\\\"This category includes all types of computers, from standard desktops to high-end gaming rigs and specialized embedded systems.\\\",\\\"id\\\":9567},{\\\"category_name\\\":\\\"Thermal Paste\\\",\\\"description\\\":\\\"Thermal paste enhances heat transfer between computer components and their coolers.\\\",\\\"id\\\":9380},{\\\"category_name\\\":\\\"Water Cooling\\\",\\\"description\\\":\\\"Components for liquid cooling systems used to maintain optimal computer temperatures.\\\",\\\"id\\\":9381},{\\\"category_name\\\":\\\"All-in-One Computers\\\",\\\"description\\\":\\\"All-in-One computers integrate the monitor and central processing unit into a single unit, offering a space-saving and convenient computing solution.\\\",\\\"id\\\":9568},{\\\"category_name\\\":\\\"Computer Kits\\\",\\\"description\\\":\\\"Bundled sets of computer hardware and software, offering a complete computing solution.\\\",\\\"id\\\":9569},{\\\"category_name\\\":\\\"Desktop Computers (PC Computers)\\\",\\\"description\\\":\\\"Desktop computers designed for general everyday tasks and use in homes and offices.\\\",\\\"id\\\":9570},{\\\"category_name\\\":\\\"Gaming Desktops\\\",\\\"description\\\":\\\"High-performance desktop computers designed for demanding gaming experiences.\\\",\\\"id\\\":9571},{\\\"category_name\\\":\\\"Business Desktop Computers\\\",\\\"description\\\":\\\"Desktop computers designed for business use, offering a balance of performance, security, and affordability.\\\",\\\"id\\\":9572},{\\\"category_name\\\":\\\"Mini Computers - Nettops\\\",\\\"description\\\":\\\"Mini PCs, often fanless and ruggedized, designed for industrial, military, and general-purpose applications requiring small size and reliability.\\\",\\\"id\\\":9573}][categories-data end]\\n if it does not fit into any given category than set category_id as 0 and describe why. \\n Please return response in proper JSON format [text end]<end_of_turn>\n<start_of_turn>model\n\n" time=2025-04-28T15:44:48.284Z level=DEBUG source=process_text_spm.go:184 msg="adding bos token to prompt" id=2 time=2025-04-28T15:44:48.443Z level=DEBUG source=cache.go:136 msg="loading cache slot" id=0 cache=936 prompt=968 used=91 remaining=877 [GIN] 2025/04/28 - 15:44:52 | 200 | 4.294356701s | 172.19.0.3 | POST "/api/generate" time=2025-04-28T15:44:52.268Z level=DEBUG source=sched.go:409 msg="context for request finished" time=2025-04-28T15:44:52.268Z level=DEBUG source=sched.go:341 msg="runner with non-zero duration has gone idle, adding timer" modelPath=/root/.ollama/models/blobs/sha256-ccc0cddac56136ef0969cf2e3e9ac051124c937be42503b47ec570dead85ff87 duration=2562047h47m16.854775807s time=2025-04-28T15:44:52.268Z level=DEBUG source=sched.go:359 msg="after processing request finished event" modelPath=/root/.ollama/models/blobs/sha256-ccc0cddac56136ef0969cf2e3e9ac051124c937be42503b47ec570dead85ff87 refCount=0 time=2025-04-28T15:44:53.267Z level=WARN source=ggml.go:152 msg="key not found" key=general.alignment default=32 time=2025-04-28T15:44:53.270Z level=DEBUG source=sched.go:577 msg="evaluating already loaded" model=/root/.ollama/models/blobs/sha256-ccc0cddac56136ef0969cf2e3e9ac051124c937be42503b47ec570dead85ff87 time=2025-04-28T15:44:53.271Z level=DEBUG source=routes.go:297 msg="generate request" images=1 prompt="<start_of_turn>user\nYou act as a web-shop expert reaponsible to properly classify any given product. You carefully examine image of the product (if provided), product-data and categories-data. Then decide if it fits into any given category and if it does, which category is the best fit for the product. You also provide a short explanation of your choice.\nPlease return response in following JSON format:<end_of_turn>\n<start_of_turn>user\n[img-0]\n\n[text beginning] Read about the product from:[product-data start] [\\\"Product_name: Ryzen 3 3200g.\\\", \\\"Description: 4 cores, 4 threads, 3.6ghz base clock, 4mb l3 cache, 65w tdp, integrated radeon vega 8 graphics.\\\", \\\"Suggested_category is CPU.\\\"] [product-data end] and decide which category product fits the best:[categories-data start][{\\\"category_name\\\":\\\"Processors\\\",\\\"description\\\":\\\"Processors are the central processing units that power computers, responsible for executing instructions and performing calculations.\\\",\\\"id\\\":9363},{\\\"category_name\\\":\\\"Computer Cooling\\\",\\\"description\\\":\\\"This category includes all types of cooling solutions for computer components.\\\",\\\"id\\\":9378},{\\\"category_name\\\":\\\"Computer Cooling\\\",\\\"description\\\":\\\"This category includes CPU coolers and case fans for efficient computer cooling.\\\",\\\"id\\\":9379},{\\\"category_name\\\":\\\"Other Computer Components\\\",\\\"description\\\":\\\"This category includes all computer components that are not core parts like the CPU, motherboard, or RAM.\\\",\\\"id\\\":9383},{\\\"category_name\\\":\\\"PC Modification\\\",\\\"description\\\":\\\"This category includes components and accessories used for customizing and enhancing the appearance and performance of personal computers.\\\",\\\"id\\\":9388},{\\\"category_name\\\":\\\"Computers\\\",\\\"description\\\":\\\"This category includes all types of computers, from standard desktops to high-end gaming rigs and specialized embedded systems.\\\",\\\"id\\\":9567},{\\\"category_name\\\":\\\"Thermal Paste\\\",\\\"description\\\":\\\"Thermal paste enhances heat transfer between computer components and their coolers.\\\",\\\"id\\\":9380},{\\\"category_name\\\":\\\"Water Cooling\\\",\\\"description\\\":\\\"Components for liquid cooling systems used to maintain optimal computer temperatures.\\\",\\\"id\\\":9381},{\\\"category_name\\\":\\\"TV/Video Capture Cards\\\",\\\"description\\\":\\\"These cards allow computers to receive and process TV signals, enabling TV viewing and video capture.\\\",\\\"id\\\":9384},{\\\"category_name\\\":\\\"Cables and Connectors\\\",\\\"description\\\":\\\"This category includes cables and adapters necessary for connecting computer components and peripherals.\\\",\\\"id\\\":9385},{\\\"category_name\\\":\\\"Expansion Cards\\\",\\\"description\\\":\\\"Expansion cards add functionality to a computer by plugging into expansion slots on the motherboard.\\\",\\\"id\\\":9386},{\\\"category_name\\\":\\\"External Sound Cards\\\",\\\"description\\\":\\\"External sound cards provide enhanced audio quality and connectivity for computers and other devices.\\\",\\\"id\\\":9387},{\\\"category_name\\\":\\\"Drive Holders and Adapters\\\",\\\"description\\\":\\\"These adapters help efficiently manage free space inside a computer case while expanding its data storage.\\\",\\\"id\\\":9389},{\\\"category_name\\\":\\\"PC Lighting\\\",\\\"description\\\":\\\"Components and peripherals that add customizable lighting effects to a PC.\\\",\\\"id\\\":9390},{\\\"category_name\\\":\\\"All-in-One Computers\\\",\\\"description\\\":\\\"All-in-One computers integrate the monitor and central processing unit into a single unit, offering a space-saving and convenient computing solution.\\\",\\\"id\\\":9568},{\\\"category_name\\\":\\\"Computer Kits\\\",\\\"description\\\":\\\"Bundled sets of computer hardware and software, offering a complete computing solution.\\\",\\\"id\\\":9569},{\\\"category_name\\\":\\\"Desktop Computers (PC Computers)\\\",\\\"description\\\":\\\"Desktop computers designed for general everyday tasks and use in homes and offices.\\\",\\\"id\\\":9570},{\\\"category_name\\\":\\\"Gaming Desktops\\\",\\\"description\\\":\\\"High-performance desktop computers designed for demanding gaming experiences.\\\",\\\"id\\\":9571},{\\\"category_name\\\":\\\"Business Desktop Computers\\\",\\\"description\\\":\\\"Desktop computers designed for business use, offering a balance of performance, security, and affordability.\\\",\\\"id\\\":9572},{\\\"category_name\\\":\\\"Mini Computers - Nettops\\\",\\\"description\\\":\\\"Mini PCs, often fanless and ruggedized, designed for industrial, military, and general-purpose applications requiring small size and reliability.\\\",\\\"id\\\":9573}][categories-data end]\\n if it does not fit into any given category than set category_id as 0 and describe why. \\n Please return response in proper JSON format [text end]<end_of_turn>\n<start_of_turn>model\n\n" time=2025-04-28T15:44:53.273Z level=DEBUG source=process_text_spm.go:184 msg="adding bos token to prompt" id=2 time=2025-04-28T15:44:53.438Z level=DEBUG source=cache.go:136 msg="loading cache slot" id=0 cache=1044 prompt=1238 used=0 remaining=1238 [GIN] 2025/04/28 - 15:44:57 | 200 | 4.180067608s | 172.19.0.3 | POST "/api/generate" time=2025-04-28T15:44:57.347Z level=DEBUG source=sched.go:409 msg="context for request finished" time=2025-04-28T15:44:57.347Z level=DEBUG source=sched.go:341 msg="runner with non-zero duration has gone idle, adding timer" modelPath=/root/.ollama/models/blobs/sha256-ccc0cddac56136ef0969cf2e3e9ac051124c937be42503b47ec570dead85ff87 duration=2562047h47m16.854775807s time=2025-04-28T15:44:57.347Z level=DEBUG source=sched.go:359 msg="after processing request finished event" modelPath=/root/.ollama/models/blobs/sha256-ccc0cddac56136ef0969cf2e3e9ac051124c937be42503b47ec570dead85ff87 refCount=0 time=2025-04-28T15:44:58.361Z level=WARN source=ggml.go:152 msg="key not found" key=general.alignment default=32 time=2025-04-28T15:44:58.364Z level=DEBUG source=sched.go:577 msg="evaluating already loaded" model=/root/.ollama/models/blobs/sha256-ccc0cddac56136ef0969cf2e3e9ac051124c937be42503b47ec570dead85ff87 time=2025-04-28T15:44:58.364Z level=DEBUG source=routes.go:297 msg="generate request" images=1 prompt="<start_of_turn>user\nYou act as a web-shop expert reaponsible to properly classify any given product. You carefully examine image of the product (if provided), product-data and categories-data. Then decide if it fits into any given category and if it does, which category is the best fit for the product. You also provide a short explanation of your choice.\nPlease return response in following JSON format:<end_of_turn>\n<start_of_turn>user\n[img-0]\n\n[text beginning] Read about the product from:[product-data start] [\\\"Product_name: Gembird virtus plus sound card.\\\", \\\"Description: Usb 2.0 sound card.\\\", \\\"Type is Sound Card.\\\", \\\"Brand is GEMBIRD.\\\", \\\"Model is Virtus Plus.\\\", \\\"Interface is USB 2.0.\\\", \\\"Suggested_category is Sound Cards.\\\"] [product-data end] and decide which category product fits the best:[categories-data start][{\\\"category_name\\\":\\\"Memory Cards and Readers\\\",\\\"description\\\":\\\"This category includes various memory cards and card readers for different devices.\\\",\\\"id\\\":7115},{\\\"category_name\\\":\\\"Memory Cards and Readers\\\",\\\"description\\\":\\\"This category includes various types of memory cards and card readers for storing and transferring digital data.\\\",\\\"id\\\":7116},{\\\"category_name\\\":\\\"Graphics Cards\\\",\\\"description\\\":\\\"Graphics cards process and display images, videos, and graphics on a computer monitor.\\\",\\\"id\\\":9364},{\\\"category_name\\\":\\\"Sound Cards\\\",\\\"description\\\":\\\"Sound cards enhance audio input and output capabilities of a computer system.\\\",\\\"id\\\":9372},{\\\"category_name\\\":\\\"TV/Video Capture Cards\\\",\\\"description\\\":\\\"These cards allow computers to receive and process TV signals, enabling TV viewing and video capture.\\\",\\\"id\\\":9384},{\\\"category_name\\\":\\\"External Sound Cards\\\",\\\"description\\\":\\\"External sound cards provide enhanced audio quality and connectivity for computers and other devices.\\\",\\\"id\\\":9387}][categories-data end]\\n if it does not fit into any given category than set category_id as 0 and describe why. \\n Please return response in proper JSON format [text end]<end_of_turn>\n<start_of_turn>model\n\n" time=2025-04-28T15:44:58.366Z level=DEBUG source=process_text_spm.go:184 msg="adding bos token to prompt" id=2 time=2025-04-28T15:44:58.477Z level=DEBUG source=cache.go:136 msg="loading cache slot" id=0 cache=1311 prompt=717 used=0 remaining=717 [GIN] 2025/04/28 - 15:45:02 | 200 | 3.888141147s | 172.19.0.3 | POST "/api/generate" time=2025-04-28T15:45:02.163Z level=DEBUG source=sched.go:409 msg="context for request finished" time=2025-04-28T15:45:02.163Z level=DEBUG source=sched.go:341 msg="runner with non-zero duration has gone idle, adding timer" modelPath=/root/.ollama/models/blobs/sha256-ccc0cddac56136ef0969cf2e3e9ac051124c937be42503b47ec570dead85ff87 duration=2562047h47m16.854775807s time=2025-04-28T15:45:02.163Z level=DEBUG source=sched.go:359 msg="after processing request finished event" modelPath=/root/.ollama/models/blobs/sha256-ccc0cddac56136ef0969cf2e3e9ac051124c937be42503b47ec570dead85ff87 refCount=0 time=2025-04-28T15:45:02.893Z level=WARN source=ggml.go:152 msg="key not found" key=general.alignment default=32 time=2025-04-28T15:45:02.898Z level=DEBUG source=sched.go:577 msg="evaluating already loaded" model=/root/.ollama/models/blobs/sha256-ccc0cddac56136ef0969cf2e3e9ac051124c937be42503b47ec570dead85ff87 time=2025-04-28T15:45:02.898Z level=DEBUG source=routes.go:297 msg="generate request" images=1 prompt="<start_of_turn>user\nYou act as a web-shop expert reaponsible to properly classify any given product. You carefully examine image of the product (if provided), product-data and categories-data. Then decide if it fits into any given category and if it does, which category is the best fit for the product. You also provide a short explanation of your choice.\nPlease return response in following JSON format:<end_of_turn>\n<start_of_turn>user\n[img-0]\n\n[text beginning] Read about the product from:[product-data start] [\\\"Product_name: Smart-ups 2200va/1980w.\\\", \\\"Description: Smart-ups 2200va/1980w.\\\", \\\"Wattage is 1980 W.\\\", \\\"Va_rating is 2200 VA.\\\", \\\"Form_factor is Rackmount.\\\", \\\"Product_type is Rack Mount UPS.\\\", \\\"Suggested_category is UPS.\\\"] [product-data end] and decide which category product fits the best:[categories-data start][{\\\"category_name\\\":\\\"Power Cables\\\",\\\"description\\\":\\\"This category contains various power cables for connecting devices to a power source.\\\",\\\"id\\\":6227},{\\\"category_name\\\":\\\"Car Upholstery\\\",\\\"description\\\":\\\"Materials for durable and aesthetically pleasing car interior upholstery.\\\",\\\"id\\\":6261},{\\\"category_name\\\":\\\"Forklifts and Carts\\\",\\\"description\\\":\\\"Forklifts and carts for material handling in various industries and construction.\\\",\\\"id\\\":9090},{\\\"category_name\\\":\\\"Uninterruptible Power Supplies (UPS)\\\",\\\"description\\\":\\\"UPS devices provide backup power to protect electronics during outages and voltage fluctuations.\\\",\\\"id\\\":9396},{\\\"category_name\\\":\\\"Smart Plugs (Powerline)\\\",\\\"description\\\":\\\"Smart plugs allow remote control and monitoring of electrical appliances for convenience and energy savings.\\\",\\\"id\\\":9506},{\\\"category_name\\\":\\\"Computer Accessories/Miscellaneous | Power Surge Protection\\\",\\\"description\\\":\\\"This category includes devices that protect electronic equipment from power surges and voltage spikes.\\\",\\\"id\\\":9512},{\\\"category_name\\\":\\\"SUP Bags and Transport\\\",\\\"description\\\":\\\"Bags and systems for transporting and storing Stand-Up Paddleboards (SUPs) and accessories.\\\",\\\"id\\\":9734}][categories-data end]\\n if it does not fit into any given category than set category_id as 0 and describe why. \\n Please return response in proper JSON format [text end]<end_of_turn>\n<start_of_turn>model\n\n" time=2025-04-28T15:45:02.900Z level=DEBUG source=process_text_spm.go:184 msg="adding bos token to prompt" id=2 time=2025-04-28T15:45:03.096Z level=DEBUG source=cache.go:136 msg="loading cache slot" id=0 cache=797 prompt=787 used=91 remaining=696 [GIN] 2025/04/28 - 15:45:07 | 200 | 4.232392469s | 172.19.0.3 | POST "/api/generate" time=2025-04-28T15:45:07.010Z level=DEBUG source=sched.go:409 msg="context for request finished" time=2025-04-28T15:45:07.010Z level=DEBUG source=sched.go:341 msg="runner with non-zero duration has gone idle, adding timer" modelPath=/root/.ollama/models/blobs/sha256-ccc0cddac56136ef0969cf2e3e9ac051124c937be42503b47ec570dead85ff87 duration=2562047h47m16.854775807s time=2025-04-28T15:45:07.010Z level=DEBUG source=sched.go:359 msg="after processing request finished event" modelPath=/root/.ollama/models/blobs/sha256-ccc0cddac56136ef0969cf2e3e9ac051124c937be42503b47ec570dead85ff87 refCount=0 time=2025-04-28T15:45:07.917Z level=WARN source=ggml.go:152 msg="key not found" key=general.alignment default=32 time=2025-04-28T15:45:07.922Z level=DEBUG source=sched.go:577 msg="evaluating already loaded" model=/root/.ollama/models/blobs/sha256-ccc0cddac56136ef0969cf2e3e9ac051124c937be42503b47ec570dead85ff87 time=2025-04-28T15:45:07.922Z level=DEBUG source=routes.go:297 msg="generate request" images=1 prompt="<start_of_turn>user\nYou act as a web-shop expert reaponsible to properly classify any given product. You carefully examine image of the product (if provided), product-data and categories-data. Then decide if it fits into any given category and if it does, which category is the best fit for the product. You also provide a short explanation of your choice.\nPlease return response in following JSON format:<end_of_turn>\n<start_of_turn>user\n[img-0]\n\n[text beginning] Read about the product from:[product-data start] [\\\"Product_name: Macbook air 15.3 2023 mqkw3ll/a.\\\", \\\"Description: Macbook air 15.3 2023 m2 8gb 256gb midnight.\\\", \\\"Ram is 8GB.\\\", \\\"Year is 2023.\\\", \\\"Color is Midnight.\\\", \\\"Model is MQKW3LL/A.\\\", \\\"Storage is 256GB.\\\", \\\"Processor is M2.\\\", \\\"Screen_size is 15.3 inches.\\\", \\\"Product_type is MacBook Air.\\\", \\\"Suggested_category is Laptops.\\\"] [product-data end] and decide which category product fits the best:[categories-data start][{\\\"category_name\\\":\\\"Laptops\\\",\\\"description\\\":\\\"Portable computers for work, education, and entertainment.\\\",\\\"id\\\":9562},{\\\"category_name\\\":\\\"Laptops for Everyday Use\\\",\\\"description\\\":\\\"Laptops designed for general everyday tasks like browsing, office work, and entertainment.\\\",\\\"id\\\":9563},{\\\"category_name\\\":\\\"Gaming Laptops\\\",\\\"description\\\":\\\"High-performance laptops designed specifically for gaming, offering powerful hardware and immersive experiences.\\\",\\\"id\\\":9564},{\\\"category_name\\\":\\\"Business Laptops\\\",\\\"description\\\":\\\"Business laptops are portable, reliable, and secure devices designed for professional use.\\\",\\\"id\\\":9565},{\\\"category_name\\\":\\\"School Laptops\\\",\\\"description\\\":\\\"Affordable and portable laptops ideal for students and school use.\\\",\\\"id\\\":9566},{\\\"category_name\\\":\\\"Computers\\\",\\\"description\\\":\\\"This category includes all types of computers, from standard desktops to high-end gaming rigs and specialized embedded systems.\\\",\\\"id\\\":9567},{\\\"category_name\\\":\\\"Laptop Chargers\\\",\\\"description\\\":\\\"This category contains chargers for laptops, ensuring safe and efficient power delivery.\\\",\\\"id\\\":9583},{\\\"category_name\\\":\\\"Laptop Accessories - Cleaning and Maintenance\\\",\\\"description\\\":\\\"Products for keeping laptops clean and functioning optimally.\\\",\\\"id\\\":9586},{\\\"category_name\\\":\\\"All-in-One Computers\\\",\\\"description\\\":\\\"All-in-One computers integrate the monitor and central processing unit into a single unit, offering a space-saving and convenient computing solution.\\\",\\\"id\\\":9568},{\\\"category_name\\\":\\\"Computer Kits\\\",\\\"description\\\":\\\"Bundled sets of computer hardware and software, offering a complete computing solution.\\\",\\\"id\\\":9569},{\\\"category_name\\\":\\\"Desktop Computers (PC Computers)\\\",\\\"description\\\":\\\"Desktop computers designed for general everyday tasks and use in homes and offices.\\\",\\\"id\\\":9570},{\\\"category_name\\\":\\\"Gaming Desktops\\\",\\\"description\\\":\\\"High-performance desktop computers designed for demanding gaming experiences.\\\",\\\"id\\\":9571},{\\\"category_name\\\":\\\"Business Desktop Computers\\\",\\\"description\\\":\\\"Desktop computers designed for business use, offering a balance of performance, security, and affordability.\\\",\\\"id\\\":9572},{\\\"category_name\\\":\\\"Mini Computers - Nettops\\\",\\\"description\\\":\\\"Mini PCs, often fanless and ruggedized, designed for industrial, military, and general-purpose applications requiring small size and reliability.\\\",\\\"id\\\":9573}][categories-data end]\\n if it does not fit into any given category than set category_id as 0 and describe why. \\n Please return response in proper JSON format [text end]<end_of_turn>\n<start_of_turn>model\n\n" time=2025-04-28T15:45:07.924Z level=DEBUG source=process_text_spm.go:184 msg="adding bos token to prompt" id=2 time=2025-04-28T15:45:08.110Z level=DEBUG source=cache.go:136 msg="loading cache slot" id=0 cache=871 prompt=1085 used=91 remaining=994 [GIN] 2025/04/28 - 15:45:12 | 200 | 4.661316982s | 172.19.0.3 | POST "/api/generate" time=2025-04-28T15:45:12.486Z level=DEBUG source=sched.go:409 msg="context for request finished" time=2025-04-28T15:45:12.486Z level=DEBUG source=sched.go:341 msg="runner with non-zero duration has gone idle, adding timer" modelPath=/root/.ollama/models/blobs/sha256-ccc0cddac56136ef0969cf2e3e9ac051124c937be42503b47ec570dead85ff87 duration=2562047h47m16.854775807s time=2025-04-28T15:45:12.486Z level=DEBUG source=sched.go:359 msg="after processing request finished event" modelPath=/root/.ollama/models/blobs/sha256-ccc0cddac56136ef0969cf2e3e9ac051124c937be42503b47ec570dead85ff87 refCount=0 time=2025-04-28T15:45:13.208Z level=WARN source=ggml.go:152 msg="key not found" key=general.alignment default=32 time=2025-04-28T15:45:13.212Z level=DEBUG source=sched.go:577 msg="evaluating already loaded" model=/root/.ollama/models/blobs/sha256-ccc0cddac56136ef0969cf2e3e9ac051124c937be42503b47ec570dead85ff87 time=2025-04-28T15:45:13.213Z level=DEBUG source=routes.go:297 msg="generate request" images=1 prompt="<start_of_turn>user\nYou act as a web-shop expert reaponsible to properly classify any given product. You carefully examine image of the product (if provided), product-data and categories-data. Then decide if it fits into any given category and if it does, which category is the best fit for the product. You also provide a short explanation of your choice.\nPlease return response in following JSON format:<end_of_turn>\n<start_of_turn>user\n[img-0]\n\n[text beginning] Read about the product from:[product-data start] [\\\"Product_name: Iphone 14 128gb purple.\\\", \\\"Description: Iphone 14 with 128gb storage and purple color..\\\", \\\"Color is Purple.\\\", \\\"Model is iPhone 14.\\\", \\\"Display_size is 6.1\\\\\\\".\\\", \\\"Storage_capacity is 128 GB.\\\", \\\"Display_technology is Super Retina XDR OLED.\\\", \\\"Suggested_category is Smartphones.\\\"] [product-data end] and decide which category product fits the best:[categories-data start][{\\\"category_name\\\":\\\"Smartwatches\\\",\\\"description\\\":\\\"Smartwatches combine functionality, technology, and style for health tracking, notifications, and more.\\\",\\\"id\\\":6983},{\\\"category_name\\\":\\\"Smartwatches\\\",\\\"description\\\":\\\"Smartwatches are technologically advanced watches with smartphone-like features.\\\",\\\"id\\\":6984},{\\\"category_name\\\":\\\"Mobile Phones\\\",\\\"description\\\":\\\"This category contains a wide selection of mobile phones and related accessories.\\\",\\\"id\\\":10087},{\\\"category_name\\\":\\\"iPhones\\\",\\\"description\\\":\\\"This category contains Apple iPhones, known for their innovation, performance, and user experience.\\\",\\\"id\\\":10088},{\\\"category_name\\\":\\\"Mobile Phone Screens\\\",\\\"description\\\":\\\"Find replacement screens and repair kits for your smartphone.\\\",\\\"id\\\":10098},{\\\"category_name\\\":\\\"Phone Cases, Covers \\\\u0026 Pouches\\\",\\\"description\\\":\\\"Protective and decorative covers for mobile phones, including cases, pouches, and flip covers.\\\",\\\"id\\\":10116},{\\\"category_name\\\":\\\"Phone Cases, Covers \\\\u0026 Sleeves\\\",\\\"description\\\":\\\"This category includes protective cases, covers, and sleeves for mobile phones.\\\",\\\"id\\\":10117},{\\\"category_name\\\":\\\"Mobile Phone Cases, Pouches \\\\u0026 Bags\\\",\\\"description\\\":\\\"This category includes protective and stylish cases, pouches, and bags for mobile phones, particularly geared towards women's fashion.\\\",\\\"id\\\":10119},{\\\"category_name\\\":\\\"Fitness Trackers\\\",\\\"description\\\":\\\"Fitness trackers help monitor health and activity levels, motivating users to achieve their fitness goals.\\\",\\\"id\\\":6985},{\\\"category_name\\\":\\\"Samsung Galaxy Smartphones\\\",\\\"description\\\":\\\"This category includes Samsung Galaxy smartphones known for their innovative features, high performance, and advanced camera technology.\\\",\\\"id\\\":10089},{\\\"category_name\\\":\\\"Xiaomi Mi Smartphones\\\",\\\"description\\\":\\\"Xiaomi Mi smartphones offer premium features and performance at competitive prices.\\\",\\\"id\\\":10090},{\\\"category_name\\\":\\\"Xiaomi Redmi Smartphones\\\",\\\"description\\\":\\\"Xiaomi Redmi smartphones offer a balance of innovation, performance, and affordability.\\\",\\\"id\\\":10091},{\\\"category_name\\\":\\\"OnePlus Nord Smartphones\\\",\\\"description\\\":\\\"OnePlus Nord smartphones offer high-end features and performance at a more affordable price point.\\\",\\\"id\\\":10092},{\\\"category_name\\\":\\\"Mobile Phone Cases\\\",\\\"description\\\":\\\"Protective cases, including flip and book-style covers, for mobile phones.\\\",\\\"id\\\":10118},{\\\"category_name\\\":\\\"Running Phone Holders\\\",\\\"description\\\":\\\"Holders and straps designed to securely carry a phone while running.\\\",\\\"id\\\":10120}][categories-data end]\\n if it does not fit into any given category than set category_id as 0 and describe why. \\n Please return response in proper JSON format [text end]<end_of_turn>\n<start_of_turn>model\n\n" time=2025-04-28T15:45:13.214Z level=DEBUG source=process_text_spm.go:184 msg="adding bos token to prompt" id=2 time=2025-04-28T15:45:13.388Z level=DEBUG source=cache.go:136 msg="loading cache slot" id=0 cache=1175 prompt=1100 used=0 remaining=1100 [GIN] 2025/04/28 - 15:45:17 | 200 | 4.227742024s | 172.19.0.3 | POST "/api/generate" time=2025-04-28T15:45:17.281Z level=DEBUG source=sched.go:409 msg="context for request finished" time=2025-04-28T15:45:17.281Z level=DEBUG source=sched.go:341 msg="runner with non-zero duration has gone idle, adding timer" modelPath=/root/.ollama/models/blobs/sha256-ccc0cddac56136ef0969cf2e3e9ac051124c937be42503b47ec570dead85ff87 duration=2562047h47m16.854775807s time=2025-04-28T15:45:17.281Z level=DEBUG source=sched.go:359 msg="after processing request finished event" modelPath=/root/.ollama/models/blobs/sha256-ccc0cddac56136ef0969cf2e3e9ac051124c937be42503b47ec570dead85ff87 refCount=0 time=2025-04-28T15:45:18.080Z level=WARN source=ggml.go:152 msg="key not found" key=general.alignment default=32 time=2025-04-28T15:45:18.094Z level=DEBUG source=sched.go:577 msg="evaluating already loaded" model=/root/.ollama/models/blobs/sha256-ccc0cddac56136ef0969cf2e3e9ac051124c937be42503b47ec570dead85ff87 time=2025-04-28T15:45:18.095Z level=DEBUG source=routes.go:297 msg="generate request" images=0 prompt="<start_of_turn>user\nYou act as a web-shop expert reaponsible to properly classify any given product. You carefully examine image of the product (if provided), product-data and categories-data. Then decide if it fits into any given category and if it does, which category is the best fit for the product. You also provide a short explanation of your choice.\nPlease return response in following JSON format:<end_of_turn>\n<start_of_turn>user\n[text beginning] Read about the product from:[product-data start] [\\\"Product_name: Asus tuf gaming 850w 80+ gold power supply.\\\", \\\"Description: 850w power supply with 80+ gold certification and full modular cabling..\\\", \\\"Wattage is 850W.\\\", \\\"Modularity is Full Modular.\\\", \\\"Certification is 80+ Gold.\\\", \\\"8pin_connector_count is 3.\\\", \\\"Sata_connector_count is 5.\\\", \\\"16pin_connector_count is 1.\\\", \\\"Suggested_category is PC Power Supplies.\\\"] [product-data end] and decide which category product fits the best:[categories-data start][{\\\"category_name\\\":\\\"Power Cables\\\",\\\"description\\\":\\\"This category contains various power cables for connecting devices to a power source.\\\",\\\"id\\\":6227},{\\\"category_name\\\":\\\"Gaming PC Cases\\\",\\\"description\\\":\\\"Cases specifically designed for gaming PCs, offering enhanced cooling, expandability, and aesthetics.\\\",\\\"id\\\":9367},{\\\"category_name\\\":\\\"Power Supplies\\\",\\\"description\\\":\\\"Power supplies provide the necessary electrical power for a computer system to function.\\\",\\\"id\\\":9371},{\\\"category_name\\\":\\\"Computer Cooling\\\",\\\"description\\\":\\\"This category includes CPU coolers and case fans for efficient computer cooling.\\\",\\\"id\\\":9379},{\\\"category_name\\\":\\\"Cables and Connectors\\\",\\\"description\\\":\\\"This category includes cables and adapters necessary for connecting computer components and peripherals.\\\",\\\"id\\\":9385},{\\\"category_name\\\":\\\"Uninterruptible Power Supplies (UPS)\\\",\\\"description\\\":\\\"UPS devices provide backup power to protect electronics during outages and voltage fluctuations.\\\",\\\"id\\\":9396}][categories-data end]\\n if it does not fit into any given category than set category_id as 0 and describe why. \\n Please return response in proper JSON format [text end]<end_of_turn>\n<start_of_turn>model\n\n" time=2025-04-28T15:45:18.100Z level=DEBUG source=process_text_spm.go:184 msg="adding bos token to prompt" id=2 time=2025-04-28T15:45:18.101Z level=DEBUG source=cache.go:136 msg="loading cache slot" id=0 cache=1178 prompt=503 used=0 remaining=503 [GIN] 2025/04/28 - 15:45:20 | 200 | 2.84079761s | 172.19.0.3 | POST "/api/generate" time=2025-04-28T15:45:20.845Z level=DEBUG source=sched.go:409 msg="context for request finished" time=2025-04-28T15:45:20.845Z level=DEBUG source=sched.go:341 msg="runner with non-zero duration has gone idle, adding timer" modelPath=/root/.ollama/models/blobs/sha256-ccc0cddac56136ef0969cf2e3e9ac051124c937be42503b47ec570dead85ff87 duration=2562047h47m16.854775807s time=2025-04-28T15:45:20.845Z level=DEBUG source=sched.go:359 msg="after processing request finished event" modelPath=/root/.ollama/models/blobs/sha256-ccc0cddac56136ef0969cf2e3e9ac051124c937be42503b47ec570dead85ff87 refCount=0 time=2025-04-28T15:45:22.357Z level=WARN source=ggml.go:152 msg="key not found" key=general.alignment default=32 time=2025-04-28T15:45:22.361Z level=DEBUG source=sched.go:577 msg="evaluating already loaded" model=/root/.ollama/models/blobs/sha256-ccc0cddac56136ef0969cf2e3e9ac051124c937be42503b47ec570dead85ff87 time=2025-04-28T15:45:22.362Z level=DEBUG source=routes.go:297 msg="generate request" images=1 prompt="<start_of_turn>user\nYou act as a web-shop expert reaponsible to properly classify any given product. You carefully examine image of the product (if provided), product-data and categories-data. Then decide if it fits into any given category and if it does, which category is the best fit for the product. You also provide a short explanation of your choice.\nPlease return response in following JSON format:<end_of_turn>\n<start_of_turn>user\n[img-0]\n\n[text beginning] Read about the product from:[product-data start] [\\\"Product_name: Back 4 blood special day 1 edition.\\\", \\\"Description: Shooter game for ps5.\\\", \\\"Genre is Shooter.\\\", \\\"Edition is Special Day 1.\\\", \\\"Platform is PS5.\\\", \\\"Suggested_category is Shooter.\\\"] [product-data end] and decide which category product fits the best:[categories-data start][{\\\"category_name\\\":\\\"PlayStation Consoles (PS5)\\\",\\\"description\\\":\\\"This category includes PlayStation gaming consoles, accessories, and related virtual reality products.\\\",\\\"id\\\":9432},{\\\"category_name\\\":\\\"Gamepads / Controllers\\\",\\\"description\\\":\\\"Controllers and gamepads for various gaming platforms, enhancing the gaming experience.\\\",\\\"id\\\":9437},{\\\"category_name\\\":\\\"Computer Games\\\",\\\"description\\\":\\\"Video games for computers, covering a wide range of genres.\\\",\\\"id\\\":9440},{\\\"category_name\\\":\\\"PlayStation Games\\\",\\\"description\\\":\\\"Video games designed for PlayStation consoles.\\\",\\\"id\\\":9442},{\\\"category_name\\\":\\\"XBOX Games\\\",\\\"description\\\":\\\"This category contains video games designed for Xbox consoles.\\\",\\\"id\\\":9443},{\\\"category_name\\\":\\\"Nintendo Games\\\",\\\"description\\\":\\\"Video games for the Nintendo Switch console.\\\",\\\"id\\\":9444},{\\\"category_name\\\":\\\"Digital Game Codes\\\",\\\"description\\\":\\\"This category contains digital codes for activating and downloading computer games.\\\",\\\"id\\\":9446},{\\\"category_name\\\":\\\"Sports and Recreation / Sports Games and Hobby Equipment\\\",\\\"description\\\":\\\"A variety of sports equipment and accessories for active lifestyles.\\\",\\\"id\\\":9701},{\\\"category_name\\\":\\\"Game Subscriptions\\\",\\\"description\\\":\\\"Prepaid cards and subscriptions for various gaming platforms like Steam, Xbox, PlayStation, and Nintendo.\\\",\\\"id\\\":9441},{\\\"category_name\\\":\\\"PC Games\\\",\\\"description\\\":\\\"This category includes computer games designed to be played on PCs.\\\",\\\"id\\\":9445}][categories-data end]\\n if it does not fit into any given category than set category_id as 0 and describe why. \\n Please return response in proper JSON format [text end]<end_of_turn>\n<start_of_turn>model\n\n" time=2025-04-28T15:45:22.365Z level=DEBUG source=process_text_spm.go:184 msg="adding bos token to prompt" id=2 time=2025-04-28T15:45:22.496Z level=DEBUG source=cache.go:136 msg="loading cache slot" id=0 cache=572 prompt=818 used=89 remaining=729 [GIN] 2025/04/28 - 15:45:26 | 200 | 4.41542636s | 172.19.0.3 | POST "/api/generate" time=2025-04-28T15:45:26.430Z level=DEBUG source=sched.go:409 msg="context for request finished" time=2025-04-28T15:45:26.430Z level=DEBUG source=sched.go:341 msg="runner with non-zero duration has gone idle, adding timer" modelPath=/root/.ollama/models/blobs/sha256-ccc0cddac56136ef0969cf2e3e9ac051124c937be42503b47ec570dead85ff87 duration=2562047h47m16.854775807s time=2025-04-28T15:45:26.430Z level=DEBUG source=sched.go:359 msg="after processing request finished event" modelPath=/root/.ollama/models/blobs/sha256-ccc0cddac56136ef0969cf2e3e9ac051124c937be42503b47ec570dead85ff87 refCount=0 time=2025-04-28T15:45:27.169Z level=WARN source=ggml.go:152 msg="key not found" key=general.alignment default=32 time=2025-04-28T15:45:27.173Z level=DEBUG source=sched.go:577 msg="evaluating already loaded" model=/root/.ollama/models/blobs/sha256-ccc0cddac56136ef0969cf2e3e9ac051124c937be42503b47ec570dead85ff87 time=2025-04-28T15:45:27.177Z level=DEBUG source=routes.go:297 msg="generate request" images=1 prompt="<start_of_turn>user\nYou act as a web-shop expert reaponsible to properly classify any given product. You carefully examine image of the product (if provided), product-data and categories-data. Then decide if it fits into any given category and if it does, which category is the best fit for the product. You also provide a short explanation of your choice.\nPlease return response in following JSON format:<end_of_turn>\n<start_of_turn>user\n[img-0]\n\n[text beginning] Read about the product from:[product-data start] [\\\"Product_name: Xo x26 black earbuds.\\\", \\\"Description: Earbuds xo x26 black.\\\", \\\"Type is Earbuds.\\\", \\\"Brand is XO.\\\", \\\"Color is Black.\\\", \\\"Model is X26.\\\", \\\"Suggested_category is Earbuds.\\\"] [product-data end] and decide which category product fits the best:[categories-data start][{\\\"category_name\\\":\\\"In-Ear Monitors\\\",\\\"description\\\":\\\"Professional earphones designed for musicians and audio professionals, providing high-quality, isolated sound for live performance and critical listening.\\\",\\\"id\\\":6128},{\\\"category_name\\\":\\\"Headphones \\\\u0026 Accessories\\\",\\\"description\\\":\\\"Wireless and in-ear headphones offering freedom, comfort, and high-quality sound.\\\",\\\"id\\\":6199},{\\\"category_name\\\":\\\"Sports Headphones\\\",\\\"description\\\":\\\"Headphones specifically designed for use during sports and physical activities.\\\",\\\"id\\\":6200},{\\\"category_name\\\":\\\"Headphone Cases \\\\u0026 Accessories\\\",\\\"description\\\":\\\"Protective cases and accessories for headphones, including hard and soft cases, earcup covers, and cable protectors.\\\",\\\"id\\\":6203},{\\\"category_name\\\":\\\"Headphone Earpads\\\",\\\"description\\\":\\\"Replacement earpads for headphones, available in various materials for comfort and sound quality.\\\",\\\"id\\\":6204},{\\\"category_name\\\":\\\"Earplugs\\\",\\\"description\\\":\\\"Earplugs are used to protect ears from noise and water.\\\",\\\"id\\\":8732}][categories-data end]\\n if it does not fit into any given category than set category_id as 0 and describe why. \\n Please return response in proper JSON format [text end]<end_of_turn>\n<start_of_turn>model\n\n" time=2025-04-28T15:45:27.179Z level=DEBUG source=process_text_spm.go:184 msg="adding bos token to prompt" id=2 time=2025-04-28T15:45:27.330Z level=DEBUG source=cache.go:136 msg="loading cache slot" id=0 cache=904 prompt=734 used=91 remaining=643 [GIN] 2025/04/28 - 15:45:32 | 200 | 5.371758844s | 172.19.0.3 | POST "/api/generate" time=2025-04-28T15:45:32.465Z level=DEBUG source=sched.go:409 msg="context for request finished" time=2025-04-28T15:45:32.465Z level=DEBUG source=sched.go:341 msg="runner with non-zero duration has gone idle, adding timer" modelPath=/root/.ollama/models/blobs/sha256-ccc0cddac56136ef0969cf2e3e9ac051124c937be42503b47ec570dead85ff87 duration=2562047h47m16.854775807s time=2025-04-28T15:45:32.465Z level=DEBUG source=sched.go:359 msg="after processing request finished event" modelPath=/root/.ollama/models/blobs/sha256-ccc0cddac56136ef0969cf2e3e9ac051124c937be42503b47ec570dead85ff87 refCount=0 time=2025-04-28T15:45:33.303Z level=WARN source=ggml.go:152 msg="key not found" key=general.alignment default=32 ``` ### OS Linux, Docker ### GPU Nvidia ### CPU Intel ### Ollama version 0.6.6

GiteaMirror added the bugneeds more info labels 2026-05-09 21:02:45 -05:00

GiteaMirror closed this issue 2026-05-09 21:03:02 -05:00

GiteaMirror commented 2026-05-09 21:03:05 -05:00

Author

Owner

Copy Link

@rick-github commented on GitHub (Apr 28, 2025):

A full log will include information about your configuration, devices and memory allocations, pleased add a full log. Also your docker configuration.

<!-- gh-comment-id:2834603527 --> @rick-github commented on GitHub (Apr 28, 2025): A full log will include information about your configuration, devices and memory allocations, pleased add a full log. Also your docker configuration.

GiteaMirror commented 2026-05-09 21:03:06 -05:00

Author

Owner

Copy Link

@moonflash commented on GitHub (Apr 28, 2025):

Tested on various versions: 0.6.6/0.6.5/0.6.3 (all the same)
Was not able to run properly gemma3:27b-it-qat on any earlier version.

<!-- gh-comment-id:2835559380 --> @moonflash commented on GitHub (Apr 28, 2025): Tested on various versions: 0.6.6/0.6.5/0.6.3 (all the same) Was not able to run properly `gemma3:27b-it-qat` on any earlier version.

GiteaMirror commented 2026-05-09 21:03:08 -05:00

Author

Owner

Copy Link

@moonflash commented on GitHub (Apr 28, 2025):

ollama.log
Log on initializing ollama and first request only.
All other requests look as the previous log

<!-- gh-comment-id:2836154812 --> @moonflash commented on GitHub (Apr 28, 2025): [ollama.log](https://github.com/user-attachments/files/19946662/ollama.log) Log on initializing ollama and first request only. All other requests look as the previous log

GiteaMirror commented 2026-05-09 21:03:09 -05:00

Author

Owner

Copy Link

@chunyao commented on GitHub (Apr 29, 2025):

gemma3:27b-it-qat is bad. gemma3:27b-it is ok. try it~

<!-- gh-comment-id:2837532103 --> @chunyao commented on GitHub (Apr 29, 2025): gemma3:27b-it-qat is bad. gemma3:27b-it is ok. try it~

GiteaMirror commented 2026-05-09 21:03:09 -05:00

Author

Owner

Copy Link

@moonflash commented on GitHub (Apr 29, 2025):

@chunyao Thanks. I've tried it. It's a little bit "better" but i assume just because model has 1GB smaller memory usage. At the end memory leak is still happening.

@rick-github I've uploaded logs, I hope it will be enough to understand what's going on.

BTW, I have 4xRTX3090 cards, each serving separate ollama docker image.
There are 4 golang jobs extracting data (with text and image on each request).
Average, response time is 8 seconds.

When process (with gemma3:27b-it-q4_K_M) started i had this:

               total        used        free      
Mem:            31Gi       8.0Gi       696Mi   
Swap:           79Gi       149Mi        79Gi

After 60 minutes and ~ 1800/2000 requests (4x~450/500 per card) I have this:

               total        used        free     
Mem:            31Gi        25Gi       382Mi        
Swap:           79Gi       2.8Gi        77Gi

With gemma3:27b-it-qat was even worse.

After few hours and > 10K requests:

               total        used        free 
Mem:            31Gi        30Gi       318Mi 
Swap:           79Gi        60Gi        19Gi

<!-- gh-comment-id:2837872909 --> @moonflash commented on GitHub (Apr 29, 2025): @chunyao Thanks. I've tried it. It's a little bit "better" but i assume just because model has 1GB smaller memory usage. At the end memory leak is still happening. @rick-github I've uploaded logs, I hope it will be enough to understand what's going on. BTW, I have 4xRTX3090 cards, each serving separate ollama docker image. There are 4 golang jobs extracting data (with text and image on each request). Average, response time is 8 seconds. When process (with `gemma3:27b-it-q4_K_M`) started i had this: ``` total used free Mem: 31Gi 8.0Gi 696Mi Swap: 79Gi 149Mi 79Gi ``` After 60 minutes and ~ 1800/2000 requests (4x~450/500 per card) I have this: ``` total used free Mem: 31Gi 25Gi 382Mi Swap: 79Gi 2.8Gi 77Gi ``` With `gemma3:27b-it-qat` was even worse. After few hours and > 10K requests: ``` total used free Mem: 31Gi 30Gi 318Mi Swap: 79Gi 60Gi 19Gi ```

GiteaMirror commented 2026-05-09 21:03:10 -05:00

Author

Owner

Copy Link

@rick-github commented on GitHub (Apr 29, 2025):

This looks like a leak in the image processing. I ran a ollama run gemma3:27b-it-qat describe this image ./image.jpg in a loop where image.jpg was a small image, then a large image, and then a missing image, and got this RSS profile for the runner:

So during image processing, RSS goes up - the slope is different on the large image because it took longer to process. With a missing image, the model hallucinated results so was still generating tokens, but the RSS levelled out.

<!-- gh-comment-id:2840157900 --> @rick-github commented on GitHub (Apr 29, 2025): This looks like a leak in the image processing. I ran a `ollama run gemma3:27b-it-qat describe this image ./image.jpg` in a loop where `image.jpg` was a small image, then a large image, and then a missing image, and got this RSS profile for the runner:  So during image processing, RSS goes up - the slope is different on the large image because it took longer to process. With a missing image, the model hallucinated results so was still generating tokens, but the RSS levelled out.

GiteaMirror commented 2026-05-09 21:03:10 -05:00

Author

Owner

Copy Link

@jessegross commented on GitHub (May 1, 2025):

Thanks for the great analysis @rick-github!

<!-- gh-comment-id:2845474949 --> @jessegross commented on GitHub (May 1, 2025): Thanks for the great analysis @rick-github!

GiteaMirror commented 2026-05-09 21:03:11 -05:00

Author

Owner

Copy Link

@moonflash commented on GitHub (May 1, 2025):

Thanks @rick-github for the analysis and @jessegross for fixing the problem 👍 https://github.com/ollama/ollama/issues/10434

<!-- gh-comment-id:2845633336 --> @moonflash commented on GitHub (May 1, 2025): Thanks @rick-github for the analysis and @jessegross for fixing the problem 👍 https://github.com/ollama/ollama/issues/10434

GiteaMirror commented 2026-05-09 21:03:11 -05:00

Author

Owner

Copy Link

@moonflash commented on GitHub (May 5, 2025):

Unfortunately it seems like this code change didn't fix memory leak issue.
Using ollama/ollama:0.6.8 docker image and memory usage has a same rate as when using ollama/ollama:0.6.6.
@rick-github can you, please, check on your setup?

<!-- gh-comment-id:2851456712 --> @moonflash commented on GitHub (May 5, 2025): Unfortunately it seems like this code change didn't fix memory leak issue. Using ollama/ollama:0.6.8 docker image and memory usage has a same rate as when using ollama/ollama:0.6.6. @rick-github can you, please, check on your setup?

GiteaMirror commented 2026-05-09 21:03:12 -05:00

Author

Owner

Copy Link

@rick-github commented on GitHub (May 5, 2025):

Yep, still leaking.

<!-- gh-comment-id:2852263400 --> @rick-github commented on GitHub (May 5, 2025):  Yep, still leaking.

GiteaMirror commented 2026-05-09 21:03:13 -05:00

Author

Owner

Copy Link

@moonflash commented on GitHub (May 21, 2025):

@rick-github it seems like release v0.7.0 solved the problem.
My memory consumption is much, much better now and it seems that leakage is fixed.
I'm just interested what's does your "magic graph" says? 🥰

<!-- gh-comment-id:2899236307 --> @moonflash commented on GitHub (May 21, 2025): @rick-github it seems like release v0.7.0 solved the problem. My memory consumption is much, much better now and it seems that leakage is fixed. I'm just interested what's does your "magic graph" says? 🥰

GiteaMirror commented 2026-05-09 21:03:13 -05:00

Author

Owner

Copy Link

@rick-github commented on GitHub (May 22, 2025):

Doesn't seem to be fixed yet.

<!-- gh-comment-id:2901078019 --> @rick-github commented on GitHub (May 22, 2025): Doesn't seem to be fixed yet. 

Sign in to join this conversation.

No Branch/Tag Specified

Branches Tags

main

dhiltgen/llama-runner

parth-migrate-pi

codex/make-integration-hidden-and-lunchable

hoyyeva/migrate-pi

hoyyeva/opencode-thinking

hoyyeva/anthropic-local-image-path

parth-launch-codex-app

hoyyeva/anthropic-reference-images-path

parth-anthropic-reference-images-path

brucemacd/download-before-remove

hoyyeva/editor-config-repair

parth-mlx-decode-checkpoints

hoyyeva/qwen

parth/hide-claude-desktop-till-release

parth-add-claude-code-autoinstall

release_v0.22.0

pdevine/manifest-list

codex/fix-codex-model-metadata-warning

pdevine/addressable-manifest

brucemacd/launch-fetch-reccomended

jmorganca/llama-compat

launch-copilot-cli

release_v0.20.7

parth-auto-save-backup

parth-test

jmorganca/gemma4-audio-replacements

fix-manifest-digest-on-pull

hoyyeva/vscode-improve

brucemacd/install-server-wait

parth/update-claude-docs

brucemac/start-ap-install

pdevine/mlx-update

pdevine/qwen35_vision

drifkin/api-show-fallback

mintlify/image-generation-1773352582

hoyyeva/server-context-length-local-config

jmorganca/faster-reptition-penalties

jmorganca/convert-nemotron

parth-pi-thinking

pdevine/sampling-penalties

jmorganca/fix-create-quantization-memory

dongchen/resumable_transfer_fix

pdevine/sampling-cache-error

jessegross/mlx-usage

hoyyeva/openclaw-config

hoyyeva/app-html

pdevine/qwen3next

brucemacd/sign-sh-install

brucemacd/tui-update

brucemacd/usage-api

jmorganca/launch-empty

fix-app-dist-embed

mxyng/mlx-compile

mxyng/mlx-quant

mxyng/mlx-glm4.7

mxyng/mlx

brucemacd/simplify-model-picker

jmorganca/qwen3-concurrent

fix-glm-4.7-flash-mla-config

drifkin/qwen3-coder-opening-tag

brucemacd/usage-cli

fix-cuda12-fattn-shmem

ollama-imagegen-docs

parth/fix-multiline-inputs

brucemacd/config-docs

mxyng/model-files

mxyng/simple-execute

fix-imagegen-ollama-models

mxyng/async-upload

jmorganca/lazy-no-dtype-changes

imagegen-auto-detect-create

parth/decrease-concurrent-download-hf

fix-mlx-quantize-init

jmorganca/x-cleanup

usage

imagegen-readme

jmorganca/glm-image

mlx-gpu-cd

jmorganca/imagegen-modelfile

parth/agent-skills

parth/agent-allowlist

parth/signed-in-offline

parth/agents

parth/fix-context-chopping

improve-cloud-flow

parth/add-models-websearch

parth/prompt-renderer-mcp

jmorganca/native-settings

jmorganca/download-stream-hash

jmorganca/client2-rebased

brucemacd/oai-chat-req-multipart

jessegross/multi_chunk_reserve

grace/additional-omit-empty

grace/mistral-3-large

mxyng/tokenizer2

mxyng/tokenizer

jessegross/flash

hoyyeva/windows-nacked-app

mxyng/cleanup-attention

grace/deepseek-parser

hoyyeva/remember-unsent-prompt

parth/add-lfs-pointer-error-conversion

parth/olmo2-test2

hoyyeva/ollama-launchagent-plist

nicole/olmo-model

parth/olmo-test

mxyng/remove-embedded

parth/render-template

jmorganca/intellect-3

parth/remove-prealloc-linter

jmorganca/cmd-eval

nicole/nomic-embed-text-fix

mxyng/lint-2

hoyyeva/add-gemini-3-pro-preview

hoyyeva/load-model-list

mxyng/expand-path

mxyng/environ-2

hoyyeva/deeplink-json-encoding

parth/improve-tool-calling-tests

hoyyeva/conversation

hoyyeva/assistant-edit-response

hoyyeva/thinking

origin/brucemacd/invalid-char-i-err

parth/improve-tool-calling

jmorganca/required-omitempty

grace/qwen3-vl-tests

mxyng/iter-client

parth/docs-readme

nicole/embed-test

pdevine/integration-benchstat

parth/remove-generate-cmd

parth/add-toolcall-id

mxyng/server-tests

jmorganca/glm-4.6

jmorganca/gin-h-compat

drifkin/stable-tool-args

pdevine/qwen3-more-thinking

parth/add-websearch-client

nicole/websearch_local

jmorganca/qwen3-coder-updates

grace/deepseek-v3-migration-tests

mxyng/fix-create

jmorganca/cloud-errors

pdevine/parser-tidy

revert-12233-parth/simplify-entrypoints-runner

parth/enable-so-gpt-oss

brucemacd/qwen3vl

jmorganca/readme-simplify

parth/gpt-oss-structured-outputs

revert-12039-jmorganca/tools-braces

mxyng/embeddings

mxyng/gguf

mxyng/benchmark

mxyng/types-null

parth/move-parsing

mxyng/gemma2

jmorganca/docs

mxyng/16-bit

mxyng/create-stdin

pdevine/authorizedkeys

mxyng/quant

parth/opt-in-error-context-window

brucemacd/cache-models

brucemacd/runner-completion

jmorganca/llama-update-6

brucemacd/benchmark-list

brucemacd/partial-read-caps

parth/deepseek-r1-tools

mxyng/omit-array

parth/tool-prefix-temp

brucemacd/runner-test

jmorganca/qwen25vl

brucemacd/model-forward-test-ext

parth/python-function-parsing

jmorganca/cuda-compression-none

drifkin/num-parallel

drifkin/chat-truncation-fix

jmorganca/sync

parth/python-tools-calling

drifkin/array-head-count

brucemacd/create-no-loop

parth/server-enable-content-stream-with-tools

qwen25omni

mxyng/v3

brucemacd/ropeconfig

jmorganca/silence-tokenizer

parth/sample-so-test

parth/sampling-structured-outputs

brucemacd/doc-go-engine

parth/constrained-sampling-json

jmorganca/mistral-wip

brucemacd/mistral-small-convert

parth/sample-unmarshal-json-for-params

brucemacd/jomorganca/mistral

pdevine/bfloat16

jmorganca/mistral

brucemacd/mistral

pdevine/logging

parth/sample-correctness-fix

parth/sample-fix-sorting

jmorgan/sample-fix-sorting-extras

jmorganca/temp-0-images

brucemacd/parallel-embed-models

brucemacd/shim-grammar

jmorganca/fix-gguf-error

bmizerany/nameswork

jmorganca/faster-releases

bmizerany/validatenames

brucemacd/err-no-vocab

brucemacd/rope-config

brucemacd/err-hint

brucemacd/qwen2_5

brucemacd/logprobs

brucemacd/new_runner_graph_bench

progress-flicker

brucemacd/forward-test

brucemacd/go_qwen2

pdevine/gemma2

jmorganca/add-missing-symlink-eval

mxyng/next-debug

parth/set-context-size-openai

brucemacd/next-bpe-bench

brucemacd/next-bpe-test

brucemacd/new_runner_e2e

brucemacd/new_runner_qwen2

pdevine/convert-cohere2

brucemacd/convert-cli

parth/log-probs

mxyng/next-mlx

mxyng/cmd-history

parth/templating

parth/tokenize-detokenize

brucemacd/check-key-register

bmizerany/grammar

jmorganca/vendor-081b29bd

mxyng/func-checks

jmorganca/fix-null-format

parth/fix-default-to-warn-json

jmorganca/qwen2vl

jmorganca/no-concat

parth/cmd-cleanup-SO

brucemacd/check-key-register-structured-err

parth/openai-stream-usage

parth/fix-referencing-so

stream-tools-stop

jmorganca/degin-1

brucemacd/install-path-clean

brucemacd/push-name-validation

brucemacd/browser-key-register

jmorganca/openai-fix-first-message

jmorganca/fix-proxy

jessegross/sample

parth/disallow-streaming-tools

dhiltgen/remove_submodule

jmorganca/ga

jmorganca/mllama

pdevine/newlines

pdevine/geems-2b

jmorganca/llama-bump

mxyng/modelname-7

mxyng/gin-slog

mxyng/modelname-6

jyan/convert-prog

jyan/quant5

paligemma-support

pdevine/import-docs

jmorganca/openai-context

jyan/paligemma

jyan/p2

jyan/palitest

bmizerany/embedspeedup

jmorganca/llama-vit

brucemacd/allow-ollama

royh/ep-methods

royh/whisper

mxyng/api-models

mxyng/fix-memory

jyan/q4_4/8

jyan/ollama-v

royh/stream-tools

roy-embed-parallel

bmizerany/hrm

revert-5963-revert-5924-mxyng/llama3.1-rope

royh/embed-viz

jyan/local2

jyan/auth

jyan/local

jyan/parse-temp

jmorganca/template-mistral

jyan/reord-g

royh-openai-suffixdocs

royh-imgembed

royh-embed-parallel

jyan/quant4

royh-precision

jyan/progress

pdevine/fix-template

jyan/quant3

pdevine/ggla

mxyng/update-registry-domain

jmorganca/ggml-static

mxyng/create-context

jyan/v0.146

mxyng/layers-from-files

build_dist

bmizerany/noseek

royh-ls

royh-name

timeout

mxyng/server-timestamp

bmizerany/nosillyggufslurps

royh-params

jmorganca/llama-cpp-7c26775

royh-openai-delete

royh-show-rigid

jmorganca/enable-fa

jmorganca/no-error-template

jyan/format

royh-testdelete

bmizerany/fastverify

language_support

pdevine/ps-glitches

brucemacd/tokenize

bruce/iq-quants

bmizerany/filepathwithcoloninhost

mxyng/split-bin

bmizerany/client-registry

jmorganca/if-none-match

native

jmorganca/native

jmorganca/batch-embeddings

jmorganca/initcmake

jmorganca/mm

pdevine/showggmlinfo

modenameenforcealphanum

bmizerany/modenameenforcealphanum

jmorganca/done-reason

jmorganca/llama-cpp-8960fe8

ollama.com

bmizerany/filepathnobuild

bmizerany/types/model/defaultfix

rmdisplaylong

nogogen

bmizerany/x

modelfile-readme

bmizerany/replacecolon

jmorganca/limit

jmorganca/execstack

jmorganca/replace-assets

mxyng/tune-concurrency

jmorganca/testing

whitespace-detection

jmorganca/options

upgrade-all

scratch

cuda-search

mattw/airenamer

mattw/allmodelsonhuggingface

mattw/quantcontext

mattw/whatneedstorun

brucemacd/llama-mem-calc

mattw/faq-context

mattw/communitylinks

mattw/noprune

mattw/python-functioncalling

rename

mxyng/install

pulse

remove-first

editor

mattw/selfqueryingretrieval

cgo

mattw/howtoquant

api

matt/streamingapi

format-config

mxyng/extra-args

shell

update-nous-hermes

cp-model

upload-progress

fix-unknown-model

fix-model-names

delete-fix

insecure-registry

ls

deletemodels

progressbar

readme-updates

license-layers

skip-list

list-models

modelpath

matt/examplemodelfiles

distribution

go-opts

v0.30.0-rc23

v0.30.0-rc22

v0.30.0-rc21

v0.30.0-rc20

v0.30.0-rc19

v0.30.0-rc18

v0.25.0-rc0

v0.30.0-rc17

v0.30.0-rc16

v0.24.0-rc1

v0.24.0

v0.24.0-rc0

v0.23.4

v0.23.4-rc0

v0.30.0-rc15

v0.23.3

v0.23.3-rc1

v0.30.0-rc14

v0.23.3-rc0

v0.30.0-rc13

v0.30.0-rc12

v0.30.0-rc11

v0.30.0-rc10

v0.30.0-rc9

v0.30.0-rc8

v0.30.0-rc7

v0.30.0-rc6

v0.30.0-rc5

v0.23.2

v0.23.2-rc0

v0.30.0-rc4

v0.30.0-rc3

v0.30.0-rc2

v0.30.0-rc1

v0.30.0-rc0

v0.23.1

v0.23.1-rc0

v0.23.0

v0.23.0-rc0

v0.22.1

v0.22.1-rc1

v0.22.1-rc0

v0.22.0

v0.22.0-rc1

v0.21.3-rc0

v0.21.2-rc1

v0.21.2

v0.21.2-rc0

v0.21.1

v0.21.1-rc1

v0.21.1-rc0

v0.21.0

v0.21.0-rc1

v0.21.0-rc0

v0.20.8-rc0

v0.20.7

v0.20.7-rc1

v0.20.7-rc0

v0.20.6

v0.20.6-rc1

v0.20.6-rc0

v0.20.5

v0.20.5-rc2

v0.20.5-rc1

v0.20.5-rc0

v0.20.4

v0.20.4-rc2

v0.20.4-rc1

v0.20.4-rc0

v0.20.3

v0.20.3-rc0

v0.20.2

v0.20.1

v0.20.1-rc2

v0.20.1-rc1

v0.20.1-rc0

v0.20.0

v0.20.0-rc1

v0.20.0-rc0

v0.19.0

v0.19.0-rc2

v0.19.0-rc1

v0.19.0-rc0

v0.18.4-rc1

v0.18.4-rc0

v0.18.3

v0.18.3-rc2

v0.18.3-rc1

v0.18.3-rc0

v0.18.2

v0.18.2-rc1

v0.18.2-rc0

v0.18.1

v0.18.1-rc1

v0.18.1-rc0

v0.18.0

v0.18.0-rc2

v0.18.0-rc1

v0.18.0-rc0

v0.17.8-rc4

v0.17.8-rc3

v0.17.8-rc2

v0.17.8-rc1

v0.17.8-rc0

v0.17.7

v0.17.7-rc2

v0.17.7-rc1

v0.17.7-rc0

v0.17.6

v0.17.5

v0.17.4

v0.17.3

v0.17.2

v0.17.1

v0.17.1-rc2

v0.17.1-rc1

v0.17.1-rc0

v0.17.0

v0.17.0-rc2

v0.17.0-rc1

v0.17.0-rc0

v0.16.3

v0.16.3-rc2

v0.16.3-rc1

v0.16.3-rc0

v0.16.2

v0.16.2-rc0

v0.16.1

v0.16.0

v0.16.0-rc2

v0.16.0-rc0

v0.16.0-rc1

v0.15.6

v0.15.5

v0.15.5-rc5

v0.15.5-rc4

v0.15.5-rc3

v0.15.5-rc2

v0.15.5-rc1

v0.15.5-rc0

v0.15.4

v0.15.3

v0.15.2

v0.15.1

v0.15.1-rc1

v0.15.1-rc0

v0.15.0-rc6

v0.15.0

v0.15.0-rc5

v0.15.0-rc4

v0.15.0-rc3

v0.15.0-rc2

v0.15.0-rc1

v0.15.0-rc0

v0.14.3

v0.14.3-rc3

v0.14.3-rc2

v0.14.3-rc1

v0.14.3-rc0

v0.14.2

v0.14.2-rc1

v0.14.2-rc0

v0.14.1

v0.14.0-rc11

v0.14.0

v0.14.0-rc10

v0.14.0-rc9

v0.14.0-rc8

v0.14.0-rc7

v0.14.0-rc6

v0.14.0-rc5

v0.14.0-rc4

v0.14.0-rc3

v0.14.0-rc2

v0.14.0-rc1

v0.14.0-rc0

v0.13.5

v0.13.5-rc1

v0.13.5-rc0

v0.13.4-rc2

v0.13.4

v0.13.4-rc1

v0.13.4-rc0

v0.13.3

v0.13.3-rc1

v0.13.3-rc0

v0.13.2

v0.13.2-rc2

v0.13.2-rc1

v0.13.2-rc0

v0.13.1

v0.13.1-rc2

v0.13.1-rc1

v0.13.1-rc0

v0.13.0

v0.13.0-rc0

v0.12.11

v0.12.11-rc1

v0.12.11-rc0

v0.12.10

v0.12.10-rc1

v0.12.10-rc0

v0.12.9-rc0

v0.12.9

v0.12.8

v0.12.8-rc0

v0.12.7

v0.12.7-rc1

v0.12.7-rc0

v0.12.7-citest0

v0.12.6

v0.12.6-rc1

v0.12.6-rc0

v0.12.5

v0.12.5-rc0

v0.12.4

v0.12.4-rc7

v0.12.4-rc6

v0.12.4-rc5

v0.12.4-rc4

v0.12.4-rc3

v0.12.4-rc2

v0.12.4-rc1

v0.12.4-rc0

v0.12.3

v0.12.2

v0.12.2-rc0

v0.12.1

v0.12.1-rc1

v0.12.1-rc2

v0.12.1-rc0

v0.12.0

v0.12.0-rc1

v0.12.0-rc0

v0.11.11

v0.11.11-rc3

v0.11.11-rc2

v0.11.11-rc1

v0.11.11-rc0

v0.11.10

v0.11.9

v0.11.9-rc0

v0.11.8

v0.11.8-rc0

v0.11.7-rc1

v0.11.7-rc0

v0.11.7

v0.11.6

v0.11.6-rc0

v0.11.5-rc4

v0.11.5-rc3

v0.11.5

v0.11.5-rc5

v0.11.5-rc2

v0.11.5-rc1

v0.11.5-rc0

v0.11.4

v0.11.4-rc0

v0.11.3

v0.11.3-rc0

v0.11.2

v0.11.1

v0.11.0-rc0

v0.11.0-rc1

v0.11.0-rc2

v0.11.0

v0.10.2-int1

v0.10.1

v0.10.0

v0.10.0-rc4

v0.10.0-rc3

v0.10.0-rc2

v0.10.0-rc1

v0.10.0-rc0

v0.9.7-rc1

v0.9.7-rc0

v0.9.6

v0.9.6-rc0

v0.9.6-ci0

v0.9.5

v0.9.4-rc5

v0.9.4-rc6

v0.9.4

v0.9.4-rc3

v0.9.4-rc4

v0.9.4-rc1

v0.9.4-rc2

v0.9.4-rc0

v0.9.3

v0.9.3-rc5

v0.9.4-citest0

v0.9.3-rc4

v0.9.3-rc3

v0.9.3-rc2

v0.9.3-rc1

v0.9.3-rc0

v0.9.2

v0.9.1

v0.9.1-rc1

v0.9.1-rc0

v0.9.1-ci1

v0.9.1-ci0

v0.9.0

v0.9.0-rc0

v0.8.0

v0.8.0-rc0

v0.7.1-rc2

v0.7.1

v0.7.1-rc1

v0.7.1-rc0

v0.7.0

v0.7.0-rc1

v0.7.0-rc0

v0.6.9-rc0

v0.6.8

v0.6.8-rc0

v0.6.7

v0.6.7-rc2

v0.6.7-rc1

v0.6.7-rc0

v0.6.6

v0.6.6-rc2

v0.6.6-rc1

v0.6.6-rc0

v0.6.5-rc1

v0.6.5

v0.6.5-rc0

v0.6.4-rc0

v0.6.4

v0.6.3-rc1

v0.6.3

v0.6.3-rc0

v0.6.2

v0.6.2-rc0

v0.6.1

v0.6.1-rc0

v0.6.0-rc0

v0.6.0

v0.5.14-rc0

v0.5.13

v0.5.13-rc6

v0.5.13-rc5

v0.5.13-rc4

v0.5.13-rc3

v0.5.13-rc2

v0.5.13-rc1

v0.5.13-rc0

v0.5.12

v0.5.12-rc1

v0.5.12-rc0

v0.5.11

v0.5.10

v0.5.9

v0.5.9-rc0

v0.5.8-rc13

v0.5.8

v0.5.8-rc12

v0.5.8-rc11

v0.5.8-rc10

v0.5.8-rc9

v0.5.8-rc8

v0.5.8-rc7

v0.5.8-rc6

v0.5.8-rc5

v0.5.8-rc4

v0.5.8-rc3

v0.5.8-rc2

v0.5.8-rc1

v0.5.8-rc0

v0.5.7

v0.5.6

v0.5.5

v0.5.5-rc0

v0.5.4

v0.5.3

v0.5.3-rc0

v0.5.2

v0.5.2-rc3

v0.5.2-rc2

v0.5.2-rc1

v0.5.2-rc0

v0.5.1

v0.5.0

v0.5.0-rc1

v0.4.8-rc0

v0.4.7

v0.4.6

v0.4.5

v0.4.4

v0.4.3

v0.4.3-rc0

v0.4.2

v0.4.2-rc1

v0.4.2-rc0

v0.4.1

v0.4.1-rc0

v0.4.0

v0.4.0-rc8

v0.4.0-rc7

v0.4.0-rc6

v0.4.0-rc5

v0.4.0-rc4

v0.4.0-rc3

v0.4.0-rc2

v0.4.0-rc1

v0.4.0-rc0

v0.4.0-ci3

v0.3.14

v0.3.14-rc0

v0.3.13

v0.3.12

v0.3.12-rc5

v0.3.12-rc4

v0.3.12-rc3

v0.3.12-rc2

v0.3.12-rc1

v0.3.11

v0.3.11-rc4

v0.3.11-rc3

v0.3.11-rc2

v0.3.11-rc1

v0.3.10

v0.3.10-rc1

v0.3.9

v0.3.8

v0.3.7

v0.3.7-rc6

v0.3.7-rc5

v0.3.7-rc4

v0.3.7-rc3

v0.3.7-rc2

v0.3.7-rc1

v0.3.6

v0.3.5

v0.3.4

v0.3.3

v0.3.2

v0.3.1

v0.3.0

v0.2.8

v0.2.8-rc2

v0.2.8-rc1

v0.2.7

v0.2.6

v0.2.5

v0.2.4

v0.2.3

v0.2.2

v0.2.2-rc2

v0.2.2-rc1

v0.2.1

v0.2.0

v0.1.49-rc14

v0.1.49-rc13

v0.1.49-rc12

v0.1.49-rc11

v0.1.49-rc10

v0.1.49-rc9

v0.1.49-rc8

v0.1.49-rc7

v0.1.49-rc6

v0.1.49-rc4

v0.1.49-rc5

v0.1.49-rc3

v0.1.49-rc2

v0.1.49-rc1

v0.1.48

v0.1.47

v0.1.46

v0.1.45-rc5

v0.1.45

v0.1.45-rc4

v0.1.45-rc3

v0.1.45-rc2

v0.1.45-rc1

v0.1.44

v0.1.43

v0.1.42

v0.1.41

v0.1.40

v0.1.40-rc1

v0.1.39

v0.1.39-rc2

v0.1.39-rc1

v0.1.38

v0.1.37

v0.1.36

v0.1.35

v0.1.35-rc1

v0.1.34

v0.1.34-rc1

v0.1.33

v0.1.33-rc7

v0.1.33-rc6

v0.1.33-rc5

v0.1.33-rc4

v0.1.33-rc3

v0.1.33-rc2

v0.1.33-rc1

v0.1.32

v0.1.32-rc2

v0.1.32-rc1

v0.1.31

v0.1.30

v0.1.29

v0.1.28

v0.1.27

v0.1.26

v0.1.25

v0.1.24

v0.1.23

v0.1.22

v0.1.21

v0.1.20

v0.1.19

v0.1.18

v0.1.17

v0.1.16

v0.1.15

v0.1.14

v0.1.13

v0.1.12

v0.1.11

v0.1.10

v0.1.9

v0.1.8

v0.1.7

v0.1.6

v0.1.5

v0.1.4

v0.1.3

v0.1.2

v0.1.1

v0.1.0

v0.0.21

v0.0.20

v0.0.19

v0.0.18

v0.0.17

v0.0.16

v0.0.15

v0.0.14

v0.0.13

v0.0.12

v0.0.11

v0.0.10

v0.0.9

v0.0.8

v0.0.7

v0.0.6

v0.0.5

v0.0.4

v0.0.3

v0.0.2

v0.0.1

Labels

Clear labels

amd

api

app

bug

build

cli

cloud

compatibility

context-length

create

docker

documentation

embeddings

feature request

feedback wanted

good first issue

gpt-oss

gpu

harmony

help wanted

image

install

intel

js

launch

linux

macos

memory

mlx

model

needs more info

networking

nvidia

ollama.com

performance

pull-request

Mirrored from GitHub Pull Request

python

question

registry

rendering

thinking

tools

top

vulkan

windows

wsl

No Label bug needs more info

Milestone

No items

No Milestone

Projects

Clear projects

No project

Assignees

Clear assignees

GiteaMirror ninjasurge

No Assignees

1 Participants

Notifications

Subscribe

Due Date

No due date set.

Dependencies

No dependencies set.

Reference: github-starred/ollama#84544