github-starred/open-webui
2
0
Fork 0
mirror of https://github.com/open-webui/open-webui.git synced 2026-03-25 04:24:30 -05:00
Code Issues 308 Packages Projects Releases 100 Wiki Activity

Memory leak / overflow when using Llama 3.1 models on Ollama backend #1784

New Issue
Closed
opened 2025-11-11 14:53:09 -06:00 by GiteaMirror · 0 comments
GiteaMirror commented 2025-11-11 14:53:09 -06:00
Owner
Copy Link

Originally created by @TheSeraph on GitHub (Aug 15, 2024).

Bug Report

Installation Method

Home gaming PC running virtualbox & ollama server.
Open-WebUI is running as a docker container on a VM in virtualbox, reverse proxied by Nginx, and alongside a set of docker containers for n8n.
Ollama is runnign on the host machine, which has all the Compute resources (CPU, RAM, VRAM) that is being affected by the memory leak

Environment

  • Open WebUI: v0.3.12 in docker container, on Ubuntu 24.04 LTS VM

  • Ollama v0.4.3 on Windows 10 Pro (Host)

  • Operating System: Win 10 Pro + Ubuntu 24.04 LTS

  • CPU: AMD Ryzen 7 5800x

  • Memory: 64gb DDR4

  • GPU: PowerColor Hellhound 7900 XTX (24 gb vram)

  • Browser (if applicable): Firefox 129.0.1

Confirmation:

  • I have read and followed all the instructions provided in the README.md.
  • I am on the latest version of both Open WebUI and Ollama.
  • I have included the browser console logs.
  • I have included the Docker container logs.
  • I have provided the exact steps to reproduce the bug in the "Steps to Reproduce" section below.

Expected Behavior:

I expect to run smaller Llama3.1 modelfiles (16gb or less) completely within my 24gb of VRAM of my GPU

Actual Behavior:

When running llama3.1:latest (4.7gb model) and llama3.1:8b-instruct-fp16 (16gb model) through Open-WebUI there seems to be a memory leak, or a runaway memory problem on the system hosting Ollama, causing models to overflow VRAM, and take up other system resources

Description

Bug Summary:
When running the models with Open-WebUI, the models suddenly take up an amount of memory that is multiples of their actual size. This has been tested with llama3.1:latest (4.7gb model) and llama3.1:8b-instruct-fp16 (16gb model) and both have shown this type of behaviour.

This is running llama3.1:latest through the ollama CLI
image

This is what happens running it through Open-WebUI. You can see at first it's normal, but then it goes rogue taking up 4.7 times the amount of resources it does under normal operation. This model is only 4.7gb
image

Interestingly enough other models don't necessarily show the same behaviour. For example dolphin-llama3:8b (4.7gb) does not seem to balloon when used through Open-WebUI.

In order to make a comparison, I did use Ollama CLI and n8n as benchmarks for memory and processor usage. This doesn't occur when using those other interfaces to the LLM, just open-webui

Reproduction Details

Steps to Reproduce:

  1. Run llama3.1 using Ollama CLI on the desktop host ollama run llama3.1:latest
  2. Send a few test prompts through
  3. Exit Ollama CLI /bye
  4. Verify system resource usage using ollama ps or any other tools (task manager, GPU tools)
  5. (OPTIONAL) Wait to unload the model from memory (default is 5 minutes) or unload model from ollama memory using API
  6. (OPTIONAL) Repeat steps 1 through 5 with another external tool (I tried this with n8n, which is cohosted with Open-WebUI)
  7. Open the Open-WebUI and start a chat using the same model
  8. Verify system resource usage using ollama ps or any other tools (task manager, GPU tools)

Logs and Screenshots

NOTICE!! For the purpose of logging I restarted the container to get a relatively "clean" slate of events to debug

Browser Console Logs:

XHRGET
https://[REDACTED]/ws/socket.io/?EIO=4&transport=polling&t=P5M0GUp
[HTTP/1.1 502 Bad Gateway 2ms]

XHRGET
https://[REDACTED]/ws/socket.io/?EIO=4&transport=polling&t=P5M0Gyp
[HTTP/1.1 502 Bad Gateway 3ms]

user-count 
Object { count: 1 }
+layout.svelte:125:13
usage 
Object { models: [] }
+layout.svelte:130:13
connected +layout.svelte:119:13
submitPrompt <empty string> Chat.svelte:496:10
modelId llama3.1:latest Chat.svelte:649:12
usage 
Object { models: (1) […] }
+layout.svelte:130:13
usage 
Object { models: (1) […] }
+layout.svelte:130:13
usage 
Object { models: (1) […] }
+layout.svelte:130:13
usage 
Object { models: (1) […] }
+layout.svelte:130:13
usage 
Object { models: (1) […] }
+layout.svelte:130:13
usage 
Object { models: (1) […] }
+layout.svelte:130:13
usage 
Object { models: (1) […] }
+layout.svelte:130:13
controller 
AbortController { signal: AbortSignal }
Chat.svelte:833:11
{"model":"llama3.1:latest","created_at":"2024-08-15T12:27:08.1081714Z","message":{"role":"assistant","content":"Not"},"done":false} Chat.svelte:862:15
{"model":"llama3.1:latest","created_at":"2024-08-15T12:27:08.170814Z","message":{"role":"assistant","content":" much"},"done":false} Chat.svelte:862:15
{"model":"llama3.1:latest","created_at":"2024-08-15T12:27:08.2307259Z","message":{"role":"assistant","content":","},"done":false} Chat.svelte:862:15
{"model":"llama3.1:latest","created_at":"2024-08-15T12:27:08.2895079Z","message":{"role":"assistant","content":" just"},"done":false} Chat.svelte:862:15
{"model":"llama3.1:latest","created_at":"2024-08-15T12:27:08.3496388Z","message":{"role":"assistant","content":" chill"},"done":false} Chat.svelte:862:15
{"model":"llama3.1:latest","created_at":"2024-08-15T12:27:08.4096861Z","message":{"role":"assistant","content":"in"},"done":false} Chat.svelte:862:15
{"model":"llama3.1:latest","created_at":"2024-08-15T12:27:08.4697711Z","message":{"role":"assistant","content":"'"},"done":false} Chat.svelte:862:15
{"model":"llama3.1:latest","created_at":"2024-08-15T12:27:08.5294599Z","message":{"role":"assistant","content":" in"},"done":false} Chat.svelte:862:15
{"model":"llama3.1:latest","created_at":"2024-08-15T12:27:08.5891239Z","message":{"role":"assistant","content":" the"},"done":false} Chat.svelte:862:15
{"model":"llama3.1:latest","created_at":"2024-08-15T12:27:08.6500482Z","message":{"role":"assistant","content":" virtual"},"done":false} Chat.svelte:862:15
{"model":"llama3.1:latest","created_at":"2024-08-15T12:27:08.7093321Z","message":{"role":"assistant","content":" desert"},"done":false} Chat.svelte:862:15
usage 
Object { models: (1) […] }
+layout.svelte:130:13
{"model":"llama3.1:latest","created_at":"2024-08-15T12:27:08.7702411Z","message":{"role":"assistant","content":"."},"done":false} Chat.svelte:862:15
{"model":"llama3.1:latest","created_at":"2024-08-15T12:27:08.8299715Z","message":{"role":"assistant","content":" What"},"done":false} Chat.svelte:862:15
{"model":"llama3.1:latest","created_at":"2024-08-15T12:27:08.8929719Z","message":{"role":"assistant","content":"'s"},"done":false} Chat.svelte:862:15
{"model":"llama3.1:latest","created_at":"2024-08-15T12:27:08.9548183Z","message":{"role":"assistant","content":" on"},"done":false} Chat.svelte:862:15
{"model":"llama3.1:latest","created_at":"2024-08-15T12:27:09.0196769Z","message":{"role":"assistant","content":" your"},"done":false} Chat.svelte:862:15
{"model":"llama3.1:latest","created_at":"2024-08-15T12:27:09.0840637Z","message":{"role":"assistant","content":" mind"},"done":false} Chat.svelte:862:15
{"model":"llama3.1:latest","created_at":"2024-08-15T12:27:09.1467364Z","message":{"role":"assistant","content":"?"},"done":false} Chat.svelte:862:15
{"model":"llama3.1:latest","created_at":"2024-08-15T12:27:09.2076977Z","message":{"role":"assistant","content":" Want"},"done":false} Chat.svelte:862:15
{"model":"llama3.1:latest","created_at":"2024-08-15T12:27:09.2684302Z","message":{"role":"assistant","content":" to"},"done":false} Chat.svelte:862:15
{"model":"llama3.1:latest","created_at":"2024-08-15T12:27:09.3295448Z","message":{"role":"assistant","content":" talk"},"done":false} Chat.svelte:862:15
{"model":"llama3.1:latest","created_at":"2024-08-15T12:27:09.3973307Z","message":{"role":"assistant","content":" about"},"done":false} Chat.svelte:862:15
{"model":"llama3.1:latest","created_at":"2024-08-15T12:27:09.4629073Z","message":{"role":"assistant","content":" llama"},"done":false} Chat.svelte:862:15
{"model":"llama3.1:latest","created_at":"2024-08-15T12:27:09.5293886Z","message":{"role":"assistant","content":"-themed"},"done":false} Chat.svelte:862:15
{"model":"llama3.1:latest","created_at":"2024-08-15T12:27:09.6009259Z","message":{"role":"assistant","content":" pun"},"done":false} Chat.svelte:862:15
{"model":"llama3.1:latest","created_at":"2024-08-15T12:27:09.6733066Z","message":{"role":"assistant","content":"s"},"done":false} Chat.svelte:862:15
usage 
Object { models: (1) […] }
+layout.svelte:130:13
{"model":"llama3.1:latest","created_at":"2024-08-15T12:27:09.7493123Z","message":{"role":"assistant","content":" or"},"done":false} Chat.svelte:862:15
{"model":"llama3.1:latest","created_at":"2024-08-15T12:27:09.8205168Z","message":{"role":"assistant","content":" something"},"done":false} Chat.svelte:862:15
{"model":"llama3.1:latest","created_at":"2024-08-15T12:27:09.8863276Z","message":{"role":"assistant","content":" more"},"done":false} Chat.svelte:862:15
{"model":"llama3.1:latest","created_at":"2024-08-15T12:27:09.954875Z","message":{"role":"assistant","content":" serious"},"done":false} Chat.svelte:862:15
{"model":"llama3.1:latest","created_at":"2024-08-15T12:27:10.0285003Z","message":{"role":"assistant","content":"?"},"done":false} Chat.svelte:862:15
{"model":"llama3.1:latest","created_at":"2024-08-15T12:27:10.0971274Z","message":{"role":"assistant","content":""},"done_reason":"stop","done":true,"total_duration":9517094700,"load_duration":7100390200,"prompt_eval_count":17,"prompt_eval_duration":426745000,"eval_count":32,"eval_duration":1988346000} Chat.svelte:862:15
usage 
Object { models: (1) […] }
+layout.svelte:130:13
usage 
Object { models: (1) […] }
+layout.svelte:130:13
usage 
Object { models: (1) […] }
+layout.svelte:130:13
usage 
Object { models: (1) […] }
+layout.svelte:130:13
usage 
Object { models: (1) […] }
+layout.svelte:130:13
usage 
Object { models: (1) […] }
+layout.svelte:130:13
submitPrompt dcd7198d-4369-44a5-bafa-7c3cfdd3eb70 Chat.svelte:496:10
modelId llama3.1:latest Chat.svelte:649:12
usage 
Object { models: [] }
+layout.svelte:130:13
usage 
Object { models: (1) […] }
+layout.svelte:130:13
usage 
Object { models: (1) […] }
+layout.svelte:130:13
usage 
Object { models: (1) […] }
+layout.svelte:130:13
usage 
Object { models: (1) […] }
+layout.svelte:130:13
usage 
Object { models: (1) […] }
+layout.svelte:130:13
usage 
Object { models: (1) […] }
+layout.svelte:130:13
usage 
Object { models: (1) […] }
+layout.svelte:130:13
usage 
Object { models: (1) […] }
+layout.svelte:130:13
usage 
Object { models: (1) […] }
+layout.svelte:130:13
usage 
Object { models: (1) […] }
+layout.svelte:130:13
usage 
Object { models: (1) […] }
+layout.svelte:130:13
usage 
Object { models: (1) […] }
+layout.svelte:130:13
controller 
AbortController { signal: AbortSignal }
Chat.svelte:833:11
{"model":"llama3.1:latest","created_at":"2024-08-15T12:27:30.013716Z","message":{"role":"assistant","content":"As"},"done":false} Chat.svelte:862:15
{"model":"llama3.1:latest","created_at":"2024-08-15T12:27:30.0762419Z","message":{"role":"assistant","content":" a"},"done":false} Chat.svelte:862:15
{"model":"llama3.1:latest","created_at":"2024-08-15T12:27:30.1402565Z","message":{"role":"assistant","content":" convers"},"done":false} Chat.svelte:862:15
{"model":"llama3.1:latest","created_at":"2024-08-15T12:27:30.2006807Z","message":{"role":"assistant","content":"ational"},"done":false} Chat.svelte:862:15
{"model":"llama3.1:latest","created_at":"2024-08-15T12:27:30.261802Z","message":{"role":"assistant","content":" AI"},"done":false} Chat.svelte:862:15
{"model":"llama3.1:latest","created_at":"2024-08-15T12:27:30.3271791Z","message":{"role":"assistant","content":","},"done":false} Chat.svelte:862:15
{"model":"llama3.1:latest","created_at":"2024-08-15T12:27:30.3892109Z","message":{"role":"assistant","content":" I"},"done":false} Chat.svelte:862:15
{"model":"llama3.1:latest","created_at":"2024-08-15T12:27:30.4519769Z","message":{"role":"assistant","content":" use"},"done":false} Chat.svelte:862:15
{"model":"llama3.1:latest","created_at":"2024-08-15T12:27:30.5137226Z","message":{"role":"assistant","content":" a"},"done":false} Chat.svelte:862:15
{"model":"llama3.1:latest","created_at":"2024-08-15T12:27:30.5770823Z","message":{"role":"assistant","content":" significant"},"done":false} Chat.svelte:862:15
{"model":"llama3.1:latest","created_at":"2024-08-15T12:27:30.6366461Z","message":{"role":"assistant","content":" amount"},"done":false} Chat.svelte:862:15
{"model":"llama3.1:latest","created_at":"2024-08-15T12:27:30.6994705Z","message":{"role":"assistant","content":" of"},"done":false} Chat.svelte:862:15
{"model":"llama3.1:latest","created_at":"2024-08-15T12:27:30.7624538Z","message":{"role":"assistant","content":" computing"},"done":false} Chat.svelte:862:15
{"model":"llama3.1:latest","created_at":"2024-08-15T12:27:30.8244884Z","message":{"role":"assistant","content":" resources"},"done":false} Chat.svelte:862:15
{"model":"llama3.1:latest","created_at":"2024-08-15T12:27:30.8842064Z","message":{"role":"assistant","content":" to"},"done":false} Chat.svelte:862:15
{"model":"llama3.1:latest","created_at":"2024-08-15T12:27:30.9469078Z","message":{"role":"assistant","content":" process"},"done":false} Chat.svelte:862:15
usage 
Object { models: (1) […] }
+layout.svelte:130:13
{"model":"llama3.1:latest","created_at":"2024-08-15T12:27:31.0091376Z","message":{"role":"assistant","content":" and"},"done":false} Chat.svelte:862:15
{"model":"llama3.1:latest","created_at":"2024-08-15T12:27:31.0713022Z","message":{"role":"assistant","content":" respond"},"done":false} Chat.svelte:862:15
{"model":"llama3.1:latest","created_at":"2024-08-15T12:27:31.1352146Z","message":{"role":"assistant","content":" to"},"done":false} Chat.svelte:862:15
{"model":"llama3.1:latest","created_at":"2024-08-15T12:27:31.1973338Z","message":{"role":"assistant","content":" user"},"done":false} Chat.svelte:862:15
{"model":"llama3.1:latest","created_at":"2024-08-15T12:27:31.258238Z","message":{"role":"assistant","content":" inputs"},"done":false} Chat.svelte:862:15
{"model":"llama3.1:latest","created_at":"2024-08-15T12:27:31.3179661Z","message":{"role":"assistant","content":" like"},"done":false} Chat.svelte:862:15
{"model":"llama3.1:latest","created_at":"2024-08-15T12:27:31.3775835Z","message":{"role":"assistant","content":" our"},"done":false} Chat.svelte:862:15
{"model":"llama3.1:latest","created_at":"2024-08-15T12:27:31.4393179Z","message":{"role":"assistant","content":" conversation"},"done":false} Chat.svelte:862:15
{"model":"llama3.1:latest","created_at":"2024-08-15T12:27:31.4985372Z","message":{"role":"assistant","content":"."},"done":false} Chat.svelte:862:15
{"model":"llama3.1:latest","created_at":"2024-08-15T12:27:31.5600354Z","message":{"role":"assistant","content":" This"},"done":false} Chat.svelte:862:15
{"model":"llama3.1:latest","created_at":"2024-08-15T12:27:31.6237137Z","message":{"role":"assistant","content":" is"},"done":false} Chat.svelte:862:15
{"model":"llama3.1:latest","created_at":"2024-08-15T12:27:31.6837153Z","message":{"role":"assistant","content":" because"},"done":false} Chat.svelte:862:15
{"model":"llama3.1:latest","created_at":"2024-08-15T12:27:31.7466787Z","message":{"role":"assistant","content":":\n\n"},"done":false} Chat.svelte:862:15
{"model":"llama3.1:latest","created_at":"2024-08-15T12:27:31.8075438Z","message":{"role":"assistant","content":"1"},"done":false} Chat.svelte:862:15
{"model":"llama3.1:latest","created_at":"2024-08-15T12:27:31.8672158Z","message":{"role":"assistant","content":"."},"done":false} Chat.svelte:862:15
{"model":"llama3.1:latest","created_at":"2024-08-15T12:27:31.9291608Z","message":{"role":"assistant","content":" **"},"done":false} Chat.svelte:862:15
{"model":"llama3.1:latest","created_at":"2024-08-15T12:27:31.9895124Z","message":{"role":"assistant","content":"Language"},"done":false} Chat.svelte:862:15
usage 
Object { models: (1) […] }
+layout.svelte:130:13
{"model":"llama3.1:latest","created_at":"2024-08-15T12:27:32.0514873Z","message":{"role":"assistant","content":" understanding"},"done":false} Chat.svelte:862:15
{"model":"llama3.1:latest","created_at":"2024-08-15T12:27:32.1166838Z","message":{"role":"assistant","content":"**:"},"done":false} Chat.svelte:862:15
{"model":"llama3.1:latest","created_at":"2024-08-15T12:27:32.1774426Z","message":{"role":"assistant","content":" I"},"done":false} Chat.svelte:862:15
{"model":"llama3.1:latest","created_at":"2024-08-15T12:27:32.2392734Z","message":{"role":"assistant","content":" need"},"done":false} Chat.svelte:862:15
{"model":"llama3.1:latest","created_at":"2024-08-15T12:27:32.3002835Z","message":{"role":"assistant","content":" to"},"done":false} Chat.svelte:862:15
{"model":"llama3.1:latest","created_at":"2024-08-15T12:27:32.3613665Z","message":{"role":"assistant","content":" analyze"},"done":false} Chat.svelte:862:15
{"model":"llama3.1:latest","created_at":"2024-08-15T12:27:32.4211287Z","message":{"role":"assistant","content":" the"},"done":false} Chat.svelte:862:15
{"model":"llama3.1:latest","created_at":"2024-08-15T12:27:32.4819728Z","message":{"role":"assistant","content":" context"},"done":false} Chat.svelte:862:15
{"model":"llama3.1:latest","created_at":"2024-08-15T12:27:32.543073Z","message":{"role":"assistant","content":","},"done":false} Chat.svelte:862:15
{"model":"llama3.1:latest","created_at":"2024-08-15T12:27:32.6043227Z","message":{"role":"assistant","content":" syntax"},"done":false} Chat.svelte:862:15
{"model":"llama3.1:latest","created_at":"2024-08-15T12:27:32.665229Z","message":{"role":"assistant","content":","},"done":false} Chat.svelte:862:15
{"model":"llama3.1:latest","created_at":"2024-08-15T12:27:32.7289042Z","message":{"role":"assistant","content":" and"},"done":false} Chat.svelte:862:15
{"model":"llama3.1:latest","created_at":"2024-08-15T12:27:32.7899397Z","message":{"role":"assistant","content":" semantics"},"done":false} Chat.svelte:862:15
{"model":"llama3.1:latest","created_at":"2024-08-15T12:27:32.8515937Z","message":{"role":"assistant","content":" of"},"done":false} Chat.svelte:862:15
{"model":"llama3.1:latest","created_at":"2024-08-15T12:27:32.9135202Z","message":{"role":"assistant","content":" your"},"done":false} Chat.svelte:862:15
{"model":"llama3.1:latest","created_at":"2024-08-15T12:27:32.973854Z","message":{"role":"assistant","content":" messages"},"done":false} Chat.svelte:862:15
usage 
Object { models: (1) […] }
+layout.svelte:130:13
{"model":"llama3.1:latest","created_at":"2024-08-15T12:27:33.0395712Z","message":{"role":"assistant","content":" to"},"done":false} Chat.svelte:862:15
{"model":"llama3.1:latest","created_at":"2024-08-15T12:27:33.1017984Z","message":{"role":"assistant","content":" understand"},"done":false} Chat.svelte:862:15
{"model":"llama3.1:latest","created_at":"2024-08-15T12:27:33.1744851Z","message":{"role":"assistant","content":" what"},"done":false} Chat.svelte:862:15
{"model":"llama3.1:latest","created_at":"2024-08-15T12:27:33.2362158Z","message":{"role":"assistant","content":" you"},"done":false} Chat.svelte:862:15
{"model":"llama3.1:latest","created_at":"2024-08-15T12:27:33.2960658Z","message":{"role":"assistant","content":"'re"},"done":false} Chat.svelte:862:15
{"model":"llama3.1:latest","created_at":"2024-08-15T12:27:33.3585163Z","message":{"role":"assistant","content":" asking"},"done":false} Chat.svelte:862:15
{"model":"llama3.1:latest","created_at":"2024-08-15T12:27:33.4213981Z","message":{"role":"assistant","content":".\n"},"done":false} Chat.svelte:862:15
{"model":"llama3.1:latest","created_at":"2024-08-15T12:27:33.4822911Z","message":{"role":"assistant","content":"2"},"done":false} Chat.svelte:862:15
{"model":"llama3.1:latest","created_at":"2024-08-15T12:27:33.5433646Z","message":{"role":"assistant","content":"."},"done":false} Chat.svelte:862:15
{"model":"llama3.1:latest","created_at":"2024-08-15T12:27:33.6047685Z","message":{"role":"assistant","content":" **"},"done":false} Chat.svelte:862:15
{"model":"llama3.1:latest","created_at":"2024-08-15T12:27:33.668573Z","message":{"role":"assistant","content":"Knowledge"},"done":false} Chat.svelte:862:15
{"model":"llama3.1:latest","created_at":"2024-08-15T12:27:33.7283299Z","message":{"role":"assistant","content":" retrieval"},"done":false} Chat.svelte:862:15
{"model":"llama3.1:latest","created_at":"2024-08-15T12:27:33.7923352Z","message":{"role":"assistant","content":"**:"},"done":false} Chat.svelte:862:15
{"model":"llama3.1:latest","created_at":"2024-08-15T12:27:33.8524732Z","message":{"role":"assistant","content":" When"},"done":false} Chat.svelte:862:15
{"model":"llama3.1:latest","created_at":"2024-08-15T12:27:33.91213Z","message":{"role":"assistant","content":" answering"},"done":false} Chat.svelte:862:15
{"model":"llama3.1:latest","created_at":"2024-08-15T12:27:33.9740126Z","message":{"role":"assistant","content":" questions"},"done":false} Chat.svelte:862:15
usage 
Object { models: (1) […] }
+layout.svelte:130:13
{"model":"llama3.1:latest","created_at":"2024-08-15T12:27:34.0360014Z","message":{"role":"assistant","content":" or"},"done":false} Chat.svelte:862:15
{"model":"llama3.1:latest","created_at":"2024-08-15T12:27:34.0966802Z","message":{"role":"assistant","content":" providing"},"done":false} Chat.svelte:862:15
{"model":"llama3.1:latest","created_at":"2024-08-15T12:27:34.1595543Z","message":{"role":"assistant","content":" information"},"done":false} Chat.svelte:862:15
{"model":"llama3.1:latest","created_at":"2024-08-15T12:27:34.2240205Z","message":{"role":"assistant","content":","},"done":false} Chat.svelte:862:15
{"model":"llama3.1:latest","created_at":"2024-08-15T12:27:34.2852352Z","message":{"role":"assistant","content":" I"},"done":false} Chat.svelte:862:15
{"model":"llama3.1:latest","created_at":"2024-08-15T12:27:34.3453914Z","message":{"role":"assistant","content":" have"},"done":false} Chat.svelte:862:15
{"model":"llama3.1:latest","created_at":"2024-08-15T12:27:34.4053703Z","message":{"role":"assistant","content":" to"},"done":false} Chat.svelte:862:15
{"model":"llama3.1:latest","created_at":"2024-08-15T12:27:34.4664242Z","message":{"role":"assistant","content":" search"},"done":false} Chat.svelte:862:15
{"model":"llama3.1:latest","created_at":"2024-08-15T12:27:34.5262481Z","message":{"role":"assistant","content":" through"},"done":false} Chat.svelte:862:15
{"model":"llama3.1:latest","created_at":"2024-08-15T12:27:34.5879789Z","message":{"role":"assistant","content":" vast"},"done":false} Chat.svelte:862:15
{"model":"llama3.1:latest","created_at":"2024-08-15T12:27:34.6500452Z","message":{"role":"assistant","content":" amounts"},"done":false} Chat.svelte:862:15
{"model":"llama3.1:latest","created_at":"2024-08-15T12:27:34.7120748Z","message":{"role":"assistant","content":" of"},"done":false} Chat.svelte:862:15
{"model":"llama3.1:latest","created_at":"2024-08-15T12:27:34.7780127Z","message":{"role":"assistant","content":" data"},"done":false} Chat.svelte:862:15
{"model":"llama3.1:latest","created_at":"2024-08-15T12:27:34.839839Z","message":{"role":"assistant","content":","},"done":false} Chat.svelte:862:15
{"model":"llama3.1:latest","created_at":"2024-08-15T12:27:34.9001677Z","message":{"role":"assistant","content":" such"},"done":false} Chat.svelte:862:15
{"model":"llama3.1:latest","created_at":"2024-08-15T12:27:34.961529Z","message":{"role":"assistant","content":" as"},"done":false} Chat.svelte:862:15
{"model":"llama3.1:latest","created_at":"2024-08-15T12:27:35.0227846Z","message":{"role":"assistant","content":" my"},"done":false} Chat.svelte:862:15
usage 
Object { models: (1) […] }
+layout.svelte:130:13
{"model":"llama3.1:latest","created_at":"2024-08-15T12:27:35.0847861Z","message":{"role":"assistant","content":" training"},"done":false} Chat.svelte:862:15
{"model":"llama3.1:latest","created_at":"2024-08-15T12:27:35.146849Z","message":{"role":"assistant","content":" dataset"},"done":false} Chat.svelte:862:15
{"model":"llama3.1:latest","created_at":"2024-08-15T12:27:35.2076656Z","message":{"role":"assistant","content":","},"done":false} Chat.svelte:862:15
{"model":"llama3.1:latest","created_at":"2024-08-15T12:27:35.2728124Z","message":{"role":"assistant","content":" to"},"done":false} Chat.svelte:862:15
{"model":"llama3.1:latest","created_at":"2024-08-15T12:27:35.3332007Z","message":{"role":"assistant","content":" find"},"done":false} Chat.svelte:862:15
{"model":"llama3.1:latest","created_at":"2024-08-15T12:27:35.3948021Z","message":{"role":"assistant","content":" relevant"},"done":false} Chat.svelte:862:15
{"model":"llama3.1:latest","created_at":"2024-08-15T12:27:35.4564203Z","message":{"role":"assistant","content":" responses"},"done":false} Chat.svelte:862:15
{"model":"llama3.1:latest","created_at":"2024-08-15T12:27:35.5150691Z","message":{"role":"assistant","content":".\n"},"done":false} Chat.svelte:862:15
{"model":"llama3.1:latest","created_at":"2024-08-15T12:27:35.5777179Z","message":{"role":"assistant","content":"3"},"done":false} Chat.svelte:862:15
{"model":"llama3.1:latest","created_at":"2024-08-15T12:27:35.6379343Z","message":{"role":"assistant","content":"."},"done":false} Chat.svelte:862:15
{"model":"llama3.1:latest","created_at":"2024-08-15T12:27:35.6978614Z","message":{"role":"assistant","content":" **"},"done":false} Chat.svelte:862:15
{"model":"llama3.1:latest","created_at":"2024-08-15T12:27:35.7626508Z","message":{"role":"assistant","content":"Text"},"done":false} Chat.svelte:862:15
{"model":"llama3.1:latest","created_at":"2024-08-15T12:27:35.8246818Z","message":{"role":"assistant","content":" generation"},"done":false} Chat.svelte:862:15
{"model":"llama3.1:latest","created_at":"2024-08-15T12:27:35.8850396Z","message":{"role":"assistant","content":"**:"},"done":false} Chat.svelte:862:15
{"model":"llama3.1:latest","created_at":"2024-08-15T12:27:35.9464147Z","message":{"role":"assistant","content":" Crafting"},"done":false} Chat.svelte:862:15
{"model":"llama3.1:latest","created_at":"2024-08-15T12:27:36.0064414Z","message":{"role":"assistant","content":" a"},"done":false} Chat.svelte:862:15
usage 
Object { models: (1) […] }
+layout.svelte:130:13
{"model":"llama3.1:latest","created_at":"2024-08-15T12:27:36.0683452Z","message":{"role":"assistant","content":" response"},"done":false} Chat.svelte:862:15
{"model":"llama3.1:latest","created_at":"2024-08-15T12:27:36.1313823Z","message":{"role":"assistant","content":" requires"},"done":false} Chat.svelte:862:15
{"model":"llama3.1:latest","created_at":"2024-08-15T12:27:36.1930541Z","message":{"role":"assistant","content":" generating"},"done":false} Chat.svelte:862:15
{"model":"llama3.1:latest","created_at":"2024-08-15T12:27:36.2544313Z","message":{"role":"assistant","content":" text"},"done":false} Chat.svelte:862:15
{"model":"llama3.1:latest","created_at":"2024-08-15T12:27:36.3185841Z","message":{"role":"assistant","content":" based"},"done":false} Chat.svelte:862:15
{"model":"llama3.1:latest","created_at":"2024-08-15T12:27:36.3803586Z","message":{"role":"assistant","content":" on"},"done":false} Chat.svelte:862:15
{"model":"llama3.1:latest","created_at":"2024-08-15T12:27:36.4408833Z","message":{"role":"assistant","content":" the"},"done":false} Chat.svelte:862:15
{"model":"llama3.1:latest","created_at":"2024-08-15T12:27:36.5015119Z","message":{"role":"assistant","content":" conversation"},"done":false} Chat.svelte:862:15
{"model":"llama3.1:latest","created_at":"2024-08-15T12:27:36.5647445Z","message":{"role":"assistant","content":"'s"},"done":false} Chat.svelte:862:15
{"model":"llama3.1:latest","created_at":"2024-08-15T12:27:36.6295069Z","message":{"role":"assistant","content":" context"},"done":false} Chat.svelte:862:15
{"model":"llama3.1:latest","created_at":"2024-08-15T12:27:36.6933122Z","message":{"role":"assistant","content":","},"done":false} Chat.svelte:862:15
{"model":"llama3.1:latest","created_at":"2024-08-15T12:27:36.7567013Z","message":{"role":"assistant","content":" which"},"done":false} Chat.svelte:862:15
{"model":"llama3.1:latest","created_at":"2024-08-15T12:27:36.8193919Z","message":{"role":"assistant","content":" can"},"done":false} Chat.svelte:862:15
{"model":"llama3.1:latest","created_at":"2024-08-15T12:27:36.8823489Z","message":{"role":"assistant","content":" be"},"done":false} Chat.svelte:862:15
{"model":"llama3.1:latest","created_at":"2024-08-15T12:27:36.942398Z","message":{"role":"assistant","content":" comput"},"done":false} Chat.svelte:862:15
{"model":"llama3.1:latest","created_at":"2024-08-15T12:27:37.0037645Z","message":{"role":"assistant","content":"ationally"},"done":false} Chat.svelte:862:15
{"model":"llama3.1:latest","created_at":"2024-08-15T12:27:37.0641803Z","message":{"role":"assistant","content":" intensive"},"done":false} Chat.svelte:862:15
usage 
Object { models: (1) […] }
+layout.svelte:130:13
{"model":"llama3.1:latest","created_at":"2024-08-15T12:27:37.1269088Z","message":{"role":"assistant","content":".\n\n"},"done":false} Chat.svelte:862:15
{"model":"llama3.1:latest","created_at":"2024-08-15T12:27:37.1887474Z","message":{"role":"assistant","content":"To"},"done":false} Chat.svelte:862:15
{"model":"llama3.1:latest","created_at":"2024-08-15T12:27:37.2496734Z","message":{"role":"assistant","content":" give"},"done":false} Chat.svelte:862:15
{"model":"llama3.1:latest","created_at":"2024-08-15T12:27:37.3125493Z","message":{"role":"assistant","content":" you"},"done":false} Chat.svelte:862:15
{"model":"llama3.1:latest","created_at":"2024-08-15T12:27:37.3746114Z","message":{"role":"assistant","content":" an"},"done":false} Chat.svelte:862:15
{"model":"llama3.1:latest","created_at":"2024-08-15T12:27:37.4397231Z","message":{"role":"assistant","content":" idea"},"done":false} Chat.svelte:862:15
{"model":"llama3.1:latest","created_at":"2024-08-15T12:27:37.5021763Z","message":{"role":"assistant","content":","},"done":false} Chat.svelte:862:15
{"model":"llama3.1:latest","created_at":"2024-08-15T12:27:37.5627345Z","message":{"role":"assistant","content":" here"},"done":false} Chat.svelte:862:15
{"model":"llama3.1:latest","created_at":"2024-08-15T12:27:37.6221319Z","message":{"role":"assistant","content":" are"},"done":false} Chat.svelte:862:15
{"model":"llama3.1:latest","created_at":"2024-08-15T12:27:37.6840372Z","message":{"role":"assistant","content":" some"},"done":false} Chat.svelte:862:15
{"model":"llama3.1:latest","created_at":"2024-08-15T12:27:37.7459143Z","message":{"role":"assistant","content":" rough"},"done":false} Chat.svelte:862:15
{"model":"llama3.1:latest","created_at":"2024-08-15T12:27:37.8093514Z","message":{"role":"assistant","content":" estimates"},"done":false} Chat.svelte:862:15
{"model":"llama3.1:latest","created_at":"2024-08-15T12:27:37.8729836Z","message":{"role":"assistant","content":":\n\n"},"done":false} Chat.svelte:862:15
{"model":"llama3.1:latest","created_at":"2024-08-15T12:27:37.9357305Z","message":{"role":"assistant","content":"*"},"done":false} Chat.svelte:862:15
{"model":"llama3.1:latest","created_at":"2024-08-15T12:27:38.0010555Z","message":{"role":"assistant","content":" Processing"},"done":false} Chat.svelte:862:15
usage 
Object { models: (1) […] }
+layout.svelte:130:13
{"model":"llama3.1:latest","created_at":"2024-08-15T12:27:38.0645656Z","message":{"role":"assistant","content":" a"},"done":false} Chat.svelte:862:15
{"model":"llama3.1:latest","created_at":"2024-08-15T12:27:38.130691Z","message":{"role":"assistant","content":" single"},"done":false} Chat.svelte:862:15
{"model":"llama3.1:latest","created_at":"2024-08-15T12:27:38.1954037Z","message":{"role":"assistant","content":" message"},"done":false} Chat.svelte:862:15
{"model":"llama3.1:latest","created_at":"2024-08-15T12:27:38.2562553Z","message":{"role":"assistant","content":" can"},"done":false} Chat.svelte:862:15
{"model":"llama3.1:latest","created_at":"2024-08-15T12:27:38.3211322Z","message":{"role":"assistant","content":" take"},"done":false} Chat.svelte:862:15
{"model":"llama3.1:latest","created_at":"2024-08-15T12:27:38.3826946Z","message":{"role":"assistant","content":" around"},"done":false} Chat.svelte:862:15
{"model":"llama3.1:latest","created_at":"2024-08-15T12:27:38.4458393Z","message":{"role":"assistant","content":" "},"done":false} Chat.svelte:862:15
{"model":"llama3.1:latest","created_at":"2024-08-15T12:27:38.5076822Z","message":{"role":"assistant","content":"1"},"done":false} Chat.svelte:862:15
{"model":"llama3.1:latest","created_at":"2024-08-15T12:27:38.5678822Z","message":{"role":"assistant","content":"-"},"done":false} Chat.svelte:862:15
{"model":"llama3.1:latest","created_at":"2024-08-15T12:27:38.6307299Z","message":{"role":"assistant","content":"5"},"done":false} Chat.svelte:862:15
{"model":"llama3.1:latest","created_at":"2024-08-15T12:27:38.6934234Z","message":{"role":"assistant","content":" milliseconds"},"done":false} Chat.svelte:862:15
{"model":"llama3.1:latest","created_at":"2024-08-15T12:27:38.7551117Z","message":{"role":"assistant","content":" ("},"done":false} Chat.svelte:862:15
{"model":"llama3.1:latest","created_at":"2024-08-15T12:27:38.8161174Z","message":{"role":"assistant","content":"depending"},"done":false} Chat.svelte:862:15
{"model":"llama3.1:latest","created_at":"2024-08-15T12:27:38.8787873Z","message":{"role":"assistant","content":" on"},"done":false} Chat.svelte:862:15
{"model":"llama3.1:latest","created_at":"2024-08-15T12:27:38.9411353Z","message":{"role":"assistant","content":" complexity"},"done":false} Chat.svelte:862:15
{"model":"llama3.1:latest","created_at":"2024-08-15T12:27:39.0012262Z","message":{"role":"assistant","content":")\n"},"done":false} Chat.svelte:862:15
usage 
Object { models: (1) […] }
+layout.svelte:130:13
{"model":"llama3.1:latest","created_at":"2024-08-15T12:27:39.0627323Z","message":{"role":"assistant","content":"*"},"done":false} Chat.svelte:862:15
{"model":"llama3.1:latest","created_at":"2024-08-15T12:27:39.12634Z","message":{"role":"assistant","content":" Access"},"done":false} Chat.svelte:862:15
{"model":"llama3.1:latest","created_at":"2024-08-15T12:27:39.1872918Z","message":{"role":"assistant","content":"ing"},"done":false} Chat.svelte:862:15
{"model":"llama3.1:latest","created_at":"2024-08-15T12:27:39.2474112Z","message":{"role":"assistant","content":" and"},"done":false} Chat.svelte:862:15
{"model":"llama3.1:latest","created_at":"2024-08-15T12:27:39.3092011Z","message":{"role":"assistant","content":" processing"},"done":false} Chat.svelte:862:15
{"model":"llama3.1:latest","created_at":"2024-08-15T12:27:39.3700856Z","message":{"role":"assistant","content":" large"},"done":false} Chat.svelte:862:15
{"model":"llama3.1:latest","created_at":"2024-08-15T12:27:39.4320018Z","message":{"role":"assistant","content":" datasets"},"done":false} Chat.svelte:862:15
{"model":"llama3.1:latest","created_at":"2024-08-15T12:27:39.4947853Z","message":{"role":"assistant","content":" for"},"done":false} Chat.svelte:862:15
{"model":"llama3.1:latest","created_at":"2024-08-15T12:27:39.5558812Z","message":{"role":"assistant","content":" knowledge"},"done":false} Chat.svelte:862:15
{"model":"llama3.1:latest","created_at":"2024-08-15T12:27:39.6169845Z","message":{"role":"assistant","content":" retrieval"},"done":false} Chat.svelte:862:15
{"model":"llama3.1:latest","created_at":"2024-08-15T12:27:39.6781413Z","message":{"role":"assistant","content":" can"},"done":false} Chat.svelte:862:15
{"model":"llama3.1:latest","created_at":"2024-08-15T12:27:39.7412249Z","message":{"role":"assistant","content":" add"},"done":false} Chat.svelte:862:15
{"model":"llama3.1:latest","created_at":"2024-08-15T12:27:39.8029085Z","message":{"role":"assistant","content":" up"},"done":false} Chat.svelte:862:15
{"model":"llama3.1:latest","created_at":"2024-08-15T12:27:39.8651027Z","message":{"role":"assistant","content":" to"},"done":false} Chat.svelte:862:15
{"model":"llama3.1:latest","created_at":"2024-08-15T12:27:39.9281707Z","message":{"role":"assistant","content":" tens"},"done":false} Chat.svelte:862:15
{"model":"llama3.1:latest","created_at":"2024-08-15T12:27:39.9900588Z","message":{"role":"assistant","content":" or"},"done":false} Chat.svelte:862:15
{"model":"llama3.1:latest","created_at":"2024-08-15T12:27:40.0511999Z","message":{"role":"assistant","content":" hundreds"},"done":false} Chat.svelte:862:15
usage 
Object { models: (1) […] }
+layout.svelte:130:13
{"model":"llama3.1:latest","created_at":"2024-08-15T12:27:40.1139543Z","message":{"role":"assistant","content":" of"},"done":false} Chat.svelte:862:15
{"model":"llama3.1:latest","created_at":"2024-08-15T12:27:40.1750802Z","message":{"role":"assistant","content":" milliseconds"},"done":false} Chat.svelte:862:15
{"model":"llama3.1:latest","created_at":"2024-08-15T12:27:40.2353322Z","message":{"role":"assistant","content":"\n"},"done":false} Chat.svelte:862:15
{"model":"llama3.1:latest","created_at":"2024-08-15T12:27:40.2960094Z","message":{"role":"assistant","content":"*"},"done":false} Chat.svelte:862:15
{"model":"llama3.1:latest","created_at":"2024-08-15T12:27:40.3584292Z","message":{"role":"assistant","content":" Generating"},"done":false} Chat.svelte:862:15
{"model":"llama3.1:latest","created_at":"2024-08-15T12:27:40.4213404Z","message":{"role":"assistant","content":" text"},"done":false} Chat.svelte:862:15
{"model":"llama3.1:latest","created_at":"2024-08-15T12:27:40.4822954Z","message":{"role":"assistant","content":" responses"},"done":false} Chat.svelte:862:15
{"model":"llama3.1:latest","created_at":"2024-08-15T12:27:40.5446188Z","message":{"role":"assistant","content":" can"},"done":false} Chat.svelte:862:15
{"model":"llama3.1:latest","created_at":"2024-08-15T12:27:40.6055189Z","message":{"role":"assistant","content":" consume"},"done":false} Chat.svelte:862:15
{"model":"llama3.1:latest","created_at":"2024-08-15T12:27:40.6662788Z","message":{"role":"assistant","content":" even"},"done":false} Chat.svelte:862:15
{"model":"llama3.1:latest","created_at":"2024-08-15T12:27:40.7294373Z","message":{"role":"assistant","content":" more"},"done":false} Chat.svelte:862:15
{"model":"llama3.1:latest","created_at":"2024-08-15T12:27:40.790157Z","message":{"role":"assistant","content":" resources"},"done":false} Chat.svelte:862:15
{"model":"llama3.1:latest","created_at":"2024-08-15T12:27:40.8518948Z","message":{"role":"assistant","content":","},"done":false} Chat.svelte:862:15
{"model":"llama3.1:latest","created_at":"2024-08-15T12:27:40.9138657Z","message":{"role":"assistant","content":" potentially"},"done":false} Chat.svelte:862:15
{"model":"llama3.1:latest","created_at":"2024-08-15T12:27:40.9747827Z","message":{"role":"assistant","content":" taking"},"done":false} Chat.svelte:862:15
{"model":"llama3.1:latest","created_at":"2024-08-15T12:27:41.0353838Z","message":{"role":"assistant","content":" longer"},"done":false} Chat.svelte:862:15
usage 
Object { models: (1) […] }
+layout.svelte:130:13
{"model":"llama3.1:latest","created_at":"2024-08-15T12:27:41.0970856Z","message":{"role":"assistant","content":" than"},"done":false} Chat.svelte:862:15
{"model":"llama3.1:latest","created_at":"2024-08-15T12:27:41.1597531Z","message":{"role":"assistant","content":" the"},"done":false} Chat.svelte:862:15
{"model":"llama3.1:latest","created_at":"2024-08-15T12:27:41.2231477Z","message":{"role":"assistant","content":" above"},"done":false} Chat.svelte:862:15
{"model":"llama3.1:latest","created_at":"2024-08-15T12:27:41.2851275Z","message":{"role":"assistant","content":" steps"},"done":false} Chat.svelte:862:15
{"model":"llama3.1:latest","created_at":"2024-08-15T12:27:41.348124Z","message":{"role":"assistant","content":" combined"},"done":false} Chat.svelte:862:15
{"model":"llama3.1:latest","created_at":"2024-08-15T12:27:41.4122322Z","message":{"role":"assistant","content":"\n\n"},"done":false} Chat.svelte:862:15
{"model":"llama3.1:latest","created_at":"2024-08-15T12:27:41.4733631Z","message":{"role":"assistant","content":"These"},"done":false} Chat.svelte:862:15
{"model":"llama3.1:latest","created_at":"2024-08-15T12:27:41.5371471Z","message":{"role":"assistant","content":" computations"},"done":false} Chat.svelte:862:15
{"model":"llama3.1:latest","created_at":"2024-08-15T12:27:41.6006251Z","message":{"role":"assistant","content":" are"},"done":false} Chat.svelte:862:15
{"model":"llama3.1:latest","created_at":"2024-08-15T12:27:41.6652774Z","message":{"role":"assistant","content":" usually"},"done":false} Chat.svelte:862:15
{"model":"llama3.1:latest","created_at":"2024-08-15T12:27:41.7296308Z","message":{"role":"assistant","content":" done"},"done":false} Chat.svelte:862:15
{"model":"llama3.1:latest","created_at":"2024-08-15T12:27:41.7924326Z","message":{"role":"assistant","content":" on"},"done":false} Chat.svelte:862:15
{"model":"llama3.1:latest","created_at":"2024-08-15T12:27:41.856117Z","message":{"role":"assistant","content":" remote"},"done":false} Chat.svelte:862:15
{"model":"llama3.1:latest","created_at":"2024-08-15T12:27:41.9189016Z","message":{"role":"assistant","content":" servers"},"done":false} Chat.svelte:862:15
{"model":"llama3.1:latest","created_at":"2024-08-15T12:27:41.9827983Z","message":{"role":"assistant","content":","},"done":false} Chat.svelte:862:15
{"model":"llama3.1:latest","created_at":"2024-08-15T12:27:42.0438284Z","message":{"role":"assistant","content":" which"},"done":false} Chat.svelte:862:15
usage 
Object { models: (1) […] }
+layout.svelte:130:13
{"model":"llama3.1:latest","created_at":"2024-08-15T12:27:42.1060931Z","message":{"role":"assistant","content":" are"},"done":false} Chat.svelte:862:15
{"model":"llama3.1:latest","created_at":"2024-08-15T12:27:42.1683093Z","message":{"role":"assistant","content":" designed"},"done":false} Chat.svelte:862:15
{"model":"llama3.1:latest","created_at":"2024-08-15T12:27:42.2285679Z","message":{"role":"assistant","content":" to"},"done":false} Chat.svelte:862:15
{"model":"llama3.1:latest","created_at":"2024-08-15T12:27:42.2893661Z","message":{"role":"assistant","content":" handle"},"done":false} Chat.svelte:862:15
{"model":"llama3.1:latest","created_at":"2024-08-15T12:27:42.350453Z","message":{"role":"assistant","content":" multiple"},"done":false} Chat.svelte:862:15
{"model":"llama3.1:latest","created_at":"2024-08-15T12:27:42.4130544Z","message":{"role":"assistant","content":" requests"},"done":false} Chat.svelte:862:15
{"model":"llama3.1:latest","created_at":"2024-08-15T12:27:42.4742198Z","message":{"role":"assistant","content":" simultaneously"},"done":false} Chat.svelte:862:15
{"model":"llama3.1:latest","created_at":"2024-08-15T12:27:42.5361236Z","message":{"role":"assistant","content":"."},"done":false} Chat.svelte:862:15
{"model":"llama3.1:latest","created_at":"2024-08-15T12:27:42.5972138Z","message":{"role":"assistant","content":" However"},"done":false} Chat.svelte:862:15
{"model":"llama3.1:latest","created_at":"2024-08-15T12:27:42.6639927Z","message":{"role":"assistant","content":","},"done":false} Chat.svelte:862:15
{"model":"llama3.1:latest","created_at":"2024-08-15T12:27:42.7263844Z","message":{"role":"assistant","content":" if"},"done":false} Chat.svelte:862:15
{"model":"llama3.1:latest","created_at":"2024-08-15T12:27:42.7871458Z","message":{"role":"assistant","content":" there"},"done":false} Chat.svelte:862:15
{"model":"llama3.1:latest","created_at":"2024-08-15T12:27:42.8490228Z","message":{"role":"assistant","content":"'s"},"done":false} Chat.svelte:862:15
{"model":"llama3.1:latest","created_at":"2024-08-15T12:27:42.9086006Z","message":{"role":"assistant","content":" an"},"done":false} Chat.svelte:862:15
{"model":"llama3.1:latest","created_at":"2024-08-15T12:27:42.9724504Z","message":{"role":"assistant","content":" overwhelming"},"done":false} Chat.svelte:862:15
{"model":"llama3.1:latest","created_at":"2024-08-15T12:27:43.0328453Z","message":{"role":"assistant","content":" surge"},"done":false} Chat.svelte:862:15
{"model":"llama3.1:latest","created_at":"2024-08-15T12:27:43.0927746Z","message":{"role":"assistant","content":" in"},"done":false} Chat.svelte:862:15
usage 
Object { models: (1) […] }
+layout.svelte:130:13
{"model":"llama3.1:latest","created_at":"2024-08-15T12:27:43.1558914Z","message":{"role":"assistant","content":" traffic"},"done":false} Chat.svelte:862:15
{"model":"llama3.1:latest","created_at":"2024-08-15T12:27:43.2169829Z","message":{"role":"assistant","content":" ("},"done":false} Chat.svelte:862:15
{"model":"llama3.1:latest","created_at":"2024-08-15T12:27:43.2770958Z","message":{"role":"assistant","content":"like"},"done":false} Chat.svelte:862:15
{"model":"llama3.1:latest","created_at":"2024-08-15T12:27:43.3392113Z","message":{"role":"assistant","content":" during"},"done":false} Chat.svelte:862:15
{"model":"llama3.1:latest","created_at":"2024-08-15T12:27:43.3987346Z","message":{"role":"assistant","content":" a"},"done":false} Chat.svelte:862:15
{"model":"llama3.1:latest","created_at":"2024-08-15T12:27:43.4607152Z","message":{"role":"assistant","content":" global"},"done":false} Chat.svelte:862:15
{"model":"llama3.1:latest","created_at":"2024-08-15T12:27:43.5207846Z","message":{"role":"assistant","content":" crisis"},"done":false} Chat.svelte:862:15
{"model":"llama3.1:latest","created_at":"2024-08-15T12:27:43.5818753Z","message":{"role":"assistant","content":" or"},"done":false} Chat.svelte:862:15
{"model":"llama3.1:latest","created_at":"2024-08-15T12:27:43.6446029Z","message":{"role":"assistant","content":" when"},"done":false} Chat.svelte:862:15
{"model":"llama3.1:latest","created_at":"2024-08-15T12:27:43.7050335Z","message":{"role":"assistant","content":" I"},"done":false} Chat.svelte:862:15
{"model":"llama3.1:latest","created_at":"2024-08-15T12:27:43.7704873Z","message":{"role":"assistant","content":"'m"},"done":false} Chat.svelte:862:15
{"model":"llama3.1:latest","created_at":"2024-08-15T12:27:43.8320445Z","message":{"role":"assistant","content":" handling"},"done":false} Chat.svelte:862:15
{"model":"llama3.1:latest","created_at":"2024-08-15T12:27:43.8921448Z","message":{"role":"assistant","content":" a"},"done":false} Chat.svelte:862:15
{"model":"llama3.1:latest","created_at":"2024-08-15T12:27:43.9558501Z","message":{"role":"assistant","content":" large"},"done":false} Chat.svelte:862:15
{"model":"llama3.1:latest","created_at":"2024-08-15T12:27:44.0172965Z","message":{"role":"assistant","content":" influx"},"done":false} Chat.svelte:862:15
{"model":"llama3.1:latest","created_at":"2024-08-15T12:27:44.0774426Z","message":{"role":"assistant","content":" of"},"done":false} Chat.svelte:862:15
usage 
Object { models: (1) […] }
+layout.svelte:130:13
{"model":"llama3.1:latest","created_at":"2024-08-15T12:27:44.1402125Z","message":{"role":"assistant","content":" conversations"},"done":false} Chat.svelte:862:15
{"model":"llama3.1:latest","created_at":"2024-08-15T12:27:44.2022195Z","message":{"role":"assistant","content":"),"},"done":false} Chat.svelte:862:15
{"model":"llama3.1:latest","created_at":"2024-08-15T12:27:44.2639268Z","message":{"role":"assistant","content":" my"},"done":false} Chat.svelte:862:15
{"model":"llama3.1:latest","created_at":"2024-08-15T12:27:44.32213Z","message":{"role":"assistant","content":" resource"},"done":false} Chat.svelte:862:15
{"model":"llama3.1:latest","created_at":"2024-08-15T12:27:44.3831763Z","message":{"role":"assistant","content":" usage"},"done":false} Chat.svelte:862:15
{"model":"llama3.1:latest","created_at":"2024-08-15T12:27:44.4459858Z","message":{"role":"assistant","content":" might"},"done":false} Chat.svelte:862:15
{"model":"llama3.1:latest","created_at":"2024-08-15T12:27:44.5064235Z","message":{"role":"assistant","content":" increase"},"done":false} Chat.svelte:862:15
{"model":"llama3.1:latest","created_at":"2024-08-15T12:27:44.5678407Z","message":{"role":"assistant","content":".\n\n"},"done":false} Chat.svelte:862:15
{"model":"llama3.1:latest","created_at":"2024-08-15T12:27:44.629062Z","message":{"role":"assistant","content":"If"},"done":false} Chat.svelte:862:15
{"model":"llama3.1:latest","created_at":"2024-08-15T12:27:44.6894683Z","message":{"role":"assistant","content":" you"},"done":false} Chat.svelte:862:15
{"model":"llama3.1:latest","created_at":"2024-08-15T12:27:44.7513221Z","message":{"role":"assistant","content":" ever"},"done":false} Chat.svelte:862:15
{"model":"llama3.1:latest","created_at":"2024-08-15T12:27:44.8163573Z","message":{"role":"assistant","content":" notice"},"done":false} Chat.svelte:862:15
{"model":"llama3.1:latest","created_at":"2024-08-15T12:27:44.8796781Z","message":{"role":"assistant","content":" me"},"done":false} Chat.svelte:862:15
{"model":"llama3.1:latest","created_at":"2024-08-15T12:27:44.9409914Z","message":{"role":"assistant","content":" being"},"done":false} Chat.svelte:862:15
{"model":"llama3.1:latest","created_at":"2024-08-15T12:27:45.0031091Z","message":{"role":"assistant","content":" slow"},"done":false} Chat.svelte:862:15
{"model":"llama3.1:latest","created_at":"2024-08-15T12:27:45.0648669Z","message":{"role":"assistant","content":" or"},"done":false} Chat.svelte:862:15
{"model":"llama3.1:latest","created_at":"2024-08-15T12:27:45.1275613Z","message":{"role":"assistant","content":" struggling"},"done":false} Chat.svelte:862:15
usage 
Object { models: (1) […] }
+layout.svelte:130:13
{"model":"llama3.1:latest","created_at":"2024-08-15T12:27:45.190333Z","message":{"role":"assistant","content":" to"},"done":false} Chat.svelte:862:15
{"model":"llama3.1:latest","created_at":"2024-08-15T12:27:45.2524761Z","message":{"role":"assistant","content":" respond"},"done":false} Chat.svelte:862:15
{"model":"llama3.1:latest","created_at":"2024-08-15T12:27:45.3124534Z","message":{"role":"assistant","content":","},"done":false} Chat.svelte:862:15
{"model":"llama3.1:latest","created_at":"2024-08-15T12:27:45.3754144Z","message":{"role":"assistant","content":" it"},"done":false} Chat.svelte:862:15
{"model":"llama3.1:latest","created_at":"2024-08-15T12:27:45.4363297Z","message":{"role":"assistant","content":"'s"},"done":false} Chat.svelte:862:15
{"model":"llama3.1:latest","created_at":"2024-08-15T12:27:45.4999298Z","message":{"role":"assistant","content":" likely"},"done":false} Chat.svelte:862:15
{"model":"llama3.1:latest","created_at":"2024-08-15T12:27:45.5608112Z","message":{"role":"assistant","content":" due"},"done":false} Chat.svelte:862:15
{"model":"llama3.1:latest","created_at":"2024-08-15T12:27:45.6198082Z","message":{"role":"assistant","content":" to"},"done":false} Chat.svelte:862:15
{"model":"llama3.1:latest","created_at":"2024-08-15T12:27:45.6817297Z","message":{"role":"assistant","content":" these"},"done":false} Chat.svelte:862:15
{"model":"llama3.1:latest","created_at":"2024-08-15T12:27:45.7435682Z","message":{"role":"assistant","content":" factors"},"done":false} Chat.svelte:862:15
{"model":"llama3.1:latest","created_at":"2024-08-15T12:27:45.806422Z","message":{"role":"assistant","content":"!"},"done":false} Chat.svelte:862:15
{"model":"llama3.1:latest","created_at":"2024-08-15T12:27:45.8706206Z","message":{"role":"assistant","content":""},"done_reason":"stop","done":true,"total_duration":28009254000,"load_duration":8597506300,"prompt_eval_count":65,"prompt_eval_duration":3542382000,"eval_count":257,"eval_duration":15856827000} Chat.svelte:862:15
usage 
Object { models: [] }
+layout.svelte:130:13
Wake Lock released +layout.svelte:69:13

[Include relevant browser console logs, if applicable]

Docker Container Logs:

Loading WEBUI_SECRET_KEY from file, not provided as an environment variable.
Loading WEBUI_SECRET_KEY from .webui_secret_key
USER_AGENT environment variable not set, consider setting it to identify your requests.
INFO:     Started server process [1]
INFO:     Waiting for application startup.
/app

  ___                    __        __   _     _   _ ___
 / _ \ _ __   ___ _ __   \ \      / /__| |__ | | | |_ _|
| | | | '_ \ / _ \ '_ \   \ \ /\ / / _ \ '_ \| | | || |
| |_| | |_) |  __/ | | |   \ V  V /  __/ |_) | |_| || |
 \___/| .__/ \___|_| |_|    \_/\_/ \___|_.__/ \___/|___|
      |_|


v0.3.12 - building the best open-source AI user interface.

https://github.com/open-webui/open-webui

INFO  [alembic.runtime.migration] Context impl SQLiteImpl.
INFO  [alembic.runtime.migration] Will assume non-transactional DDL.
INFO:     Application startup complete.
INFO:     Uvicorn running on http://0.0.0.0:8080 (Press CTRL+C to quit)
INFO  [apps.ollama.main] get_all_models()
INFO:     172.17.0.1:54132 - "GET /ws/socket.io/?EIO=4&transport=polling&t=P5M0I5X HTTP/1.1" 200 OK
user [REDACTED](1df0ae1f-2347-4869-ae48-3e84d248d7a0) connected with session ID nlKRfftnWkg0MefDAAAB
INFO:     172.17.0.1:54136 - "POST /ws/socket.io/?EIO=4&transport=polling&t=P5M0I61&sid=2ht_4XadLPUeR4kFAAAA HTTP/1.1" 200 OK
INFO:     172.17.0.1:54150 - "GET /ws/socket.io/?EIO=4&transport=polling&t=P5M0I62&sid=2ht_4XadLPUeR4kFAAAA HTTP/1.1" 200 OK
INFO:     ('172.17.0.1', 54168) - "WebSocket /ws/socket.io/?EIO=4&transport=websocket&sid=2ht_4XadLPUeR4kFAAAA" [accepted]
INFO:     connection open
INFO:     172.17.0.1:54156 - "GET /ws/socket.io/?EIO=4&transport=polling&t=P5M0I6P&sid=2ht_4XadLPUeR4kFAAAA HTTP/1.1" 200 OK
INFO:     172.17.0.1:58806 - "GET /api/v1/users/user/settings HTTP/1.1" 200 OK
INFO:     172.17.0.1:58810 - "GET /api/v1/users/user/settings HTTP/1.1" 200 OK
INFO:     172.17.0.1:52356 - "POST /api/v1/chats/new HTTP/1.1" 200 OK
INFO:     172.17.0.1:52358 - "GET /api/v1/chats/?page=1 HTTP/1.1" 200 OK
INFO  [apps.ollama.main] url: http://192.168.50.10:11434
INFO:     172.17.0.1:52368 - "POST /ollama/api/chat HTTP/1.1" 200 OK
INFO:     172.17.0.1:47000 - "POST /api/chat/completed HTTP/1.1" 200 OK
INFO:     172.17.0.1:47006 - "POST /api/v1/chats/dcd7198d-4369-44a5-bafa-7c3cfdd3eb70 HTTP/1.1" 200 OK
INFO:     172.17.0.1:47022 - "GET /api/v1/chats/?page=1 HTTP/1.1" 200 OK
INFO:     172.17.0.1:47034 - "POST /api/v1/chats/dcd7198d-4369-44a5-bafa-7c3cfdd3eb70 HTTP/1.1" 200 OK
INFO:     172.17.0.1:47040 - "GET /api/v1/chats/?page=1 HTTP/1.1" 200 OK
INFO  [apps.ollama.main] url: http://192.168.50.10:11434
generate_title
llama3.1:latest
generate_ollama_chat_completion
INFO:     172.17.0.1:47046 - "POST /api/task/title/completions HTTP/1.1" 200 OK
INFO:     172.17.0.1:47060 - "POST /api/v1/chats/dcd7198d-4369-44a5-bafa-7c3cfdd3eb70 HTTP/1.1" 200 OK
INFO:     172.17.0.1:47062 - "GET /api/v1/chats/?page=1 HTTP/1.1" 200 OK
INFO:     172.17.0.1:47074 - "GET /api/v1/chats/?page=1 HTTP/1.1" 200 OK
INFO  [apps.ollama.main] url: http://192.168.50.10:11434
['nlKRfftnWkg0MefDAAAB']
INFO:     172.17.0.1:46196 - "POST /ollama/api/chat HTTP/1.1" 200 OK
INFO:     172.17.0.1:33698 - "POST /api/chat/completed HTTP/1.1" 200 OK
INFO:     172.17.0.1:33700 - "POST /api/v1/chats/dcd7198d-4369-44a5-bafa-7c3cfdd3eb70 HTTP/1.1" 200 OK
INFO:     172.17.0.1:33710 - "GET /api/v1/chats/?page=1 HTTP/1.1" 200 OK
INFO:     172.17.0.1:33712 - "POST /api/v1/chats/dcd7198d-4369-44a5-bafa-7c3cfdd3eb70 HTTP/1.1" 200 OK
INFO:     172.17.0.1:33724 - "GET /api/v1/chats/?page=1 HTTP/1.1" 200 OK
INFO:     172.17.0.1:33730 - "GET /api/v1/chats/?page=1 HTTP/1.1" 200 OK

Screenshots/Screen Recordings (if applicable):
See above

Additional Information

N/A

Originally created by @TheSeraph on GitHub (Aug 15, 2024). # Bug Report ## Installation Method Home gaming PC running virtualbox & ollama server. Open-WebUI is running as a docker container on a VM in virtualbox, reverse proxied by Nginx, and alongside a set of docker containers for n8n. Ollama is runnign on the host machine, which has all the Compute resources (CPU, RAM, VRAM) that is being affected by the memory leak ## Environment - **Open WebUI**: v0.3.12 in docker container, on Ubuntu 24.04 LTS VM - **Ollama** v0.4.3 on Windows 10 Pro (Host) - **Operating System:** Win 10 Pro + Ubuntu 24.04 LTS - **CPU**: AMD Ryzen 7 5800x - **Memory**: 64gb DDR4 - **GPU**: PowerColor Hellhound 7900 XTX (24 gb vram) - **Browser (if applicable):** Firefox 129.0.1 **Confirmation:** - [x] I have read and followed all the instructions provided in the README.md. - [ ] I am on the latest version of both Open WebUI and Ollama. - [x] I have included the browser console logs. - [x] I have included the Docker container logs. - [x] I have provided the exact steps to reproduce the bug in the "Steps to Reproduce" section below. ## Expected Behavior: I expect to run smaller Llama3.1 modelfiles (16gb or less) completely within my 24gb of VRAM of my GPU ## Actual Behavior: When running llama3.1:latest (4.7gb model) and llama3.1:8b-instruct-fp16 (16gb model) through Open-WebUI there seems to be a memory leak, or a runaway memory problem on the system hosting Ollama, causing models to overflow VRAM, and take up other system resources ## Description **Bug Summary:** When running the models with Open-WebUI, the models suddenly take up an amount of memory that is multiples of their actual size. This has been tested with llama3.1:latest (4.7gb model) and llama3.1:8b-instruct-fp16 (16gb model) and both have shown this type of behaviour. This is running llama3.1:latest through the ollama CLI ![image](https://github.com/user-attachments/assets/9dfb6238-e87d-4099-af77-04acde29d0d2) This is what happens running it through Open-WebUI. You can see at first it's normal, but then it goes rogue taking up 4.7 times the amount of resources it does under normal operation. This model is only 4.7gb ![image](https://github.com/user-attachments/assets/00a7baef-1bcc-463c-88d6-3dcc6dd8a96a) Interestingly enough other models don't necessarily show the same behaviour. For example dolphin-llama3:8b (4.7gb) does not seem to balloon when used through Open-WebUI. In order to make a comparison, I did use Ollama CLI and n8n as benchmarks for memory and processor usage. This doesn't occur when using those other interfaces to the LLM, just open-webui ## Reproduction Details **Steps to Reproduce:** 1. Run llama3.1 using Ollama CLI on the desktop host `ollama run llama3.1:latest` 2. Send a few test prompts through 3. Exit Ollama CLI `/bye` 4. Verify system resource usage using `ollama ps` or any other tools (task manager, GPU tools) 5. (OPTIONAL) Wait to unload the model from memory (default is 5 minutes) or unload model from ollama memory using API 6. (OPTIONAL) Repeat steps 1 through 5 with another external tool (I tried this with n8n, which is cohosted with Open-WebUI) 7. Open the Open-WebUI and start a chat using the same model 8. Verify system resource usage using `ollama ps` or any other tools (task manager, GPU tools) ## Logs and Screenshots **NOTICE!! For the purpose of logging I restarted the container to get a relatively "clean" slate of events to debug** **Browser Console Logs:** ``` XHRGET https://[REDACTED]/ws/socket.io/?EIO=4&transport=polling&t=P5M0GUp [HTTP/1.1 502 Bad Gateway 2ms] XHRGET https://[REDACTED]/ws/socket.io/?EIO=4&transport=polling&t=P5M0Gyp [HTTP/1.1 502 Bad Gateway 3ms] user-count Object { count: 1 } +layout.svelte:125:13 usage Object { models: [] } +layout.svelte:130:13 connected +layout.svelte:119:13 submitPrompt <empty string> Chat.svelte:496:10 modelId llama3.1:latest Chat.svelte:649:12 usage Object { models: (1) […] } +layout.svelte:130:13 usage Object { models: (1) […] } +layout.svelte:130:13 usage Object { models: (1) […] } +layout.svelte:130:13 usage Object { models: (1) […] } +layout.svelte:130:13 usage Object { models: (1) […] } +layout.svelte:130:13 usage Object { models: (1) […] } +layout.svelte:130:13 usage Object { models: (1) […] } +layout.svelte:130:13 controller AbortController { signal: AbortSignal } Chat.svelte:833:11 {"model":"llama3.1:latest","created_at":"2024-08-15T12:27:08.1081714Z","message":{"role":"assistant","content":"Not"},"done":false} Chat.svelte:862:15 {"model":"llama3.1:latest","created_at":"2024-08-15T12:27:08.170814Z","message":{"role":"assistant","content":" much"},"done":false} Chat.svelte:862:15 {"model":"llama3.1:latest","created_at":"2024-08-15T12:27:08.2307259Z","message":{"role":"assistant","content":","},"done":false} Chat.svelte:862:15 {"model":"llama3.1:latest","created_at":"2024-08-15T12:27:08.2895079Z","message":{"role":"assistant","content":" just"},"done":false} Chat.svelte:862:15 {"model":"llama3.1:latest","created_at":"2024-08-15T12:27:08.3496388Z","message":{"role":"assistant","content":" chill"},"done":false} Chat.svelte:862:15 {"model":"llama3.1:latest","created_at":"2024-08-15T12:27:08.4096861Z","message":{"role":"assistant","content":"in"},"done":false} Chat.svelte:862:15 {"model":"llama3.1:latest","created_at":"2024-08-15T12:27:08.4697711Z","message":{"role":"assistant","content":"'"},"done":false} Chat.svelte:862:15 {"model":"llama3.1:latest","created_at":"2024-08-15T12:27:08.5294599Z","message":{"role":"assistant","content":" in"},"done":false} Chat.svelte:862:15 {"model":"llama3.1:latest","created_at":"2024-08-15T12:27:08.5891239Z","message":{"role":"assistant","content":" the"},"done":false} Chat.svelte:862:15 {"model":"llama3.1:latest","created_at":"2024-08-15T12:27:08.6500482Z","message":{"role":"assistant","content":" virtual"},"done":false} Chat.svelte:862:15 {"model":"llama3.1:latest","created_at":"2024-08-15T12:27:08.7093321Z","message":{"role":"assistant","content":" desert"},"done":false} Chat.svelte:862:15 usage Object { models: (1) […] } +layout.svelte:130:13 {"model":"llama3.1:latest","created_at":"2024-08-15T12:27:08.7702411Z","message":{"role":"assistant","content":"."},"done":false} Chat.svelte:862:15 {"model":"llama3.1:latest","created_at":"2024-08-15T12:27:08.8299715Z","message":{"role":"assistant","content":" What"},"done":false} Chat.svelte:862:15 {"model":"llama3.1:latest","created_at":"2024-08-15T12:27:08.8929719Z","message":{"role":"assistant","content":"'s"},"done":false} Chat.svelte:862:15 {"model":"llama3.1:latest","created_at":"2024-08-15T12:27:08.9548183Z","message":{"role":"assistant","content":" on"},"done":false} Chat.svelte:862:15 {"model":"llama3.1:latest","created_at":"2024-08-15T12:27:09.0196769Z","message":{"role":"assistant","content":" your"},"done":false} Chat.svelte:862:15 {"model":"llama3.1:latest","created_at":"2024-08-15T12:27:09.0840637Z","message":{"role":"assistant","content":" mind"},"done":false} Chat.svelte:862:15 {"model":"llama3.1:latest","created_at":"2024-08-15T12:27:09.1467364Z","message":{"role":"assistant","content":"?"},"done":false} Chat.svelte:862:15 {"model":"llama3.1:latest","created_at":"2024-08-15T12:27:09.2076977Z","message":{"role":"assistant","content":" Want"},"done":false} Chat.svelte:862:15 {"model":"llama3.1:latest","created_at":"2024-08-15T12:27:09.2684302Z","message":{"role":"assistant","content":" to"},"done":false} Chat.svelte:862:15 {"model":"llama3.1:latest","created_at":"2024-08-15T12:27:09.3295448Z","message":{"role":"assistant","content":" talk"},"done":false} Chat.svelte:862:15 {"model":"llama3.1:latest","created_at":"2024-08-15T12:27:09.3973307Z","message":{"role":"assistant","content":" about"},"done":false} Chat.svelte:862:15 {"model":"llama3.1:latest","created_at":"2024-08-15T12:27:09.4629073Z","message":{"role":"assistant","content":" llama"},"done":false} Chat.svelte:862:15 {"model":"llama3.1:latest","created_at":"2024-08-15T12:27:09.5293886Z","message":{"role":"assistant","content":"-themed"},"done":false} Chat.svelte:862:15 {"model":"llama3.1:latest","created_at":"2024-08-15T12:27:09.6009259Z","message":{"role":"assistant","content":" pun"},"done":false} Chat.svelte:862:15 {"model":"llama3.1:latest","created_at":"2024-08-15T12:27:09.6733066Z","message":{"role":"assistant","content":"s"},"done":false} Chat.svelte:862:15 usage Object { models: (1) […] } +layout.svelte:130:13 {"model":"llama3.1:latest","created_at":"2024-08-15T12:27:09.7493123Z","message":{"role":"assistant","content":" or"},"done":false} Chat.svelte:862:15 {"model":"llama3.1:latest","created_at":"2024-08-15T12:27:09.8205168Z","message":{"role":"assistant","content":" something"},"done":false} Chat.svelte:862:15 {"model":"llama3.1:latest","created_at":"2024-08-15T12:27:09.8863276Z","message":{"role":"assistant","content":" more"},"done":false} Chat.svelte:862:15 {"model":"llama3.1:latest","created_at":"2024-08-15T12:27:09.954875Z","message":{"role":"assistant","content":" serious"},"done":false} Chat.svelte:862:15 {"model":"llama3.1:latest","created_at":"2024-08-15T12:27:10.0285003Z","message":{"role":"assistant","content":"?"},"done":false} Chat.svelte:862:15 {"model":"llama3.1:latest","created_at":"2024-08-15T12:27:10.0971274Z","message":{"role":"assistant","content":""},"done_reason":"stop","done":true,"total_duration":9517094700,"load_duration":7100390200,"prompt_eval_count":17,"prompt_eval_duration":426745000,"eval_count":32,"eval_duration":1988346000} Chat.svelte:862:15 usage Object { models: (1) […] } +layout.svelte:130:13 usage Object { models: (1) […] } +layout.svelte:130:13 usage Object { models: (1) […] } +layout.svelte:130:13 usage Object { models: (1) […] } +layout.svelte:130:13 usage Object { models: (1) […] } +layout.svelte:130:13 usage Object { models: (1) […] } +layout.svelte:130:13 submitPrompt dcd7198d-4369-44a5-bafa-7c3cfdd3eb70 Chat.svelte:496:10 modelId llama3.1:latest Chat.svelte:649:12 usage Object { models: [] } +layout.svelte:130:13 usage Object { models: (1) […] } +layout.svelte:130:13 usage Object { models: (1) […] } +layout.svelte:130:13 usage Object { models: (1) […] } +layout.svelte:130:13 usage Object { models: (1) […] } +layout.svelte:130:13 usage Object { models: (1) […] } +layout.svelte:130:13 usage Object { models: (1) […] } +layout.svelte:130:13 usage Object { models: (1) […] } +layout.svelte:130:13 usage Object { models: (1) […] } +layout.svelte:130:13 usage Object { models: (1) […] } +layout.svelte:130:13 usage Object { models: (1) […] } +layout.svelte:130:13 usage Object { models: (1) […] } +layout.svelte:130:13 usage Object { models: (1) […] } +layout.svelte:130:13 controller AbortController { signal: AbortSignal } Chat.svelte:833:11 {"model":"llama3.1:latest","created_at":"2024-08-15T12:27:30.013716Z","message":{"role":"assistant","content":"As"},"done":false} Chat.svelte:862:15 {"model":"llama3.1:latest","created_at":"2024-08-15T12:27:30.0762419Z","message":{"role":"assistant","content":" a"},"done":false} Chat.svelte:862:15 {"model":"llama3.1:latest","created_at":"2024-08-15T12:27:30.1402565Z","message":{"role":"assistant","content":" convers"},"done":false} Chat.svelte:862:15 {"model":"llama3.1:latest","created_at":"2024-08-15T12:27:30.2006807Z","message":{"role":"assistant","content":"ational"},"done":false} Chat.svelte:862:15 {"model":"llama3.1:latest","created_at":"2024-08-15T12:27:30.261802Z","message":{"role":"assistant","content":" AI"},"done":false} Chat.svelte:862:15 {"model":"llama3.1:latest","created_at":"2024-08-15T12:27:30.3271791Z","message":{"role":"assistant","content":","},"done":false} Chat.svelte:862:15 {"model":"llama3.1:latest","created_at":"2024-08-15T12:27:30.3892109Z","message":{"role":"assistant","content":" I"},"done":false} Chat.svelte:862:15 {"model":"llama3.1:latest","created_at":"2024-08-15T12:27:30.4519769Z","message":{"role":"assistant","content":" use"},"done":false} Chat.svelte:862:15 {"model":"llama3.1:latest","created_at":"2024-08-15T12:27:30.5137226Z","message":{"role":"assistant","content":" a"},"done":false} Chat.svelte:862:15 {"model":"llama3.1:latest","created_at":"2024-08-15T12:27:30.5770823Z","message":{"role":"assistant","content":" significant"},"done":false} Chat.svelte:862:15 {"model":"llama3.1:latest","created_at":"2024-08-15T12:27:30.6366461Z","message":{"role":"assistant","content":" amount"},"done":false} Chat.svelte:862:15 {"model":"llama3.1:latest","created_at":"2024-08-15T12:27:30.6994705Z","message":{"role":"assistant","content":" of"},"done":false} Chat.svelte:862:15 {"model":"llama3.1:latest","created_at":"2024-08-15T12:27:30.7624538Z","message":{"role":"assistant","content":" computing"},"done":false} Chat.svelte:862:15 {"model":"llama3.1:latest","created_at":"2024-08-15T12:27:30.8244884Z","message":{"role":"assistant","content":" resources"},"done":false} Chat.svelte:862:15 {"model":"llama3.1:latest","created_at":"2024-08-15T12:27:30.8842064Z","message":{"role":"assistant","content":" to"},"done":false} Chat.svelte:862:15 {"model":"llama3.1:latest","created_at":"2024-08-15T12:27:30.9469078Z","message":{"role":"assistant","content":" process"},"done":false} Chat.svelte:862:15 usage Object { models: (1) […] } +layout.svelte:130:13 {"model":"llama3.1:latest","created_at":"2024-08-15T12:27:31.0091376Z","message":{"role":"assistant","content":" and"},"done":false} Chat.svelte:862:15 {"model":"llama3.1:latest","created_at":"2024-08-15T12:27:31.0713022Z","message":{"role":"assistant","content":" respond"},"done":false} Chat.svelte:862:15 {"model":"llama3.1:latest","created_at":"2024-08-15T12:27:31.1352146Z","message":{"role":"assistant","content":" to"},"done":false} Chat.svelte:862:15 {"model":"llama3.1:latest","created_at":"2024-08-15T12:27:31.1973338Z","message":{"role":"assistant","content":" user"},"done":false} Chat.svelte:862:15 {"model":"llama3.1:latest","created_at":"2024-08-15T12:27:31.258238Z","message":{"role":"assistant","content":" inputs"},"done":false} Chat.svelte:862:15 {"model":"llama3.1:latest","created_at":"2024-08-15T12:27:31.3179661Z","message":{"role":"assistant","content":" like"},"done":false} Chat.svelte:862:15 {"model":"llama3.1:latest","created_at":"2024-08-15T12:27:31.3775835Z","message":{"role":"assistant","content":" our"},"done":false} Chat.svelte:862:15 {"model":"llama3.1:latest","created_at":"2024-08-15T12:27:31.4393179Z","message":{"role":"assistant","content":" conversation"},"done":false} Chat.svelte:862:15 {"model":"llama3.1:latest","created_at":"2024-08-15T12:27:31.4985372Z","message":{"role":"assistant","content":"."},"done":false} Chat.svelte:862:15 {"model":"llama3.1:latest","created_at":"2024-08-15T12:27:31.5600354Z","message":{"role":"assistant","content":" This"},"done":false} Chat.svelte:862:15 {"model":"llama3.1:latest","created_at":"2024-08-15T12:27:31.6237137Z","message":{"role":"assistant","content":" is"},"done":false} Chat.svelte:862:15 {"model":"llama3.1:latest","created_at":"2024-08-15T12:27:31.6837153Z","message":{"role":"assistant","content":" because"},"done":false} Chat.svelte:862:15 {"model":"llama3.1:latest","created_at":"2024-08-15T12:27:31.7466787Z","message":{"role":"assistant","content":":\n\n"},"done":false} Chat.svelte:862:15 {"model":"llama3.1:latest","created_at":"2024-08-15T12:27:31.8075438Z","message":{"role":"assistant","content":"1"},"done":false} Chat.svelte:862:15 {"model":"llama3.1:latest","created_at":"2024-08-15T12:27:31.8672158Z","message":{"role":"assistant","content":"."},"done":false} Chat.svelte:862:15 {"model":"llama3.1:latest","created_at":"2024-08-15T12:27:31.9291608Z","message":{"role":"assistant","content":" **"},"done":false} Chat.svelte:862:15 {"model":"llama3.1:latest","created_at":"2024-08-15T12:27:31.9895124Z","message":{"role":"assistant","content":"Language"},"done":false} Chat.svelte:862:15 usage Object { models: (1) […] } +layout.svelte:130:13 {"model":"llama3.1:latest","created_at":"2024-08-15T12:27:32.0514873Z","message":{"role":"assistant","content":" understanding"},"done":false} Chat.svelte:862:15 {"model":"llama3.1:latest","created_at":"2024-08-15T12:27:32.1166838Z","message":{"role":"assistant","content":"**:"},"done":false} Chat.svelte:862:15 {"model":"llama3.1:latest","created_at":"2024-08-15T12:27:32.1774426Z","message":{"role":"assistant","content":" I"},"done":false} Chat.svelte:862:15 {"model":"llama3.1:latest","created_at":"2024-08-15T12:27:32.2392734Z","message":{"role":"assistant","content":" need"},"done":false} Chat.svelte:862:15 {"model":"llama3.1:latest","created_at":"2024-08-15T12:27:32.3002835Z","message":{"role":"assistant","content":" to"},"done":false} Chat.svelte:862:15 {"model":"llama3.1:latest","created_at":"2024-08-15T12:27:32.3613665Z","message":{"role":"assistant","content":" analyze"},"done":false} Chat.svelte:862:15 {"model":"llama3.1:latest","created_at":"2024-08-15T12:27:32.4211287Z","message":{"role":"assistant","content":" the"},"done":false} Chat.svelte:862:15 {"model":"llama3.1:latest","created_at":"2024-08-15T12:27:32.4819728Z","message":{"role":"assistant","content":" context"},"done":false} Chat.svelte:862:15 {"model":"llama3.1:latest","created_at":"2024-08-15T12:27:32.543073Z","message":{"role":"assistant","content":","},"done":false} Chat.svelte:862:15 {"model":"llama3.1:latest","created_at":"2024-08-15T12:27:32.6043227Z","message":{"role":"assistant","content":" syntax"},"done":false} Chat.svelte:862:15 {"model":"llama3.1:latest","created_at":"2024-08-15T12:27:32.665229Z","message":{"role":"assistant","content":","},"done":false} Chat.svelte:862:15 {"model":"llama3.1:latest","created_at":"2024-08-15T12:27:32.7289042Z","message":{"role":"assistant","content":" and"},"done":false} Chat.svelte:862:15 {"model":"llama3.1:latest","created_at":"2024-08-15T12:27:32.7899397Z","message":{"role":"assistant","content":" semantics"},"done":false} Chat.svelte:862:15 {"model":"llama3.1:latest","created_at":"2024-08-15T12:27:32.8515937Z","message":{"role":"assistant","content":" of"},"done":false} Chat.svelte:862:15 {"model":"llama3.1:latest","created_at":"2024-08-15T12:27:32.9135202Z","message":{"role":"assistant","content":" your"},"done":false} Chat.svelte:862:15 {"model":"llama3.1:latest","created_at":"2024-08-15T12:27:32.973854Z","message":{"role":"assistant","content":" messages"},"done":false} Chat.svelte:862:15 usage Object { models: (1) […] } +layout.svelte:130:13 {"model":"llama3.1:latest","created_at":"2024-08-15T12:27:33.0395712Z","message":{"role":"assistant","content":" to"},"done":false} Chat.svelte:862:15 {"model":"llama3.1:latest","created_at":"2024-08-15T12:27:33.1017984Z","message":{"role":"assistant","content":" understand"},"done":false} Chat.svelte:862:15 {"model":"llama3.1:latest","created_at":"2024-08-15T12:27:33.1744851Z","message":{"role":"assistant","content":" what"},"done":false} Chat.svelte:862:15 {"model":"llama3.1:latest","created_at":"2024-08-15T12:27:33.2362158Z","message":{"role":"assistant","content":" you"},"done":false} Chat.svelte:862:15 {"model":"llama3.1:latest","created_at":"2024-08-15T12:27:33.2960658Z","message":{"role":"assistant","content":"'re"},"done":false} Chat.svelte:862:15 {"model":"llama3.1:latest","created_at":"2024-08-15T12:27:33.3585163Z","message":{"role":"assistant","content":" asking"},"done":false} Chat.svelte:862:15 {"model":"llama3.1:latest","created_at":"2024-08-15T12:27:33.4213981Z","message":{"role":"assistant","content":".\n"},"done":false} Chat.svelte:862:15 {"model":"llama3.1:latest","created_at":"2024-08-15T12:27:33.4822911Z","message":{"role":"assistant","content":"2"},"done":false} Chat.svelte:862:15 {"model":"llama3.1:latest","created_at":"2024-08-15T12:27:33.5433646Z","message":{"role":"assistant","content":"."},"done":false} Chat.svelte:862:15 {"model":"llama3.1:latest","created_at":"2024-08-15T12:27:33.6047685Z","message":{"role":"assistant","content":" **"},"done":false} Chat.svelte:862:15 {"model":"llama3.1:latest","created_at":"2024-08-15T12:27:33.668573Z","message":{"role":"assistant","content":"Knowledge"},"done":false} Chat.svelte:862:15 {"model":"llama3.1:latest","created_at":"2024-08-15T12:27:33.7283299Z","message":{"role":"assistant","content":" retrieval"},"done":false} Chat.svelte:862:15 {"model":"llama3.1:latest","created_at":"2024-08-15T12:27:33.7923352Z","message":{"role":"assistant","content":"**:"},"done":false} Chat.svelte:862:15 {"model":"llama3.1:latest","created_at":"2024-08-15T12:27:33.8524732Z","message":{"role":"assistant","content":" When"},"done":false} Chat.svelte:862:15 {"model":"llama3.1:latest","created_at":"2024-08-15T12:27:33.91213Z","message":{"role":"assistant","content":" answering"},"done":false} Chat.svelte:862:15 {"model":"llama3.1:latest","created_at":"2024-08-15T12:27:33.9740126Z","message":{"role":"assistant","content":" questions"},"done":false} Chat.svelte:862:15 usage Object { models: (1) […] } +layout.svelte:130:13 {"model":"llama3.1:latest","created_at":"2024-08-15T12:27:34.0360014Z","message":{"role":"assistant","content":" or"},"done":false} Chat.svelte:862:15 {"model":"llama3.1:latest","created_at":"2024-08-15T12:27:34.0966802Z","message":{"role":"assistant","content":" providing"},"done":false} Chat.svelte:862:15 {"model":"llama3.1:latest","created_at":"2024-08-15T12:27:34.1595543Z","message":{"role":"assistant","content":" information"},"done":false} Chat.svelte:862:15 {"model":"llama3.1:latest","created_at":"2024-08-15T12:27:34.2240205Z","message":{"role":"assistant","content":","},"done":false} Chat.svelte:862:15 {"model":"llama3.1:latest","created_at":"2024-08-15T12:27:34.2852352Z","message":{"role":"assistant","content":" I"},"done":false} Chat.svelte:862:15 {"model":"llama3.1:latest","created_at":"2024-08-15T12:27:34.3453914Z","message":{"role":"assistant","content":" have"},"done":false} Chat.svelte:862:15 {"model":"llama3.1:latest","created_at":"2024-08-15T12:27:34.4053703Z","message":{"role":"assistant","content":" to"},"done":false} Chat.svelte:862:15 {"model":"llama3.1:latest","created_at":"2024-08-15T12:27:34.4664242Z","message":{"role":"assistant","content":" search"},"done":false} Chat.svelte:862:15 {"model":"llama3.1:latest","created_at":"2024-08-15T12:27:34.5262481Z","message":{"role":"assistant","content":" through"},"done":false} Chat.svelte:862:15 {"model":"llama3.1:latest","created_at":"2024-08-15T12:27:34.5879789Z","message":{"role":"assistant","content":" vast"},"done":false} Chat.svelte:862:15 {"model":"llama3.1:latest","created_at":"2024-08-15T12:27:34.6500452Z","message":{"role":"assistant","content":" amounts"},"done":false} Chat.svelte:862:15 {"model":"llama3.1:latest","created_at":"2024-08-15T12:27:34.7120748Z","message":{"role":"assistant","content":" of"},"done":false} Chat.svelte:862:15 {"model":"llama3.1:latest","created_at":"2024-08-15T12:27:34.7780127Z","message":{"role":"assistant","content":" data"},"done":false} Chat.svelte:862:15 {"model":"llama3.1:latest","created_at":"2024-08-15T12:27:34.839839Z","message":{"role":"assistant","content":","},"done":false} Chat.svelte:862:15 {"model":"llama3.1:latest","created_at":"2024-08-15T12:27:34.9001677Z","message":{"role":"assistant","content":" such"},"done":false} Chat.svelte:862:15 {"model":"llama3.1:latest","created_at":"2024-08-15T12:27:34.961529Z","message":{"role":"assistant","content":" as"},"done":false} Chat.svelte:862:15 {"model":"llama3.1:latest","created_at":"2024-08-15T12:27:35.0227846Z","message":{"role":"assistant","content":" my"},"done":false} Chat.svelte:862:15 usage Object { models: (1) […] } +layout.svelte:130:13 {"model":"llama3.1:latest","created_at":"2024-08-15T12:27:35.0847861Z","message":{"role":"assistant","content":" training"},"done":false} Chat.svelte:862:15 {"model":"llama3.1:latest","created_at":"2024-08-15T12:27:35.146849Z","message":{"role":"assistant","content":" dataset"},"done":false} Chat.svelte:862:15 {"model":"llama3.1:latest","created_at":"2024-08-15T12:27:35.2076656Z","message":{"role":"assistant","content":","},"done":false} Chat.svelte:862:15 {"model":"llama3.1:latest","created_at":"2024-08-15T12:27:35.2728124Z","message":{"role":"assistant","content":" to"},"done":false} Chat.svelte:862:15 {"model":"llama3.1:latest","created_at":"2024-08-15T12:27:35.3332007Z","message":{"role":"assistant","content":" find"},"done":false} Chat.svelte:862:15 {"model":"llama3.1:latest","created_at":"2024-08-15T12:27:35.3948021Z","message":{"role":"assistant","content":" relevant"},"done":false} Chat.svelte:862:15 {"model":"llama3.1:latest","created_at":"2024-08-15T12:27:35.4564203Z","message":{"role":"assistant","content":" responses"},"done":false} Chat.svelte:862:15 {"model":"llama3.1:latest","created_at":"2024-08-15T12:27:35.5150691Z","message":{"role":"assistant","content":".\n"},"done":false} Chat.svelte:862:15 {"model":"llama3.1:latest","created_at":"2024-08-15T12:27:35.5777179Z","message":{"role":"assistant","content":"3"},"done":false} Chat.svelte:862:15 {"model":"llama3.1:latest","created_at":"2024-08-15T12:27:35.6379343Z","message":{"role":"assistant","content":"."},"done":false} Chat.svelte:862:15 {"model":"llama3.1:latest","created_at":"2024-08-15T12:27:35.6978614Z","message":{"role":"assistant","content":" **"},"done":false} Chat.svelte:862:15 {"model":"llama3.1:latest","created_at":"2024-08-15T12:27:35.7626508Z","message":{"role":"assistant","content":"Text"},"done":false} Chat.svelte:862:15 {"model":"llama3.1:latest","created_at":"2024-08-15T12:27:35.8246818Z","message":{"role":"assistant","content":" generation"},"done":false} Chat.svelte:862:15 {"model":"llama3.1:latest","created_at":"2024-08-15T12:27:35.8850396Z","message":{"role":"assistant","content":"**:"},"done":false} Chat.svelte:862:15 {"model":"llama3.1:latest","created_at":"2024-08-15T12:27:35.9464147Z","message":{"role":"assistant","content":" Crafting"},"done":false} Chat.svelte:862:15 {"model":"llama3.1:latest","created_at":"2024-08-15T12:27:36.0064414Z","message":{"role":"assistant","content":" a"},"done":false} Chat.svelte:862:15 usage Object { models: (1) […] } +layout.svelte:130:13 {"model":"llama3.1:latest","created_at":"2024-08-15T12:27:36.0683452Z","message":{"role":"assistant","content":" response"},"done":false} Chat.svelte:862:15 {"model":"llama3.1:latest","created_at":"2024-08-15T12:27:36.1313823Z","message":{"role":"assistant","content":" requires"},"done":false} Chat.svelte:862:15 {"model":"llama3.1:latest","created_at":"2024-08-15T12:27:36.1930541Z","message":{"role":"assistant","content":" generating"},"done":false} Chat.svelte:862:15 {"model":"llama3.1:latest","created_at":"2024-08-15T12:27:36.2544313Z","message":{"role":"assistant","content":" text"},"done":false} Chat.svelte:862:15 {"model":"llama3.1:latest","created_at":"2024-08-15T12:27:36.3185841Z","message":{"role":"assistant","content":" based"},"done":false} Chat.svelte:862:15 {"model":"llama3.1:latest","created_at":"2024-08-15T12:27:36.3803586Z","message":{"role":"assistant","content":" on"},"done":false} Chat.svelte:862:15 {"model":"llama3.1:latest","created_at":"2024-08-15T12:27:36.4408833Z","message":{"role":"assistant","content":" the"},"done":false} Chat.svelte:862:15 {"model":"llama3.1:latest","created_at":"2024-08-15T12:27:36.5015119Z","message":{"role":"assistant","content":" conversation"},"done":false} Chat.svelte:862:15 {"model":"llama3.1:latest","created_at":"2024-08-15T12:27:36.5647445Z","message":{"role":"assistant","content":"'s"},"done":false} Chat.svelte:862:15 {"model":"llama3.1:latest","created_at":"2024-08-15T12:27:36.6295069Z","message":{"role":"assistant","content":" context"},"done":false} Chat.svelte:862:15 {"model":"llama3.1:latest","created_at":"2024-08-15T12:27:36.6933122Z","message":{"role":"assistant","content":","},"done":false} Chat.svelte:862:15 {"model":"llama3.1:latest","created_at":"2024-08-15T12:27:36.7567013Z","message":{"role":"assistant","content":" which"},"done":false} Chat.svelte:862:15 {"model":"llama3.1:latest","created_at":"2024-08-15T12:27:36.8193919Z","message":{"role":"assistant","content":" can"},"done":false} Chat.svelte:862:15 {"model":"llama3.1:latest","created_at":"2024-08-15T12:27:36.8823489Z","message":{"role":"assistant","content":" be"},"done":false} Chat.svelte:862:15 {"model":"llama3.1:latest","created_at":"2024-08-15T12:27:36.942398Z","message":{"role":"assistant","content":" comput"},"done":false} Chat.svelte:862:15 {"model":"llama3.1:latest","created_at":"2024-08-15T12:27:37.0037645Z","message":{"role":"assistant","content":"ationally"},"done":false} Chat.svelte:862:15 {"model":"llama3.1:latest","created_at":"2024-08-15T12:27:37.0641803Z","message":{"role":"assistant","content":" intensive"},"done":false} Chat.svelte:862:15 usage Object { models: (1) […] } +layout.svelte:130:13 {"model":"llama3.1:latest","created_at":"2024-08-15T12:27:37.1269088Z","message":{"role":"assistant","content":".\n\n"},"done":false} Chat.svelte:862:15 {"model":"llama3.1:latest","created_at":"2024-08-15T12:27:37.1887474Z","message":{"role":"assistant","content":"To"},"done":false} Chat.svelte:862:15 {"model":"llama3.1:latest","created_at":"2024-08-15T12:27:37.2496734Z","message":{"role":"assistant","content":" give"},"done":false} Chat.svelte:862:15 {"model":"llama3.1:latest","created_at":"2024-08-15T12:27:37.3125493Z","message":{"role":"assistant","content":" you"},"done":false} Chat.svelte:862:15 {"model":"llama3.1:latest","created_at":"2024-08-15T12:27:37.3746114Z","message":{"role":"assistant","content":" an"},"done":false} Chat.svelte:862:15 {"model":"llama3.1:latest","created_at":"2024-08-15T12:27:37.4397231Z","message":{"role":"assistant","content":" idea"},"done":false} Chat.svelte:862:15 {"model":"llama3.1:latest","created_at":"2024-08-15T12:27:37.5021763Z","message":{"role":"assistant","content":","},"done":false} Chat.svelte:862:15 {"model":"llama3.1:latest","created_at":"2024-08-15T12:27:37.5627345Z","message":{"role":"assistant","content":" here"},"done":false} Chat.svelte:862:15 {"model":"llama3.1:latest","created_at":"2024-08-15T12:27:37.6221319Z","message":{"role":"assistant","content":" are"},"done":false} Chat.svelte:862:15 {"model":"llama3.1:latest","created_at":"2024-08-15T12:27:37.6840372Z","message":{"role":"assistant","content":" some"},"done":false} Chat.svelte:862:15 {"model":"llama3.1:latest","created_at":"2024-08-15T12:27:37.7459143Z","message":{"role":"assistant","content":" rough"},"done":false} Chat.svelte:862:15 {"model":"llama3.1:latest","created_at":"2024-08-15T12:27:37.8093514Z","message":{"role":"assistant","content":" estimates"},"done":false} Chat.svelte:862:15 {"model":"llama3.1:latest","created_at":"2024-08-15T12:27:37.8729836Z","message":{"role":"assistant","content":":\n\n"},"done":false} Chat.svelte:862:15 {"model":"llama3.1:latest","created_at":"2024-08-15T12:27:37.9357305Z","message":{"role":"assistant","content":"*"},"done":false} Chat.svelte:862:15 {"model":"llama3.1:latest","created_at":"2024-08-15T12:27:38.0010555Z","message":{"role":"assistant","content":" Processing"},"done":false} Chat.svelte:862:15 usage Object { models: (1) […] } +layout.svelte:130:13 {"model":"llama3.1:latest","created_at":"2024-08-15T12:27:38.0645656Z","message":{"role":"assistant","content":" a"},"done":false} Chat.svelte:862:15 {"model":"llama3.1:latest","created_at":"2024-08-15T12:27:38.130691Z","message":{"role":"assistant","content":" single"},"done":false} Chat.svelte:862:15 {"model":"llama3.1:latest","created_at":"2024-08-15T12:27:38.1954037Z","message":{"role":"assistant","content":" message"},"done":false} Chat.svelte:862:15 {"model":"llama3.1:latest","created_at":"2024-08-15T12:27:38.2562553Z","message":{"role":"assistant","content":" can"},"done":false} Chat.svelte:862:15 {"model":"llama3.1:latest","created_at":"2024-08-15T12:27:38.3211322Z","message":{"role":"assistant","content":" take"},"done":false} Chat.svelte:862:15 {"model":"llama3.1:latest","created_at":"2024-08-15T12:27:38.3826946Z","message":{"role":"assistant","content":" around"},"done":false} Chat.svelte:862:15 {"model":"llama3.1:latest","created_at":"2024-08-15T12:27:38.4458393Z","message":{"role":"assistant","content":" "},"done":false} Chat.svelte:862:15 {"model":"llama3.1:latest","created_at":"2024-08-15T12:27:38.5076822Z","message":{"role":"assistant","content":"1"},"done":false} Chat.svelte:862:15 {"model":"llama3.1:latest","created_at":"2024-08-15T12:27:38.5678822Z","message":{"role":"assistant","content":"-"},"done":false} Chat.svelte:862:15 {"model":"llama3.1:latest","created_at":"2024-08-15T12:27:38.6307299Z","message":{"role":"assistant","content":"5"},"done":false} Chat.svelte:862:15 {"model":"llama3.1:latest","created_at":"2024-08-15T12:27:38.6934234Z","message":{"role":"assistant","content":" milliseconds"},"done":false} Chat.svelte:862:15 {"model":"llama3.1:latest","created_at":"2024-08-15T12:27:38.7551117Z","message":{"role":"assistant","content":" ("},"done":false} Chat.svelte:862:15 {"model":"llama3.1:latest","created_at":"2024-08-15T12:27:38.8161174Z","message":{"role":"assistant","content":"depending"},"done":false} Chat.svelte:862:15 {"model":"llama3.1:latest","created_at":"2024-08-15T12:27:38.8787873Z","message":{"role":"assistant","content":" on"},"done":false} Chat.svelte:862:15 {"model":"llama3.1:latest","created_at":"2024-08-15T12:27:38.9411353Z","message":{"role":"assistant","content":" complexity"},"done":false} Chat.svelte:862:15 {"model":"llama3.1:latest","created_at":"2024-08-15T12:27:39.0012262Z","message":{"role":"assistant","content":")\n"},"done":false} Chat.svelte:862:15 usage Object { models: (1) […] } +layout.svelte:130:13 {"model":"llama3.1:latest","created_at":"2024-08-15T12:27:39.0627323Z","message":{"role":"assistant","content":"*"},"done":false} Chat.svelte:862:15 {"model":"llama3.1:latest","created_at":"2024-08-15T12:27:39.12634Z","message":{"role":"assistant","content":" Access"},"done":false} Chat.svelte:862:15 {"model":"llama3.1:latest","created_at":"2024-08-15T12:27:39.1872918Z","message":{"role":"assistant","content":"ing"},"done":false} Chat.svelte:862:15 {"model":"llama3.1:latest","created_at":"2024-08-15T12:27:39.2474112Z","message":{"role":"assistant","content":" and"},"done":false} Chat.svelte:862:15 {"model":"llama3.1:latest","created_at":"2024-08-15T12:27:39.3092011Z","message":{"role":"assistant","content":" processing"},"done":false} Chat.svelte:862:15 {"model":"llama3.1:latest","created_at":"2024-08-15T12:27:39.3700856Z","message":{"role":"assistant","content":" large"},"done":false} Chat.svelte:862:15 {"model":"llama3.1:latest","created_at":"2024-08-15T12:27:39.4320018Z","message":{"role":"assistant","content":" datasets"},"done":false} Chat.svelte:862:15 {"model":"llama3.1:latest","created_at":"2024-08-15T12:27:39.4947853Z","message":{"role":"assistant","content":" for"},"done":false} Chat.svelte:862:15 {"model":"llama3.1:latest","created_at":"2024-08-15T12:27:39.5558812Z","message":{"role":"assistant","content":" knowledge"},"done":false} Chat.svelte:862:15 {"model":"llama3.1:latest","created_at":"2024-08-15T12:27:39.6169845Z","message":{"role":"assistant","content":" retrieval"},"done":false} Chat.svelte:862:15 {"model":"llama3.1:latest","created_at":"2024-08-15T12:27:39.6781413Z","message":{"role":"assistant","content":" can"},"done":false} Chat.svelte:862:15 {"model":"llama3.1:latest","created_at":"2024-08-15T12:27:39.7412249Z","message":{"role":"assistant","content":" add"},"done":false} Chat.svelte:862:15 {"model":"llama3.1:latest","created_at":"2024-08-15T12:27:39.8029085Z","message":{"role":"assistant","content":" up"},"done":false} Chat.svelte:862:15 {"model":"llama3.1:latest","created_at":"2024-08-15T12:27:39.8651027Z","message":{"role":"assistant","content":" to"},"done":false} Chat.svelte:862:15 {"model":"llama3.1:latest","created_at":"2024-08-15T12:27:39.9281707Z","message":{"role":"assistant","content":" tens"},"done":false} Chat.svelte:862:15 {"model":"llama3.1:latest","created_at":"2024-08-15T12:27:39.9900588Z","message":{"role":"assistant","content":" or"},"done":false} Chat.svelte:862:15 {"model":"llama3.1:latest","created_at":"2024-08-15T12:27:40.0511999Z","message":{"role":"assistant","content":" hundreds"},"done":false} Chat.svelte:862:15 usage Object { models: (1) […] } +layout.svelte:130:13 {"model":"llama3.1:latest","created_at":"2024-08-15T12:27:40.1139543Z","message":{"role":"assistant","content":" of"},"done":false} Chat.svelte:862:15 {"model":"llama3.1:latest","created_at":"2024-08-15T12:27:40.1750802Z","message":{"role":"assistant","content":" milliseconds"},"done":false} Chat.svelte:862:15 {"model":"llama3.1:latest","created_at":"2024-08-15T12:27:40.2353322Z","message":{"role":"assistant","content":"\n"},"done":false} Chat.svelte:862:15 {"model":"llama3.1:latest","created_at":"2024-08-15T12:27:40.2960094Z","message":{"role":"assistant","content":"*"},"done":false} Chat.svelte:862:15 {"model":"llama3.1:latest","created_at":"2024-08-15T12:27:40.3584292Z","message":{"role":"assistant","content":" Generating"},"done":false} Chat.svelte:862:15 {"model":"llama3.1:latest","created_at":"2024-08-15T12:27:40.4213404Z","message":{"role":"assistant","content":" text"},"done":false} Chat.svelte:862:15 {"model":"llama3.1:latest","created_at":"2024-08-15T12:27:40.4822954Z","message":{"role":"assistant","content":" responses"},"done":false} Chat.svelte:862:15 {"model":"llama3.1:latest","created_at":"2024-08-15T12:27:40.5446188Z","message":{"role":"assistant","content":" can"},"done":false} Chat.svelte:862:15 {"model":"llama3.1:latest","created_at":"2024-08-15T12:27:40.6055189Z","message":{"role":"assistant","content":" consume"},"done":false} Chat.svelte:862:15 {"model":"llama3.1:latest","created_at":"2024-08-15T12:27:40.6662788Z","message":{"role":"assistant","content":" even"},"done":false} Chat.svelte:862:15 {"model":"llama3.1:latest","created_at":"2024-08-15T12:27:40.7294373Z","message":{"role":"assistant","content":" more"},"done":false} Chat.svelte:862:15 {"model":"llama3.1:latest","created_at":"2024-08-15T12:27:40.790157Z","message":{"role":"assistant","content":" resources"},"done":false} Chat.svelte:862:15 {"model":"llama3.1:latest","created_at":"2024-08-15T12:27:40.8518948Z","message":{"role":"assistant","content":","},"done":false} Chat.svelte:862:15 {"model":"llama3.1:latest","created_at":"2024-08-15T12:27:40.9138657Z","message":{"role":"assistant","content":" potentially"},"done":false} Chat.svelte:862:15 {"model":"llama3.1:latest","created_at":"2024-08-15T12:27:40.9747827Z","message":{"role":"assistant","content":" taking"},"done":false} Chat.svelte:862:15 {"model":"llama3.1:latest","created_at":"2024-08-15T12:27:41.0353838Z","message":{"role":"assistant","content":" longer"},"done":false} Chat.svelte:862:15 usage Object { models: (1) […] } +layout.svelte:130:13 {"model":"llama3.1:latest","created_at":"2024-08-15T12:27:41.0970856Z","message":{"role":"assistant","content":" than"},"done":false} Chat.svelte:862:15 {"model":"llama3.1:latest","created_at":"2024-08-15T12:27:41.1597531Z","message":{"role":"assistant","content":" the"},"done":false} Chat.svelte:862:15 {"model":"llama3.1:latest","created_at":"2024-08-15T12:27:41.2231477Z","message":{"role":"assistant","content":" above"},"done":false} Chat.svelte:862:15 {"model":"llama3.1:latest","created_at":"2024-08-15T12:27:41.2851275Z","message":{"role":"assistant","content":" steps"},"done":false} Chat.svelte:862:15 {"model":"llama3.1:latest","created_at":"2024-08-15T12:27:41.348124Z","message":{"role":"assistant","content":" combined"},"done":false} Chat.svelte:862:15 {"model":"llama3.1:latest","created_at":"2024-08-15T12:27:41.4122322Z","message":{"role":"assistant","content":"\n\n"},"done":false} Chat.svelte:862:15 {"model":"llama3.1:latest","created_at":"2024-08-15T12:27:41.4733631Z","message":{"role":"assistant","content":"These"},"done":false} Chat.svelte:862:15 {"model":"llama3.1:latest","created_at":"2024-08-15T12:27:41.5371471Z","message":{"role":"assistant","content":" computations"},"done":false} Chat.svelte:862:15 {"model":"llama3.1:latest","created_at":"2024-08-15T12:27:41.6006251Z","message":{"role":"assistant","content":" are"},"done":false} Chat.svelte:862:15 {"model":"llama3.1:latest","created_at":"2024-08-15T12:27:41.6652774Z","message":{"role":"assistant","content":" usually"},"done":false} Chat.svelte:862:15 {"model":"llama3.1:latest","created_at":"2024-08-15T12:27:41.7296308Z","message":{"role":"assistant","content":" done"},"done":false} Chat.svelte:862:15 {"model":"llama3.1:latest","created_at":"2024-08-15T12:27:41.7924326Z","message":{"role":"assistant","content":" on"},"done":false} Chat.svelte:862:15 {"model":"llama3.1:latest","created_at":"2024-08-15T12:27:41.856117Z","message":{"role":"assistant","content":" remote"},"done":false} Chat.svelte:862:15 {"model":"llama3.1:latest","created_at":"2024-08-15T12:27:41.9189016Z","message":{"role":"assistant","content":" servers"},"done":false} Chat.svelte:862:15 {"model":"llama3.1:latest","created_at":"2024-08-15T12:27:41.9827983Z","message":{"role":"assistant","content":","},"done":false} Chat.svelte:862:15 {"model":"llama3.1:latest","created_at":"2024-08-15T12:27:42.0438284Z","message":{"role":"assistant","content":" which"},"done":false} Chat.svelte:862:15 usage Object { models: (1) […] } +layout.svelte:130:13 {"model":"llama3.1:latest","created_at":"2024-08-15T12:27:42.1060931Z","message":{"role":"assistant","content":" are"},"done":false} Chat.svelte:862:15 {"model":"llama3.1:latest","created_at":"2024-08-15T12:27:42.1683093Z","message":{"role":"assistant","content":" designed"},"done":false} Chat.svelte:862:15 {"model":"llama3.1:latest","created_at":"2024-08-15T12:27:42.2285679Z","message":{"role":"assistant","content":" to"},"done":false} Chat.svelte:862:15 {"model":"llama3.1:latest","created_at":"2024-08-15T12:27:42.2893661Z","message":{"role":"assistant","content":" handle"},"done":false} Chat.svelte:862:15 {"model":"llama3.1:latest","created_at":"2024-08-15T12:27:42.350453Z","message":{"role":"assistant","content":" multiple"},"done":false} Chat.svelte:862:15 {"model":"llama3.1:latest","created_at":"2024-08-15T12:27:42.4130544Z","message":{"role":"assistant","content":" requests"},"done":false} Chat.svelte:862:15 {"model":"llama3.1:latest","created_at":"2024-08-15T12:27:42.4742198Z","message":{"role":"assistant","content":" simultaneously"},"done":false} Chat.svelte:862:15 {"model":"llama3.1:latest","created_at":"2024-08-15T12:27:42.5361236Z","message":{"role":"assistant","content":"."},"done":false} Chat.svelte:862:15 {"model":"llama3.1:latest","created_at":"2024-08-15T12:27:42.5972138Z","message":{"role":"assistant","content":" However"},"done":false} Chat.svelte:862:15 {"model":"llama3.1:latest","created_at":"2024-08-15T12:27:42.6639927Z","message":{"role":"assistant","content":","},"done":false} Chat.svelte:862:15 {"model":"llama3.1:latest","created_at":"2024-08-15T12:27:42.7263844Z","message":{"role":"assistant","content":" if"},"done":false} Chat.svelte:862:15 {"model":"llama3.1:latest","created_at":"2024-08-15T12:27:42.7871458Z","message":{"role":"assistant","content":" there"},"done":false} Chat.svelte:862:15 {"model":"llama3.1:latest","created_at":"2024-08-15T12:27:42.8490228Z","message":{"role":"assistant","content":"'s"},"done":false} Chat.svelte:862:15 {"model":"llama3.1:latest","created_at":"2024-08-15T12:27:42.9086006Z","message":{"role":"assistant","content":" an"},"done":false} Chat.svelte:862:15 {"model":"llama3.1:latest","created_at":"2024-08-15T12:27:42.9724504Z","message":{"role":"assistant","content":" overwhelming"},"done":false} Chat.svelte:862:15 {"model":"llama3.1:latest","created_at":"2024-08-15T12:27:43.0328453Z","message":{"role":"assistant","content":" surge"},"done":false} Chat.svelte:862:15 {"model":"llama3.1:latest","created_at":"2024-08-15T12:27:43.0927746Z","message":{"role":"assistant","content":" in"},"done":false} Chat.svelte:862:15 usage Object { models: (1) […] } +layout.svelte:130:13 {"model":"llama3.1:latest","created_at":"2024-08-15T12:27:43.1558914Z","message":{"role":"assistant","content":" traffic"},"done":false} Chat.svelte:862:15 {"model":"llama3.1:latest","created_at":"2024-08-15T12:27:43.2169829Z","message":{"role":"assistant","content":" ("},"done":false} Chat.svelte:862:15 {"model":"llama3.1:latest","created_at":"2024-08-15T12:27:43.2770958Z","message":{"role":"assistant","content":"like"},"done":false} Chat.svelte:862:15 {"model":"llama3.1:latest","created_at":"2024-08-15T12:27:43.3392113Z","message":{"role":"assistant","content":" during"},"done":false} Chat.svelte:862:15 {"model":"llama3.1:latest","created_at":"2024-08-15T12:27:43.3987346Z","message":{"role":"assistant","content":" a"},"done":false} Chat.svelte:862:15 {"model":"llama3.1:latest","created_at":"2024-08-15T12:27:43.4607152Z","message":{"role":"assistant","content":" global"},"done":false} Chat.svelte:862:15 {"model":"llama3.1:latest","created_at":"2024-08-15T12:27:43.5207846Z","message":{"role":"assistant","content":" crisis"},"done":false} Chat.svelte:862:15 {"model":"llama3.1:latest","created_at":"2024-08-15T12:27:43.5818753Z","message":{"role":"assistant","content":" or"},"done":false} Chat.svelte:862:15 {"model":"llama3.1:latest","created_at":"2024-08-15T12:27:43.6446029Z","message":{"role":"assistant","content":" when"},"done":false} Chat.svelte:862:15 {"model":"llama3.1:latest","created_at":"2024-08-15T12:27:43.7050335Z","message":{"role":"assistant","content":" I"},"done":false} Chat.svelte:862:15 {"model":"llama3.1:latest","created_at":"2024-08-15T12:27:43.7704873Z","message":{"role":"assistant","content":"'m"},"done":false} Chat.svelte:862:15 {"model":"llama3.1:latest","created_at":"2024-08-15T12:27:43.8320445Z","message":{"role":"assistant","content":" handling"},"done":false} Chat.svelte:862:15 {"model":"llama3.1:latest","created_at":"2024-08-15T12:27:43.8921448Z","message":{"role":"assistant","content":" a"},"done":false} Chat.svelte:862:15 {"model":"llama3.1:latest","created_at":"2024-08-15T12:27:43.9558501Z","message":{"role":"assistant","content":" large"},"done":false} Chat.svelte:862:15 {"model":"llama3.1:latest","created_at":"2024-08-15T12:27:44.0172965Z","message":{"role":"assistant","content":" influx"},"done":false} Chat.svelte:862:15 {"model":"llama3.1:latest","created_at":"2024-08-15T12:27:44.0774426Z","message":{"role":"assistant","content":" of"},"done":false} Chat.svelte:862:15 usage Object { models: (1) […] } +layout.svelte:130:13 {"model":"llama3.1:latest","created_at":"2024-08-15T12:27:44.1402125Z","message":{"role":"assistant","content":" conversations"},"done":false} Chat.svelte:862:15 {"model":"llama3.1:latest","created_at":"2024-08-15T12:27:44.2022195Z","message":{"role":"assistant","content":"),"},"done":false} Chat.svelte:862:15 {"model":"llama3.1:latest","created_at":"2024-08-15T12:27:44.2639268Z","message":{"role":"assistant","content":" my"},"done":false} Chat.svelte:862:15 {"model":"llama3.1:latest","created_at":"2024-08-15T12:27:44.32213Z","message":{"role":"assistant","content":" resource"},"done":false} Chat.svelte:862:15 {"model":"llama3.1:latest","created_at":"2024-08-15T12:27:44.3831763Z","message":{"role":"assistant","content":" usage"},"done":false} Chat.svelte:862:15 {"model":"llama3.1:latest","created_at":"2024-08-15T12:27:44.4459858Z","message":{"role":"assistant","content":" might"},"done":false} Chat.svelte:862:15 {"model":"llama3.1:latest","created_at":"2024-08-15T12:27:44.5064235Z","message":{"role":"assistant","content":" increase"},"done":false} Chat.svelte:862:15 {"model":"llama3.1:latest","created_at":"2024-08-15T12:27:44.5678407Z","message":{"role":"assistant","content":".\n\n"},"done":false} Chat.svelte:862:15 {"model":"llama3.1:latest","created_at":"2024-08-15T12:27:44.629062Z","message":{"role":"assistant","content":"If"},"done":false} Chat.svelte:862:15 {"model":"llama3.1:latest","created_at":"2024-08-15T12:27:44.6894683Z","message":{"role":"assistant","content":" you"},"done":false} Chat.svelte:862:15 {"model":"llama3.1:latest","created_at":"2024-08-15T12:27:44.7513221Z","message":{"role":"assistant","content":" ever"},"done":false} Chat.svelte:862:15 {"model":"llama3.1:latest","created_at":"2024-08-15T12:27:44.8163573Z","message":{"role":"assistant","content":" notice"},"done":false} Chat.svelte:862:15 {"model":"llama3.1:latest","created_at":"2024-08-15T12:27:44.8796781Z","message":{"role":"assistant","content":" me"},"done":false} Chat.svelte:862:15 {"model":"llama3.1:latest","created_at":"2024-08-15T12:27:44.9409914Z","message":{"role":"assistant","content":" being"},"done":false} Chat.svelte:862:15 {"model":"llama3.1:latest","created_at":"2024-08-15T12:27:45.0031091Z","message":{"role":"assistant","content":" slow"},"done":false} Chat.svelte:862:15 {"model":"llama3.1:latest","created_at":"2024-08-15T12:27:45.0648669Z","message":{"role":"assistant","content":" or"},"done":false} Chat.svelte:862:15 {"model":"llama3.1:latest","created_at":"2024-08-15T12:27:45.1275613Z","message":{"role":"assistant","content":" struggling"},"done":false} Chat.svelte:862:15 usage Object { models: (1) […] } +layout.svelte:130:13 {"model":"llama3.1:latest","created_at":"2024-08-15T12:27:45.190333Z","message":{"role":"assistant","content":" to"},"done":false} Chat.svelte:862:15 {"model":"llama3.1:latest","created_at":"2024-08-15T12:27:45.2524761Z","message":{"role":"assistant","content":" respond"},"done":false} Chat.svelte:862:15 {"model":"llama3.1:latest","created_at":"2024-08-15T12:27:45.3124534Z","message":{"role":"assistant","content":","},"done":false} Chat.svelte:862:15 {"model":"llama3.1:latest","created_at":"2024-08-15T12:27:45.3754144Z","message":{"role":"assistant","content":" it"},"done":false} Chat.svelte:862:15 {"model":"llama3.1:latest","created_at":"2024-08-15T12:27:45.4363297Z","message":{"role":"assistant","content":"'s"},"done":false} Chat.svelte:862:15 {"model":"llama3.1:latest","created_at":"2024-08-15T12:27:45.4999298Z","message":{"role":"assistant","content":" likely"},"done":false} Chat.svelte:862:15 {"model":"llama3.1:latest","created_at":"2024-08-15T12:27:45.5608112Z","message":{"role":"assistant","content":" due"},"done":false} Chat.svelte:862:15 {"model":"llama3.1:latest","created_at":"2024-08-15T12:27:45.6198082Z","message":{"role":"assistant","content":" to"},"done":false} Chat.svelte:862:15 {"model":"llama3.1:latest","created_at":"2024-08-15T12:27:45.6817297Z","message":{"role":"assistant","content":" these"},"done":false} Chat.svelte:862:15 {"model":"llama3.1:latest","created_at":"2024-08-15T12:27:45.7435682Z","message":{"role":"assistant","content":" factors"},"done":false} Chat.svelte:862:15 {"model":"llama3.1:latest","created_at":"2024-08-15T12:27:45.806422Z","message":{"role":"assistant","content":"!"},"done":false} Chat.svelte:862:15 {"model":"llama3.1:latest","created_at":"2024-08-15T12:27:45.8706206Z","message":{"role":"assistant","content":""},"done_reason":"stop","done":true,"total_duration":28009254000,"load_duration":8597506300,"prompt_eval_count":65,"prompt_eval_duration":3542382000,"eval_count":257,"eval_duration":15856827000} Chat.svelte:862:15 usage Object { models: [] } +layout.svelte:130:13 Wake Lock released +layout.svelte:69:13 ``` [Include relevant browser console logs, if applicable] **Docker Container Logs:** ``` Loading WEBUI_SECRET_KEY from file, not provided as an environment variable. Loading WEBUI_SECRET_KEY from .webui_secret_key USER_AGENT environment variable not set, consider setting it to identify your requests. INFO: Started server process [1] INFO: Waiting for application startup. /app ___ __ __ _ _ _ ___ / _ \ _ __ ___ _ __ \ \ / /__| |__ | | | |_ _| | | | | '_ \ / _ \ '_ \ \ \ /\ / / _ \ '_ \| | | || | | |_| | |_) | __/ | | | \ V V / __/ |_) | |_| || | \___/| .__/ \___|_| |_| \_/\_/ \___|_.__/ \___/|___| |_| v0.3.12 - building the best open-source AI user interface. https://github.com/open-webui/open-webui INFO [alembic.runtime.migration] Context impl SQLiteImpl. INFO [alembic.runtime.migration] Will assume non-transactional DDL. INFO: Application startup complete. INFO: Uvicorn running on http://0.0.0.0:8080 (Press CTRL+C to quit) INFO [apps.ollama.main] get_all_models() INFO: 172.17.0.1:54132 - "GET /ws/socket.io/?EIO=4&transport=polling&t=P5M0I5X HTTP/1.1" 200 OK user [REDACTED](1df0ae1f-2347-4869-ae48-3e84d248d7a0) connected with session ID nlKRfftnWkg0MefDAAAB INFO: 172.17.0.1:54136 - "POST /ws/socket.io/?EIO=4&transport=polling&t=P5M0I61&sid=2ht_4XadLPUeR4kFAAAA HTTP/1.1" 200 OK INFO: 172.17.0.1:54150 - "GET /ws/socket.io/?EIO=4&transport=polling&t=P5M0I62&sid=2ht_4XadLPUeR4kFAAAA HTTP/1.1" 200 OK INFO: ('172.17.0.1', 54168) - "WebSocket /ws/socket.io/?EIO=4&transport=websocket&sid=2ht_4XadLPUeR4kFAAAA" [accepted] INFO: connection open INFO: 172.17.0.1:54156 - "GET /ws/socket.io/?EIO=4&transport=polling&t=P5M0I6P&sid=2ht_4XadLPUeR4kFAAAA HTTP/1.1" 200 OK INFO: 172.17.0.1:58806 - "GET /api/v1/users/user/settings HTTP/1.1" 200 OK INFO: 172.17.0.1:58810 - "GET /api/v1/users/user/settings HTTP/1.1" 200 OK INFO: 172.17.0.1:52356 - "POST /api/v1/chats/new HTTP/1.1" 200 OK INFO: 172.17.0.1:52358 - "GET /api/v1/chats/?page=1 HTTP/1.1" 200 OK INFO [apps.ollama.main] url: http://192.168.50.10:11434 INFO: 172.17.0.1:52368 - "POST /ollama/api/chat HTTP/1.1" 200 OK INFO: 172.17.0.1:47000 - "POST /api/chat/completed HTTP/1.1" 200 OK INFO: 172.17.0.1:47006 - "POST /api/v1/chats/dcd7198d-4369-44a5-bafa-7c3cfdd3eb70 HTTP/1.1" 200 OK INFO: 172.17.0.1:47022 - "GET /api/v1/chats/?page=1 HTTP/1.1" 200 OK INFO: 172.17.0.1:47034 - "POST /api/v1/chats/dcd7198d-4369-44a5-bafa-7c3cfdd3eb70 HTTP/1.1" 200 OK INFO: 172.17.0.1:47040 - "GET /api/v1/chats/?page=1 HTTP/1.1" 200 OK INFO [apps.ollama.main] url: http://192.168.50.10:11434 generate_title llama3.1:latest generate_ollama_chat_completion INFO: 172.17.0.1:47046 - "POST /api/task/title/completions HTTP/1.1" 200 OK INFO: 172.17.0.1:47060 - "POST /api/v1/chats/dcd7198d-4369-44a5-bafa-7c3cfdd3eb70 HTTP/1.1" 200 OK INFO: 172.17.0.1:47062 - "GET /api/v1/chats/?page=1 HTTP/1.1" 200 OK INFO: 172.17.0.1:47074 - "GET /api/v1/chats/?page=1 HTTP/1.1" 200 OK INFO [apps.ollama.main] url: http://192.168.50.10:11434 ['nlKRfftnWkg0MefDAAAB'] INFO: 172.17.0.1:46196 - "POST /ollama/api/chat HTTP/1.1" 200 OK INFO: 172.17.0.1:33698 - "POST /api/chat/completed HTTP/1.1" 200 OK INFO: 172.17.0.1:33700 - "POST /api/v1/chats/dcd7198d-4369-44a5-bafa-7c3cfdd3eb70 HTTP/1.1" 200 OK INFO: 172.17.0.1:33710 - "GET /api/v1/chats/?page=1 HTTP/1.1" 200 OK INFO: 172.17.0.1:33712 - "POST /api/v1/chats/dcd7198d-4369-44a5-bafa-7c3cfdd3eb70 HTTP/1.1" 200 OK INFO: 172.17.0.1:33724 - "GET /api/v1/chats/?page=1 HTTP/1.1" 200 OK INFO: 172.17.0.1:33730 - "GET /api/v1/chats/?page=1 HTTP/1.1" 200 OK ``` **Screenshots/Screen Recordings (if applicable):** See above ## Additional Information N/A
Sign in to join this conversation.
No Branch/Tag Specified
Branches Tags
Labels
Clear labels
bug
core
documentation
enhancement
good first issue
help wanted
non-core
pull-request
Mirrored from GitHub Pull Request
 python
question
testing wanted
No Label
Milestone
No items
No Milestone
Projects
Clear projects
No project
Assignees
Clear assignees
GiteaMirror ninjasurge
No Assignees
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: github-starred/open-webui#1784
Delete Branch "%!s()"

Deleting a branch is permanent. Although the deleted branch may continue to exist for a short time before it actually gets removed, it CANNOT be undone in most cases. Continue?