github-starred/ollama
2
0
Fork 0
mirror of https://github.com/ollama/ollama.git synced 2026-05-07 08:30:05 -05:00
Code Issues 14.5k Packages Projects Releases 120 Wiki Activity

[GH-ISSUE #3147] v0.1.28 breaks llava models #1936

New Issue
Closed
opened 2026-04-12 12:04:20 -05:00 by GiteaMirror · 3 comments
GiteaMirror commented 2026-04-12 12:04:20 -05:00
Owner
Copy Link

Originally created by @codearranger on GitHub (Mar 14, 2024).
Original GitHub issue: https://github.com/ollama/ollama/issues/3147

Using the example curl command from https://ollama.com/library/llava:latest

curl http://localhost:11434/api/generate -d '{
  "model": "llava",
  "prompt":"What is in this picture?",
  "images": ["iVBORw0KGgoAAAANSUhEUgAAAG0AAABmCAYAAADBPx+VAAAACXBIWXMAAAsTAAALEwEAmpwYAAAAAXNSR0IArs4c6QAAAARnQU1BAACxjwv8YQUAAA3VSURBVHgB7Z27r0zdG8fX743i1bi1ikMoFMQloXRpKFFIqI7LH4BEQ+NWIkjQuSWCRIEoULk0gsK1kCBI0IhrQVT7tz/7zZo888yz1r7MnDl7z5xvsjkzs2fP3uu71nNfa7lkAsm7d++Sffv2JbNmzUqcc8m0adOSzZs3Z+/XES4ZckAWJEGWPiCxjsQNLWmQsWjRIpMseaxcuTKpG/7HP27I8P79e7dq1ars/yL4/v27S0ejqwv+cUOGEGGpKHR37tzJCEpHV9tnT58+dXXCJDdECBE2Ojrqjh071hpNECjx4cMHVycM1Uhbv359B2F79+51586daxN/+pyRkRFXKyRDAqxEp4yMlDDzXG1NPnnyJKkThoK0VFd1ELZu3TrzXKxKfW7dMBQ6bcuWLW2v0VlHjx41z717927ba22U9APcw7Nnz1oGEPeL3m3p2mTAYYnFmMOMXybPPXv2bNIPpFZr1NHn4HMw0KRBjg9NuRw95s8PEcz/6DZELQd/09C9QGq5RsmSRybqkwHGjh07OsJSsYYm3ijPpyHzoiacg35MLdDSIS/O1yM778jOTwYUkKNHWUzUWaOsylE00MyI0fcnOwIdjvtNdW/HZwNLGg+sR1kMepSNJXmIwxBZiG8tDTpEZzKg0GItNsosY8USkxDhD0Rinuiko2gfL/RbiD2LZAjU9zKQJj8RDR0vJBR1/Phx9+PHj9Z7REF4nTZkxzX4LCXHrV271qXkBAPGfP/atWvu/PnzHe4C97F48eIsRLZ9+3a3f/9+87dwP1JxaF7/3r17ba+5l4EcaVo0lj3SBq5kGTJSQmLWMjgYNei2GPT1MuMqGTDEFHzeQSP2wi/jGnkmPJ/nhccs44jvDAxpVcxnq0F6eT8h4ni/iIWpR5lPyA6ETkNXoSukvpJAD3AsXLiwpZs49+fPn5ke4j10TqYvegSfn0OnafC+Tv9ooA/JPkgQysqQNBzagXY55nO/oa1F7qvIPWkRL12WRpMWUvpVDYmxAPehxWSe8ZEXL20sadYIozfmNch4QJPAfeJgW3rNsnzphBKNJM2KKODo1rVOMRYik5ETy3ix4qWNI81qAAirizgMIc+yhTytx0JWZuNI03qsrgWlGtwjoS9XwgUhWGyhUaRZZQNNIEwCiXD16tXcAHUs79co0vSD8rrJCIW98pzvxpAWyyo3HYwqS0+H0BjStClcZJT5coMm6D2LOF8TolGJtK9fvyZpyiC5ePFi9nc/oJU4eiEP0jVoAnHa9wyJycITMP78+eMeP37sXrx44d6+fdt6f82aNdkx1pg9e3Zb5W+RSRE+n+VjksQWifvVaTKFhn5O8my63K8Qabdv33b379/PiAP//vuvW7BggZszZ072/+TJk91YgkafPn166zXB1rQHFvouAWHq9z3SEevSUerqCn2/dDCeta2jxYbr69evk4MHDyY7d+7MjhMnTiTPnz9Pfv/+nfQT2ggpO2dMF8cghuoM7Ygj5iWCqRlGFml0QC/ftGmTmzt3rmsaKDsgBSPh0/8yPeLLBihLkOKJc0jp8H8vUzcxIA1k6QJ/c78tWEyj5P3o4u9+jywNPdJi5rAH9x0KHcl4Hg570eQp3+vHXGyrmEeigzQsQsjavXt38ujRo44LQuDDhw+TW7duRS1HGgMxhNXHgflaNTOsHyKvHK5Ijo2jbFjJBQK9YwFd6RVMzfgRBmEfP37suBBm/p49e1qjEP2mwTViNRo0VJWH1deMXcNK08uUjVUu7s/zRaL+oLNxz1bpANco4npUgX4G2eFbpDFyQoQxojBCpEGSytmOH8qrH5Q9vuzD6ofQylkCUmh8DBAr+q8JCyVNtWQIidKQE9wNtLSQnS4jDSsxNHogzFuQBw4cyM61UKVsjfr3ooBkPSqqQHesUPWVtzi9/vQi1T+rJj7WiTz4Pt/l3LxUkr5P2VYZaZ4URpsE+st/dujQoaBBYokbrz/8TJNQYLSonrPS9kUaSkPeZyj1AWSj+d+VBoy1pIWVNed8P0Ll/ee5HdGRhrHhR5GGN0r4LGZBaj8oFDJitBTJzIZgFcmU0Y8ytWMZMzJOaXUSrUs5RxKnrxmbb5YXO9VGUhtpXldhEUogFr3IzIsvlpmdosVcGVGXFWp2oU9kLFL3dEkSz6NHEY1sjSRdIuDFWEhd8KxFqsRi1uM/nz9/zpxnwlESONdg6dKlbsaMGS4EHFHtjFIDHwKOo46l4TxSuxgDzi+rE2jg+BaFruOX4HXa0Nnf1lwAPufZeF8/r6zD97WK2qFnGjBxTw5qNGPxT+5T/r7/7RawFC3j4vTp09koCxkeHjqbHJqArmH5UrFKKksnxrK7FuRIs8STfBZv+luugXZ2pR/pP9Ois4z+TiMzUUkUjD0iEi1fzX8GmXyuxUBRcaUfykV0YZnlJGKQpOiGB76x5GeWkWWJc3mOrK6S7xdND+W5N6XyaRgtWJFe13GkaZnKOsYqGdOVVVbGupsyA/l7emTLHi7vwTdirNEt0qxnzAvBFcnQF16xh/TMpUuXHDowhlA9vQVraQhkudRdzOnK+04ZSP3DUhVSP61YsaLtd/ks7ZgtPcXqPqEafHkdqa84X6aCeL7YWlv6edGFHb+ZFICPlljHhg0bKuk0CSvVznWsotRu433alNdFrqG45ejoaPCaUkWERpLXjzFL2Rpllp7PJU2a/v7Ab8N05/9t27Z16KUqoFGsxnI9EosS2niSYg9SpU6B4JgTrvVW1flt1sT+0ADIJU2maXzcUTraGCRaL1Wp9rUMk16PMom8QhruxzvZIegJjFU7LLCePfS8uaQdPny4jTTL0dbee5mYokQsXTIWNY46kuMbnt8Kmec+LGWtOVIl9cT1rCB0V8WqkjAsRwta93TbwNYoGKsUSChN44lgBNCoHLHzquYKrU6qZ8lolCIN0Rh6cP0Q3U6I6IXILYOQI513hJaSKAorFpuHXJNfVlpRtmYBk1Su1obZr5dnKAO+L10Hrj3WZW+E3qh6IszE37F6EB+68mGpvKm4eb9bFrlzrok7fvr0Kfv727dvWRmdVTJHw0qiiCUSZ6wCK+7XL/AcsgNyL74DQQ730sv78Su7+t/A36MdY0sW5o40ahslXr58aZ5HtZB8GH64m9EmMZ7FpYw4T6QnrZfgenrhFxaSiSGXtPnz57e9TkNZLvTjeqhr734CNtrK41L40sUQckmj1lGKQ0rC37x544r8eNXRpnVE3ZZY7zXo8NomiO0ZUCj2uHz58rbXoZ6gc0uA+F6ZeKS/jhRDUq8MKrTho9fEkihMmhxtBI1DxKFY9XLpVcSkfoi8JGnToZO5sU5aiDQIW716ddt7ZLYtMQlhECdBGXZZMWldY5BHm5xgAroWj4C0hbYkSc/jBmggIrXJWlZM6pSETsEPGqZOndr2uuuR5rF169a2HoHPdurUKZM4CO1WTPqaDaAd+GFGKdIQkxAn9RuEWcTRyN2KSUgiSgF5aWzPTeA/lN5rZubMmR2bE4SIC4nJoltgAV/dVefZm72AtctUCJU2CMJ327hxY9t7EHbkyJFseq+EJSY16RPo3Dkq1kkr7+q0bNmyDuLQcZBEPYmHVdOBiJyIlrRDq41YPWfXOxUysi5fvtyaj+2BpcnsUV/oSoEMOk2CQGlr4ckhBwaetBhjCwH0ZHtJROPJkyc7UjcYLDjmrH7ADTEBXFfOYmB0k9oYBOjJ8b4aOYSe7QkKcYhFlq3QYLQhSidNmtS2RATwy8YOM3EQJsUjKiaWZ+vZToUQgzhkHXudb/PW5YMHD9yZM2faPsMwoc7RciYJXbGuBqJ1UIGKKLv915jsvgtJxCZDubdXr165mzdvtr1Hz5LONA8jrUwKPqsmVesKa49S3Q4WxmRPUEYdTjgiUcfUwLx589ySJUva3oMkP6IYddq6HMS4o55xBJBUeRjzfa4Zdeg56QZ43LhxoyPo7Lf1kNt7oO8wWAbNwaYjIv5lhyS7kRf96dvm5Jah8vfvX3flyhX35cuX6HfzFHOToS1H4BenCaHvO8pr8iDuwoUL7tevX+b5ZdbBair0xkFIlFDlW4ZknEClsp/TzXyAKVOmmHWFVSbDNw1l1+4f90U6IY/q4V27dpnE9bJ+v87QEydjqx/UamVVPRG+mwkNTYN+9tjkwzEx+atCm/X9WvWtDtAb68Wy9LXa1UmvCDDIpPkyOQ5ZwSzJ4jMrvFcr0rSjOUh+GcT4LSg5ugkW1Io0/SCDQBojh0hPlaJdah+tkVYrnTZowP8iq1F1TgMBBauufyB33x1v+NWFYmT5KmppgHC+NkAgbmRkpD3yn9QIseXymoTQFGQmIOKTxiZIWpvAatenVqRVXf2nTrAWMsPnKrMZHz6bJq5jvce6QK8J1cQNgKxlJapMPdZSR64/UivS9NztpkVEdKcrs5alhhWP9NeqlfWopzhZScI6QxseegZRGeg5a8C3Re1Mfl1ScP36ddcUaMuv24iOJtz7sbUjTS4qBvKmstYJoUauiuD3k5qhyr7QdUHMeCgLa1Ear9NquemdXgmum4fvJ6w1lqsuDhNrg1qSpleJK7K3TF0Q2jSd94uSZ60kK1e3qyVpQK6PVWXp2/FC3mp6jBhKKOiY2h3gtUV64TWM6wDETRPLDfSakXmH3w8g9Jlug8ZtTt4kVF0kLUYYmCCtD/DrQ5YhMGbA9L3ucdjh0y8kOHW5gU/VEEmJTcL4Pz/f7mgoAbYkAAAAAElFTkSuQmCC"]
}'

With 0.1.27 we get the following result which is correct:

{"model":"llava","created_at":"2024-03-14T18:48:39.892743Z","response":" The","done":false}
{"model":"llava","created_at":"2024-03-14T18:48:39.902493399Z","response":" image","done":false}
{"model":"llava","created_at":"2024-03-14T18:48:39.912723781Z","response":" you","done":false}
{"model":"llava","created_at":"2024-03-14T18:48:39.922418535Z","response":"'","done":false}
{"model":"llava","created_at":"2024-03-14T18:48:39.932232811Z","response":"ve","done":false}
{"model":"llava","created_at":"2024-03-14T18:48:39.941861663Z","response":" shared","done":false}
{"model":"llava","created_at":"2024-03-14T18:48:39.95127562Z","response":" is","done":false}
{"model":"llava","created_at":"2024-03-14T18:48:39.960647773Z","response":" a","done":false}
{"model":"llava","created_at":"2024-03-14T18:48:39.96999504Z","response":" cart","done":false}
{"model":"llava","created_at":"2024-03-14T18:48:39.979236925Z","response":"oon","done":false}
{"model":"llava","created_at":"2024-03-14T18:48:39.988649335Z","response":" of","done":false}
{"model":"llava","created_at":"2024-03-14T18:48:39.998155111Z","response":" a","done":false}
{"model":"llava","created_at":"2024-03-14T18:48:40.007514919Z","response":" character","done":false}
{"model":"llava","created_at":"2024-03-14T18:48:40.016850803Z","response":" w","done":false}
{"model":"llava","created_at":"2024-03-14T18:48:40.026027237Z","response":"aving","done":false}
{"model":"llava","created_at":"2024-03-14T18:48:40.035208349Z","response":".","done":false}
{"model":"llava","created_at":"2024-03-14T18:48:40.0449605Z","response":" It","done":false}
{"model":"llava","created_at":"2024-03-14T18:48:40.054329288Z","response":" appears","done":false}
{"model":"llava","created_at":"2024-03-14T18:48:40.063508191Z","response":" to","done":false}
{"model":"llava","created_at":"2024-03-14T18:48:40.072706446Z","response":" be","done":false}
{"model":"llava","created_at":"2024-03-14T18:48:40.0818883Z","response":" an","done":false}
{"model":"llava","created_at":"2024-03-14T18:48:40.091155598Z","response":" animated","done":false}
{"model":"llava","created_at":"2024-03-14T18:48:40.100472991Z","response":" animal","done":false}
{"model":"llava","created_at":"2024-03-14T18:48:40.109727798Z","response":" with","done":false}
{"model":"llava","created_at":"2024-03-14T18:48:40.119072039Z","response":" a","done":false}
{"model":"llava","created_at":"2024-03-14T18:48:40.128385397Z","response":" cheer","done":false}
{"model":"llava","created_at":"2024-03-14T18:48:40.137673222Z","response":"ful","done":false}
{"model":"llava","created_at":"2024-03-14T18:48:40.147012243Z","response":" de","done":false}
{"model":"llava","created_at":"2024-03-14T18:48:40.156322671Z","response":"mean","done":false}
{"model":"llava","created_at":"2024-03-14T18:48:40.165747911Z","response":"or","done":false}
{"model":"llava","created_at":"2024-03-14T18:48:40.175332396Z","response":",","done":false}
{"model":"llava","created_at":"2024-03-14T18:48:40.184638251Z","response":" likely","done":false}
{"model":"llava","created_at":"2024-03-14T18:48:40.193956749Z","response":" designed","done":false}
{"model":"llava","created_at":"2024-03-14T18:48:40.20326162Z","response":" to","done":false}
{"model":"llava","created_at":"2024-03-14T18:48:40.212528856Z","response":" ev","done":false}
{"model":"llava","created_at":"2024-03-14T18:48:40.221887008Z","response":"oke","done":false}
{"model":"llava","created_at":"2024-03-14T18:48:40.231093223Z","response":" a","done":false}
{"model":"llava","created_at":"2024-03-14T18:48:40.240325681Z","response":" sense","done":false}
{"model":"llava","created_at":"2024-03-14T18:48:40.249555463Z","response":" of","done":false}
{"model":"llava","created_at":"2024-03-14T18:48:40.258873527Z","response":" happiness","done":false}
{"model":"llava","created_at":"2024-03-14T18:48:40.268114214Z","response":" or","done":false}
{"model":"llava","created_at":"2024-03-14T18:48:40.277427953Z","response":" play","done":false}
{"model":"llava","created_at":"2024-03-14T18:48:40.287178421Z","response":"fulness","done":false}
{"model":"llava","created_at":"2024-03-14T18:48:40.296603404Z","response":".","done":false}
{"model":"llava","created_at":"2024-03-14T18:48:40.30596708Z","response":" The","done":false}
{"model":"llava","created_at":"2024-03-14T18:48:40.315303545Z","response":" character","done":false}
{"model":"llava","created_at":"2024-03-14T18:48:40.324741421Z","response":" seems","done":false}
{"model":"llava","created_at":"2024-03-14T18:48:40.33417479Z","response":" to","done":false}
{"model":"llava","created_at":"2024-03-14T18:48:40.343508475Z","response":" be","done":false}
{"model":"llava","created_at":"2024-03-14T18:48:40.352945709Z","response":" moving","done":false}
{"model":"llava","created_at":"2024-03-14T18:48:40.362357751Z","response":",","done":false}
{"model":"llava","created_at":"2024-03-14T18:48:40.371702145Z","response":" as","done":false}
{"model":"llava","created_at":"2024-03-14T18:48:40.381167011Z","response":" suggested","done":false}
{"model":"llava","created_at":"2024-03-14T18:48:40.390572108Z","response":" by","done":false}
{"model":"llava","created_at":"2024-03-14T18:48:40.400132521Z","response":" the","done":false}
{"model":"llava","created_at":"2024-03-14T18:48:40.41006519Z","response":" blur","done":false}
{"model":"llava","created_at":"2024-03-14T18:48:40.420147404Z","response":"ring","done":false}
{"model":"llava","created_at":"2024-03-14T18:48:40.429432733Z","response":" effect","done":false}
{"model":"llava","created_at":"2024-03-14T18:48:40.43877958Z","response":" on","done":false}
{"model":"llava","created_at":"2024-03-14T18:48:40.448155073Z","response":" its","done":false}
{"model":"llava","created_at":"2024-03-14T18:48:40.457480579Z","response":" body","done":false}
{"model":"llava","created_at":"2024-03-14T18:48:40.466953213Z","response":",","done":false}
{"model":"llava","created_at":"2024-03-14T18:48:40.476393087Z","response":" indicating","done":false}
{"model":"llava","created_at":"2024-03-14T18:48:40.485779189Z","response":" motion","done":false}
{"model":"llava","created_at":"2024-03-14T18:48:40.49521034Z","response":" or","done":false}
{"model":"llava","created_at":"2024-03-14T18:48:40.5046725Z","response":" action","done":false}
{"model":"llava","created_at":"2024-03-14T18:48:40.513909517Z","response":".","done":false}
{"model":"llava","created_at":"2024-03-14T18:48:40.522835869Z","response":" ","done":false}
{"model":"llava","created_at":"2024-03-14T18:48:40.532115251Z","response":"","done":true,"context":[733,16289,28793,1824,349,297,456,5754,28804,733,5422,28733,28734,28793,733,28748,16289,28793,415,3469,368,28742,333,6431,349,264,7548,4973,302,264,3233,275,1652,28723,661,8045,298,347,396,25693,8527,395,264,17096,1007,340,13646,271,28725,3917,5682,298,683,2656,264,3367,302,15079,442,1156,19965,28723,415,3233,3969,298,347,5272,28725,390,8750,486,272,19690,699,2030,356,871,2187,28725,17888,8036,442,2992,28723,28705],"total_duration":3678847752,"load_duration":2763386454,"prompt_eval_count":1,"prompt_eval_duration":274707000,"eval_count":69,"eval_duration":639238000}

with 0.1.28 we get a description of something that isn't in the image at all:

{"model":"llava","created_at":"2024-03-14T18:50:13.841492296Z","response":" The","done":false}
{"model":"llava","created_at":"2024-03-14T18:50:13.850897111Z","response":" image","done":false}
{"model":"llava","created_at":"2024-03-14T18:50:13.86010476Z","response":" shows","done":false}
{"model":"llava","created_at":"2024-03-14T18:50:13.868933822Z","response":" a","done":false}
{"model":"llava","created_at":"2024-03-14T18:50:13.877685382Z","response":" person","done":false}
{"model":"llava","created_at":"2024-03-14T18:50:13.886462319Z","response":" sitting","done":false}
{"model":"llava","created_at":"2024-03-14T18:50:13.895111881Z","response":" on","done":false}
{"model":"llava","created_at":"2024-03-14T18:50:13.903942696Z","response":" a","done":false}
{"model":"llava","created_at":"2024-03-14T18:50:13.912728179Z","response":" chair","done":false}
{"model":"llava","created_at":"2024-03-14T18:50:13.921911488Z","response":" with","done":false}
{"model":"llava","created_at":"2024-03-14T18:50:13.930570785Z","response":" their","done":false}
{"model":"llava","created_at":"2024-03-14T18:50:13.939138053Z","response":" feet","done":false}
{"model":"llava","created_at":"2024-03-14T18:50:13.947699488Z","response":" up","done":false}
{"model":"llava","created_at":"2024-03-14T18:50:13.956352675Z","response":".","done":false}
{"model":"llava","created_at":"2024-03-14T18:50:13.964866271Z","response":" They","done":false}
{"model":"llava","created_at":"2024-03-14T18:50:13.973549445Z","response":" are","done":false}
{"model":"llava","created_at":"2024-03-14T18:50:13.982138378Z","response":" wearing","done":false}
{"model":"llava","created_at":"2024-03-14T18:50:13.990776154Z","response":" a","done":false}
{"model":"llava","created_at":"2024-03-14T18:50:13.999363861Z","response":" light","done":false}
{"model":"llava","created_at":"2024-03-14T18:50:14.008031399Z","response":"-","done":false}
{"model":"llava","created_at":"2024-03-14T18:50:14.016645026Z","response":"colored","done":false}
{"model":"llava","created_at":"2024-03-14T18:50:14.025272747Z","response":" top","done":false}
{"model":"llava","created_at":"2024-03-14T18:50:14.034026556Z","response":" and","done":false}
{"model":"llava","created_at":"2024-03-14T18:50:14.042764211Z","response":" dark","done":false}
{"model":"llava","created_at":"2024-03-14T18:50:14.051308101Z","response":" pants","done":false}
{"model":"llava","created_at":"2024-03-14T18:50:14.05999179Z","response":",","done":false}
{"model":"llava","created_at":"2024-03-14T18:50:14.068526561Z","response":" and","done":false}
{"model":"llava","created_at":"2024-03-14T18:50:14.077246111Z","response":" it","done":false}
{"model":"llava","created_at":"2024-03-14T18:50:14.08580068Z","response":" appears","done":false}
{"model":"llava","created_at":"2024-03-14T18:50:14.094624047Z","response":" to","done":false}
{"model":"llava","created_at":"2024-03-14T18:50:14.103192599Z","response":" be","done":false}
{"model":"llava","created_at":"2024-03-14T18:50:14.111909226Z","response":" an","done":false}
{"model":"llava","created_at":"2024-03-14T18:50:14.120413301Z","response":" indoor","done":false}
{"model":"llava","created_at":"2024-03-14T18:50:14.128975163Z","response":" setting","done":false}
{"model":"llava","created_at":"2024-03-14T18:50:14.137564677Z","response":".","done":false}
{"model":"llava","created_at":"2024-03-14T18:50:14.146038576Z","response":" There","done":false}
{"model":"llava","created_at":"2024-03-14T18:50:14.154740713Z","response":" is","done":false}
{"model":"llava","created_at":"2024-03-14T18:50:14.163283425Z","response":" no","done":false}
{"model":"llava","created_at":"2024-03-14T18:50:14.172394214Z","response":" clear","done":false}
{"model":"llava","created_at":"2024-03-14T18:50:14.180948803Z","response":" indication","done":false}
{"model":"llava","created_at":"2024-03-14T18:50:14.189562772Z","response":" of","done":false}
{"model":"llava","created_at":"2024-03-14T18:50:14.198215865Z","response":" the","done":false}
{"model":"llava","created_at":"2024-03-14T18:50:14.20693134Z","response":" specific","done":false}
{"model":"llava","created_at":"2024-03-14T18:50:14.215569373Z","response":" location","done":false}
{"model":"llava","created_at":"2024-03-14T18:50:14.22423472Z","response":" or","done":false}
{"model":"llava","created_at":"2024-03-14T18:50:14.232891021Z","response":" activity","done":false}
{"model":"llava","created_at":"2024-03-14T18:50:14.241488373Z","response":" taking","done":false}
{"model":"llava","created_at":"2024-03-14T18:50:14.250127781Z","response":" place","done":false}
{"model":"llava","created_at":"2024-03-14T18:50:14.258942464Z","response":".","done":false}
{"model":"llava","created_at":"2024-03-14T18:50:14.26761813Z","response":" ","done":false}
{"model":"llava","created_at":"2024-03-14T18:50:14.276847898Z","response":"","done":true,"context":[733,16289,28793,1824,349,297,456,5754,28804,733,28748,16289,28793,415,3469,4370,264,1338,6398,356,264,6225,395,652,4051,582,28723,1306,460,8192,264,2061,28733,28508,1830,304,3199,16721,28725,304,378,8045,298,347,396,24990,5587,28723,1387,349,708,3081,24183,302,272,2948,4723,442,6355,3344,1633,28723,28705],"total_duration":3169346961,"load_duration":2677211828,"prompt_eval_count":19,"prompt_eval_duration":55844000,"eval_count":51,"eval_duration":435178000}
Originally created by @codearranger on GitHub (Mar 14, 2024). Original GitHub issue: https://github.com/ollama/ollama/issues/3147 Using the example curl command from https://ollama.com/library/llava:latest ``` curl http://localhost:11434/api/generate -d '{ "model": "llava", "prompt":"What is in this picture?", "images": ["iVBORw0KGgoAAAANSUhEUgAAAG0AAABmCAYAAADBPx+VAAAACXBIWXMAAAsTAAALEwEAmpwYAAAAAXNSR0IArs4c6QAAAARnQU1BAACxjwv8YQUAAA3VSURBVHgB7Z27r0zdG8fX743i1bi1ikMoFMQloXRpKFFIqI7LH4BEQ+NWIkjQuSWCRIEoULk0gsK1kCBI0IhrQVT7tz/7zZo888yz1r7MnDl7z5xvsjkzs2fP3uu71nNfa7lkAsm7d++Sffv2JbNmzUqcc8m0adOSzZs3Z+/XES4ZckAWJEGWPiCxjsQNLWmQsWjRIpMseaxcuTKpG/7HP27I8P79e7dq1ars/yL4/v27S0ejqwv+cUOGEGGpKHR37tzJCEpHV9tnT58+dXXCJDdECBE2Ojrqjh071hpNECjx4cMHVycM1Uhbv359B2F79+51586daxN/+pyRkRFXKyRDAqxEp4yMlDDzXG1NPnnyJKkThoK0VFd1ELZu3TrzXKxKfW7dMBQ6bcuWLW2v0VlHjx41z717927ba22U9APcw7Nnz1oGEPeL3m3p2mTAYYnFmMOMXybPPXv2bNIPpFZr1NHn4HMw0KRBjg9NuRw95s8PEcz/6DZELQd/09C9QGq5RsmSRybqkwHGjh07OsJSsYYm3ijPpyHzoiacg35MLdDSIS/O1yM778jOTwYUkKNHWUzUWaOsylE00MyI0fcnOwIdjvtNdW/HZwNLGg+sR1kMepSNJXmIwxBZiG8tDTpEZzKg0GItNsosY8USkxDhD0Rinuiko2gfL/RbiD2LZAjU9zKQJj8RDR0vJBR1/Phx9+PHj9Z7REF4nTZkxzX4LCXHrV271qXkBAPGfP/atWvu/PnzHe4C97F48eIsRLZ9+3a3f/9+87dwP1JxaF7/3r17ba+5l4EcaVo0lj3SBq5kGTJSQmLWMjgYNei2GPT1MuMqGTDEFHzeQSP2wi/jGnkmPJ/nhccs44jvDAxpVcxnq0F6eT8h4ni/iIWpR5lPyA6ETkNXoSukvpJAD3AsXLiwpZs49+fPn5ke4j10TqYvegSfn0OnafC+Tv9ooA/JPkgQysqQNBzagXY55nO/oa1F7qvIPWkRL12WRpMWUvpVDYmxAPehxWSe8ZEXL20sadYIozfmNch4QJPAfeJgW3rNsnzphBKNJM2KKODo1rVOMRYik5ETy3ix4qWNI81qAAirizgMIc+yhTytx0JWZuNI03qsrgWlGtwjoS9XwgUhWGyhUaRZZQNNIEwCiXD16tXcAHUs79co0vSD8rrJCIW98pzvxpAWyyo3HYwqS0+H0BjStClcZJT5coMm6D2LOF8TolGJtK9fvyZpyiC5ePFi9nc/oJU4eiEP0jVoAnHa9wyJycITMP78+eMeP37sXrx44d6+fdt6f82aNdkx1pg9e3Zb5W+RSRE+n+VjksQWifvVaTKFhn5O8my63K8Qabdv33b379/PiAP//vuvW7BggZszZ072/+TJk91YgkafPn166zXB1rQHFvouAWHq9z3SEevSUerqCn2/dDCeta2jxYbr69evk4MHDyY7d+7MjhMnTiTPnz9Pfv/+nfQT2ggpO2dMF8cghuoM7Ygj5iWCqRlGFml0QC/ftGmTmzt3rmsaKDsgBSPh0/8yPeLLBihLkOKJc0jp8H8vUzcxIA1k6QJ/c78tWEyj5P3o4u9+jywNPdJi5rAH9x0KHcl4Hg570eQp3+vHXGyrmEeigzQsQsjavXt38ujRo44LQuDDhw+TW7duRS1HGgMxhNXHgflaNTOsHyKvHK5Ijo2jbFjJBQK9YwFd6RVMzfgRBmEfP37suBBm/p49e1qjEP2mwTViNRo0VJWH1deMXcNK08uUjVUu7s/zRaL+oLNxz1bpANco4npUgX4G2eFbpDFyQoQxojBCpEGSytmOH8qrH5Q9vuzD6ofQylkCUmh8DBAr+q8JCyVNtWQIidKQE9wNtLSQnS4jDSsxNHogzFuQBw4cyM61UKVsjfr3ooBkPSqqQHesUPWVtzi9/vQi1T+rJj7WiTz4Pt/l3LxUkr5P2VYZaZ4URpsE+st/dujQoaBBYokbrz/8TJNQYLSonrPS9kUaSkPeZyj1AWSj+d+VBoy1pIWVNed8P0Ll/ee5HdGRhrHhR5GGN0r4LGZBaj8oFDJitBTJzIZgFcmU0Y8ytWMZMzJOaXUSrUs5RxKnrxmbb5YXO9VGUhtpXldhEUogFr3IzIsvlpmdosVcGVGXFWp2oU9kLFL3dEkSz6NHEY1sjSRdIuDFWEhd8KxFqsRi1uM/nz9/zpxnwlESONdg6dKlbsaMGS4EHFHtjFIDHwKOo46l4TxSuxgDzi+rE2jg+BaFruOX4HXa0Nnf1lwAPufZeF8/r6zD97WK2qFnGjBxTw5qNGPxT+5T/r7/7RawFC3j4vTp09koCxkeHjqbHJqArmH5UrFKKksnxrK7FuRIs8STfBZv+luugXZ2pR/pP9Ois4z+TiMzUUkUjD0iEi1fzX8GmXyuxUBRcaUfykV0YZnlJGKQpOiGB76x5GeWkWWJc3mOrK6S7xdND+W5N6XyaRgtWJFe13GkaZnKOsYqGdOVVVbGupsyA/l7emTLHi7vwTdirNEt0qxnzAvBFcnQF16xh/TMpUuXHDowhlA9vQVraQhkudRdzOnK+04ZSP3DUhVSP61YsaLtd/ks7ZgtPcXqPqEafHkdqa84X6aCeL7YWlv6edGFHb+ZFICPlljHhg0bKuk0CSvVznWsotRu433alNdFrqG45ejoaPCaUkWERpLXjzFL2Rpllp7PJU2a/v7Ab8N05/9t27Z16KUqoFGsxnI9EosS2niSYg9SpU6B4JgTrvVW1flt1sT+0ADIJU2maXzcUTraGCRaL1Wp9rUMk16PMom8QhruxzvZIegJjFU7LLCePfS8uaQdPny4jTTL0dbee5mYokQsXTIWNY46kuMbnt8Kmec+LGWtOVIl9cT1rCB0V8WqkjAsRwta93TbwNYoGKsUSChN44lgBNCoHLHzquYKrU6qZ8lolCIN0Rh6cP0Q3U6I6IXILYOQI513hJaSKAorFpuHXJNfVlpRtmYBk1Su1obZr5dnKAO+L10Hrj3WZW+E3qh6IszE37F6EB+68mGpvKm4eb9bFrlzrok7fvr0Kfv727dvWRmdVTJHw0qiiCUSZ6wCK+7XL/AcsgNyL74DQQ730sv78Su7+t/A36MdY0sW5o40ahslXr58aZ5HtZB8GH64m9EmMZ7FpYw4T6QnrZfgenrhFxaSiSGXtPnz57e9TkNZLvTjeqhr734CNtrK41L40sUQckmj1lGKQ0rC37x544r8eNXRpnVE3ZZY7zXo8NomiO0ZUCj2uHz58rbXoZ6gc0uA+F6ZeKS/jhRDUq8MKrTho9fEkihMmhxtBI1DxKFY9XLpVcSkfoi8JGnToZO5sU5aiDQIW716ddt7ZLYtMQlhECdBGXZZMWldY5BHm5xgAroWj4C0hbYkSc/jBmggIrXJWlZM6pSETsEPGqZOndr2uuuR5rF169a2HoHPdurUKZM4CO1WTPqaDaAd+GFGKdIQkxAn9RuEWcTRyN2KSUgiSgF5aWzPTeA/lN5rZubMmR2bE4SIC4nJoltgAV/dVefZm72AtctUCJU2CMJ327hxY9t7EHbkyJFseq+EJSY16RPo3Dkq1kkr7+q0bNmyDuLQcZBEPYmHVdOBiJyIlrRDq41YPWfXOxUysi5fvtyaj+2BpcnsUV/oSoEMOk2CQGlr4ckhBwaetBhjCwH0ZHtJROPJkyc7UjcYLDjmrH7ADTEBXFfOYmB0k9oYBOjJ8b4aOYSe7QkKcYhFlq3QYLQhSidNmtS2RATwy8YOM3EQJsUjKiaWZ+vZToUQgzhkHXudb/PW5YMHD9yZM2faPsMwoc7RciYJXbGuBqJ1UIGKKLv915jsvgtJxCZDubdXr165mzdvtr1Hz5LONA8jrUwKPqsmVesKa49S3Q4WxmRPUEYdTjgiUcfUwLx589ySJUva3oMkP6IYddq6HMS4o55xBJBUeRjzfa4Zdeg56QZ43LhxoyPo7Lf1kNt7oO8wWAbNwaYjIv5lhyS7kRf96dvm5Jah8vfvX3flyhX35cuX6HfzFHOToS1H4BenCaHvO8pr8iDuwoUL7tevX+b5ZdbBair0xkFIlFDlW4ZknEClsp/TzXyAKVOmmHWFVSbDNw1l1+4f90U6IY/q4V27dpnE9bJ+v87QEydjqx/UamVVPRG+mwkNTYN+9tjkwzEx+atCm/X9WvWtDtAb68Wy9LXa1UmvCDDIpPkyOQ5ZwSzJ4jMrvFcr0rSjOUh+GcT4LSg5ugkW1Io0/SCDQBojh0hPlaJdah+tkVYrnTZowP8iq1F1TgMBBauufyB33x1v+NWFYmT5KmppgHC+NkAgbmRkpD3yn9QIseXymoTQFGQmIOKTxiZIWpvAatenVqRVXf2nTrAWMsPnKrMZHz6bJq5jvce6QK8J1cQNgKxlJapMPdZSR64/UivS9NztpkVEdKcrs5alhhWP9NeqlfWopzhZScI6QxseegZRGeg5a8C3Re1Mfl1ScP36ddcUaMuv24iOJtz7sbUjTS4qBvKmstYJoUauiuD3k5qhyr7QdUHMeCgLa1Ear9NquemdXgmum4fvJ6w1lqsuDhNrg1qSpleJK7K3TF0Q2jSd94uSZ60kK1e3qyVpQK6PVWXp2/FC3mp6jBhKKOiY2h3gtUV64TWM6wDETRPLDfSakXmH3w8g9Jlug8ZtTt4kVF0kLUYYmCCtD/DrQ5YhMGbA9L3ucdjh0y8kOHW5gU/VEEmJTcL4Pz/f7mgoAbYkAAAAAElFTkSuQmCC"] }' ``` With 0.1.27 we get the following result which is correct: ``` {"model":"llava","created_at":"2024-03-14T18:48:39.892743Z","response":" The","done":false} {"model":"llava","created_at":"2024-03-14T18:48:39.902493399Z","response":" image","done":false} {"model":"llava","created_at":"2024-03-14T18:48:39.912723781Z","response":" you","done":false} {"model":"llava","created_at":"2024-03-14T18:48:39.922418535Z","response":"'","done":false} {"model":"llava","created_at":"2024-03-14T18:48:39.932232811Z","response":"ve","done":false} {"model":"llava","created_at":"2024-03-14T18:48:39.941861663Z","response":" shared","done":false} {"model":"llava","created_at":"2024-03-14T18:48:39.95127562Z","response":" is","done":false} {"model":"llava","created_at":"2024-03-14T18:48:39.960647773Z","response":" a","done":false} {"model":"llava","created_at":"2024-03-14T18:48:39.96999504Z","response":" cart","done":false} {"model":"llava","created_at":"2024-03-14T18:48:39.979236925Z","response":"oon","done":false} {"model":"llava","created_at":"2024-03-14T18:48:39.988649335Z","response":" of","done":false} {"model":"llava","created_at":"2024-03-14T18:48:39.998155111Z","response":" a","done":false} {"model":"llava","created_at":"2024-03-14T18:48:40.007514919Z","response":" character","done":false} {"model":"llava","created_at":"2024-03-14T18:48:40.016850803Z","response":" w","done":false} {"model":"llava","created_at":"2024-03-14T18:48:40.026027237Z","response":"aving","done":false} {"model":"llava","created_at":"2024-03-14T18:48:40.035208349Z","response":".","done":false} {"model":"llava","created_at":"2024-03-14T18:48:40.0449605Z","response":" It","done":false} {"model":"llava","created_at":"2024-03-14T18:48:40.054329288Z","response":" appears","done":false} {"model":"llava","created_at":"2024-03-14T18:48:40.063508191Z","response":" to","done":false} {"model":"llava","created_at":"2024-03-14T18:48:40.072706446Z","response":" be","done":false} {"model":"llava","created_at":"2024-03-14T18:48:40.0818883Z","response":" an","done":false} {"model":"llava","created_at":"2024-03-14T18:48:40.091155598Z","response":" animated","done":false} {"model":"llava","created_at":"2024-03-14T18:48:40.100472991Z","response":" animal","done":false} {"model":"llava","created_at":"2024-03-14T18:48:40.109727798Z","response":" with","done":false} {"model":"llava","created_at":"2024-03-14T18:48:40.119072039Z","response":" a","done":false} {"model":"llava","created_at":"2024-03-14T18:48:40.128385397Z","response":" cheer","done":false} {"model":"llava","created_at":"2024-03-14T18:48:40.137673222Z","response":"ful","done":false} {"model":"llava","created_at":"2024-03-14T18:48:40.147012243Z","response":" de","done":false} {"model":"llava","created_at":"2024-03-14T18:48:40.156322671Z","response":"mean","done":false} {"model":"llava","created_at":"2024-03-14T18:48:40.165747911Z","response":"or","done":false} {"model":"llava","created_at":"2024-03-14T18:48:40.175332396Z","response":",","done":false} {"model":"llava","created_at":"2024-03-14T18:48:40.184638251Z","response":" likely","done":false} {"model":"llava","created_at":"2024-03-14T18:48:40.193956749Z","response":" designed","done":false} {"model":"llava","created_at":"2024-03-14T18:48:40.20326162Z","response":" to","done":false} {"model":"llava","created_at":"2024-03-14T18:48:40.212528856Z","response":" ev","done":false} {"model":"llava","created_at":"2024-03-14T18:48:40.221887008Z","response":"oke","done":false} {"model":"llava","created_at":"2024-03-14T18:48:40.231093223Z","response":" a","done":false} {"model":"llava","created_at":"2024-03-14T18:48:40.240325681Z","response":" sense","done":false} {"model":"llava","created_at":"2024-03-14T18:48:40.249555463Z","response":" of","done":false} {"model":"llava","created_at":"2024-03-14T18:48:40.258873527Z","response":" happiness","done":false} {"model":"llava","created_at":"2024-03-14T18:48:40.268114214Z","response":" or","done":false} {"model":"llava","created_at":"2024-03-14T18:48:40.277427953Z","response":" play","done":false} {"model":"llava","created_at":"2024-03-14T18:48:40.287178421Z","response":"fulness","done":false} {"model":"llava","created_at":"2024-03-14T18:48:40.296603404Z","response":".","done":false} {"model":"llava","created_at":"2024-03-14T18:48:40.30596708Z","response":" The","done":false} {"model":"llava","created_at":"2024-03-14T18:48:40.315303545Z","response":" character","done":false} {"model":"llava","created_at":"2024-03-14T18:48:40.324741421Z","response":" seems","done":false} {"model":"llava","created_at":"2024-03-14T18:48:40.33417479Z","response":" to","done":false} {"model":"llava","created_at":"2024-03-14T18:48:40.343508475Z","response":" be","done":false} {"model":"llava","created_at":"2024-03-14T18:48:40.352945709Z","response":" moving","done":false} {"model":"llava","created_at":"2024-03-14T18:48:40.362357751Z","response":",","done":false} {"model":"llava","created_at":"2024-03-14T18:48:40.371702145Z","response":" as","done":false} {"model":"llava","created_at":"2024-03-14T18:48:40.381167011Z","response":" suggested","done":false} {"model":"llava","created_at":"2024-03-14T18:48:40.390572108Z","response":" by","done":false} {"model":"llava","created_at":"2024-03-14T18:48:40.400132521Z","response":" the","done":false} {"model":"llava","created_at":"2024-03-14T18:48:40.41006519Z","response":" blur","done":false} {"model":"llava","created_at":"2024-03-14T18:48:40.420147404Z","response":"ring","done":false} {"model":"llava","created_at":"2024-03-14T18:48:40.429432733Z","response":" effect","done":false} {"model":"llava","created_at":"2024-03-14T18:48:40.43877958Z","response":" on","done":false} {"model":"llava","created_at":"2024-03-14T18:48:40.448155073Z","response":" its","done":false} {"model":"llava","created_at":"2024-03-14T18:48:40.457480579Z","response":" body","done":false} {"model":"llava","created_at":"2024-03-14T18:48:40.466953213Z","response":",","done":false} {"model":"llava","created_at":"2024-03-14T18:48:40.476393087Z","response":" indicating","done":false} {"model":"llava","created_at":"2024-03-14T18:48:40.485779189Z","response":" motion","done":false} {"model":"llava","created_at":"2024-03-14T18:48:40.49521034Z","response":" or","done":false} {"model":"llava","created_at":"2024-03-14T18:48:40.5046725Z","response":" action","done":false} {"model":"llava","created_at":"2024-03-14T18:48:40.513909517Z","response":".","done":false} {"model":"llava","created_at":"2024-03-14T18:48:40.522835869Z","response":" ","done":false} {"model":"llava","created_at":"2024-03-14T18:48:40.532115251Z","response":"","done":true,"context":[733,16289,28793,1824,349,297,456,5754,28804,733,5422,28733,28734,28793,733,28748,16289,28793,415,3469,368,28742,333,6431,349,264,7548,4973,302,264,3233,275,1652,28723,661,8045,298,347,396,25693,8527,395,264,17096,1007,340,13646,271,28725,3917,5682,298,683,2656,264,3367,302,15079,442,1156,19965,28723,415,3233,3969,298,347,5272,28725,390,8750,486,272,19690,699,2030,356,871,2187,28725,17888,8036,442,2992,28723,28705],"total_duration":3678847752,"load_duration":2763386454,"prompt_eval_count":1,"prompt_eval_duration":274707000,"eval_count":69,"eval_duration":639238000} ``` with 0.1.28 we get a description of something that isn't in the image at all: ``` {"model":"llava","created_at":"2024-03-14T18:50:13.841492296Z","response":" The","done":false} {"model":"llava","created_at":"2024-03-14T18:50:13.850897111Z","response":" image","done":false} {"model":"llava","created_at":"2024-03-14T18:50:13.86010476Z","response":" shows","done":false} {"model":"llava","created_at":"2024-03-14T18:50:13.868933822Z","response":" a","done":false} {"model":"llava","created_at":"2024-03-14T18:50:13.877685382Z","response":" person","done":false} {"model":"llava","created_at":"2024-03-14T18:50:13.886462319Z","response":" sitting","done":false} {"model":"llava","created_at":"2024-03-14T18:50:13.895111881Z","response":" on","done":false} {"model":"llava","created_at":"2024-03-14T18:50:13.903942696Z","response":" a","done":false} {"model":"llava","created_at":"2024-03-14T18:50:13.912728179Z","response":" chair","done":false} {"model":"llava","created_at":"2024-03-14T18:50:13.921911488Z","response":" with","done":false} {"model":"llava","created_at":"2024-03-14T18:50:13.930570785Z","response":" their","done":false} {"model":"llava","created_at":"2024-03-14T18:50:13.939138053Z","response":" feet","done":false} {"model":"llava","created_at":"2024-03-14T18:50:13.947699488Z","response":" up","done":false} {"model":"llava","created_at":"2024-03-14T18:50:13.956352675Z","response":".","done":false} {"model":"llava","created_at":"2024-03-14T18:50:13.964866271Z","response":" They","done":false} {"model":"llava","created_at":"2024-03-14T18:50:13.973549445Z","response":" are","done":false} {"model":"llava","created_at":"2024-03-14T18:50:13.982138378Z","response":" wearing","done":false} {"model":"llava","created_at":"2024-03-14T18:50:13.990776154Z","response":" a","done":false} {"model":"llava","created_at":"2024-03-14T18:50:13.999363861Z","response":" light","done":false} {"model":"llava","created_at":"2024-03-14T18:50:14.008031399Z","response":"-","done":false} {"model":"llava","created_at":"2024-03-14T18:50:14.016645026Z","response":"colored","done":false} {"model":"llava","created_at":"2024-03-14T18:50:14.025272747Z","response":" top","done":false} {"model":"llava","created_at":"2024-03-14T18:50:14.034026556Z","response":" and","done":false} {"model":"llava","created_at":"2024-03-14T18:50:14.042764211Z","response":" dark","done":false} {"model":"llava","created_at":"2024-03-14T18:50:14.051308101Z","response":" pants","done":false} {"model":"llava","created_at":"2024-03-14T18:50:14.05999179Z","response":",","done":false} {"model":"llava","created_at":"2024-03-14T18:50:14.068526561Z","response":" and","done":false} {"model":"llava","created_at":"2024-03-14T18:50:14.077246111Z","response":" it","done":false} {"model":"llava","created_at":"2024-03-14T18:50:14.08580068Z","response":" appears","done":false} {"model":"llava","created_at":"2024-03-14T18:50:14.094624047Z","response":" to","done":false} {"model":"llava","created_at":"2024-03-14T18:50:14.103192599Z","response":" be","done":false} {"model":"llava","created_at":"2024-03-14T18:50:14.111909226Z","response":" an","done":false} {"model":"llava","created_at":"2024-03-14T18:50:14.120413301Z","response":" indoor","done":false} {"model":"llava","created_at":"2024-03-14T18:50:14.128975163Z","response":" setting","done":false} {"model":"llava","created_at":"2024-03-14T18:50:14.137564677Z","response":".","done":false} {"model":"llava","created_at":"2024-03-14T18:50:14.146038576Z","response":" There","done":false} {"model":"llava","created_at":"2024-03-14T18:50:14.154740713Z","response":" is","done":false} {"model":"llava","created_at":"2024-03-14T18:50:14.163283425Z","response":" no","done":false} {"model":"llava","created_at":"2024-03-14T18:50:14.172394214Z","response":" clear","done":false} {"model":"llava","created_at":"2024-03-14T18:50:14.180948803Z","response":" indication","done":false} {"model":"llava","created_at":"2024-03-14T18:50:14.189562772Z","response":" of","done":false} {"model":"llava","created_at":"2024-03-14T18:50:14.198215865Z","response":" the","done":false} {"model":"llava","created_at":"2024-03-14T18:50:14.20693134Z","response":" specific","done":false} {"model":"llava","created_at":"2024-03-14T18:50:14.215569373Z","response":" location","done":false} {"model":"llava","created_at":"2024-03-14T18:50:14.22423472Z","response":" or","done":false} {"model":"llava","created_at":"2024-03-14T18:50:14.232891021Z","response":" activity","done":false} {"model":"llava","created_at":"2024-03-14T18:50:14.241488373Z","response":" taking","done":false} {"model":"llava","created_at":"2024-03-14T18:50:14.250127781Z","response":" place","done":false} {"model":"llava","created_at":"2024-03-14T18:50:14.258942464Z","response":".","done":false} {"model":"llava","created_at":"2024-03-14T18:50:14.26761813Z","response":" ","done":false} {"model":"llava","created_at":"2024-03-14T18:50:14.276847898Z","response":"","done":true,"context":[733,16289,28793,1824,349,297,456,5754,28804,733,28748,16289,28793,415,3469,4370,264,1338,6398,356,264,6225,395,652,4051,582,28723,1306,460,8192,264,2061,28733,28508,1830,304,3199,16721,28725,304,378,8045,298,347,396,24990,5587,28723,1387,349,708,3081,24183,302,272,2948,4723,442,6355,3344,1633,28723,28705],"total_duration":3169346961,"load_duration":2677211828,"prompt_eval_count":19,"prompt_eval_duration":55844000,"eval_count":51,"eval_duration":435178000} ```
GiteaMirror added the bug label 2026-04-12 12:04:21 -05:00
GiteaMirror commented 2026-04-12 12:04:23 -05:00
Author
Owner
Copy Link

@jmorganca commented on GitHub (Mar 15, 2024):

Hi there, I'm not quite sure why this happened. Did you download a pre-release version by chance? That might have had an issue with vision models while in pre-release. In any case this should be fixed in 0.1.29

<!-- gh-comment-id:1998729012 --> @jmorganca commented on GitHub (Mar 15, 2024): Hi there, I'm not quite sure why this happened. Did you download a pre-release version by chance? That might have had an issue with vision models while in pre-release. In any case this should be fixed in 0.1.29
GiteaMirror commented 2026-04-12 12:04:23 -05:00
Author
Owner
Copy Link

@codearranger commented on GitHub (Mar 17, 2024):

I'm just running the docker images

version: "3.8"
services:

  webui:
    image: ghcr.io/open-webui/open-webui:main
    expose:
     - 8080/tcp
    ports:
     - 8080:8080/tcp
    restart: unless-stopped
    environment:
     - OLLAMA_API_BASE_URL=http://ollama:11434/api
     # uncomment the following if you are running ollama on the docker host and remove the ollama service below
     #- OLLAMA_API_BASE_URL=http://host.docker.internal:11434/api 
    volumes:
      - open-webui:/app/backend/data
    depends_on:
     - ollama

  ollama:
    image: ollama/ollama:0.1.28
    expose:
     - 11434/tcp
    ports:
     - 11434:11434/tcp
    healthcheck:
      test: ollama --version || exit 1
    command: serve
    restart: unless-stopped
    volumes:
      - ollama:/root/.ollama
    deploy:
      resources:
        reservations:
          devices:
            - driver: nvidia
              device_ids: ['all']
              capabilities: [gpu]

  tunnel:
    image: cloudflare/cloudflared:latest
    pull_policy: always
    restart: unless-stopped
    environment:
      - TUNNEL_URL=http://webui:8080
    command: tunnel --no-autoupdate
    depends_on:
      - webui

volumes:
  ollama:
  open-webui:
<!-- gh-comment-id:2002292767 --> @codearranger commented on GitHub (Mar 17, 2024): I'm just running the docker images ``` version: "3.8" services: webui: image: ghcr.io/open-webui/open-webui:main expose: - 8080/tcp ports: - 8080:8080/tcp restart: unless-stopped environment: - OLLAMA_API_BASE_URL=http://ollama:11434/api # uncomment the following if you are running ollama on the docker host and remove the ollama service below #- OLLAMA_API_BASE_URL=http://host.docker.internal:11434/api volumes: - open-webui:/app/backend/data depends_on: - ollama ollama: image: ollama/ollama:0.1.28 expose: - 11434/tcp ports: - 11434:11434/tcp healthcheck: test: ollama --version || exit 1 command: serve restart: unless-stopped volumes: - ollama:/root/.ollama deploy: resources: reservations: devices: - driver: nvidia device_ids: ['all'] capabilities: [gpu] tunnel: image: cloudflare/cloudflared:latest pull_policy: always restart: unless-stopped environment: - TUNNEL_URL=http://webui:8080 command: tunnel --no-autoupdate depends_on: - webui volumes: ollama: open-webui: ```
GiteaMirror commented 2026-04-12 12:04:25 -05:00
Author
Owner
Copy Link

@codearranger commented on GitHub (Mar 17, 2024):

Confirmed it works with 0.1.29

<!-- gh-comment-id:2002293173 --> @codearranger commented on GitHub (Mar 17, 2024): Confirmed it works with 0.1.29
Sign in to join this conversation.
No Branch/Tag Specified
Branches Tags
Labels
Clear labels
amd
api
app
bug
build
cli
cloud
compatibility
context-length
create
docker
documentation
embeddings
feature request
feedback wanted
good first issue
gpt-oss
gpu
harmony
help wanted
image
install
intel
js
launch
linux
macos
memory
mlx
model
needs more info
networking
nvidia
ollama.com
performance
pull-request
Mirrored from GitHub Pull Request
 python
question
registry
rendering
thinking
tools
top
vulkan
windows
wsl
No Label bug
Milestone
No items
No Milestone
Projects
Clear projects
No project
Assignees
Clear assignees
GiteaMirror ninjasurge
No Assignees
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: github-starred/ollama#1936
Delete Branch "%!s()"

Deleting a branch is permanent. Although the deleted branch may continue to exist for a short time before it actually gets removed, it CANNOT be undone in most cases. Continue?