Michael Yang 3f6642f6fc model: implement bert in ollama engine (#9080) ...

* fix truncate

* s/SentencePieceModel/SentencePiece/

* bert

* wordpiece

* refactor pooling

* more tokenizers

* normalize embeddings

2025-09-15 15:35:59 -07:00

..

imageproc

imageproc mllama refactor (#7537)

2024-12-14 19:50:15 -08:00

input

batch: use tensors for outputs (#12185)

2025-09-15 14:33:06 -07:00

models

model: implement bert in ollama engine (#9080)

2025-09-15 15:35:59 -07:00

testdata

gemma2 impl

2025-03-11 14:35:08 -07:00

bytepairencoding_test.go

model: add bpe roundtripping tests

2025-08-19 22:05:48 -07:00

bytepairencoding.go

embedding gemma model (#12181)

2025-09-04 09:09:07 -07:00

model_test.go

update vendored llama.cpp and ggml (#11823)

2025-08-14 14:42:58 -07:00

model.go

model: implement bert in ollama engine (#9080)

2025-09-15 15:35:59 -07:00

sentencepiece_test.go

model: implement bert in ollama engine (#9080)

2025-09-15 15:35:59 -07:00

sentencepiece.go

model: implement bert in ollama engine (#9080)

2025-09-15 15:35:59 -07:00

textprocessor.go

model: handle multiple eos tokens (#10577)

2025-05-16 13:40:23 -07:00

vocabulary_test.go

model: treat 'user defined' tokens as special tokens (#11077)

2025-06-16 16:03:16 -07:00

vocabulary.go

embedding gemma model (#12181)

2025-09-04 09:09:07 -07:00

wordpiece_test.go

model: implement bert in ollama engine (#9080)

2025-09-15 15:35:59 -07:00

wordpiece.go

model: implement bert in ollama engine (#9080)

2025-09-15 15:35:59 -07:00