Llama.cpp Embeddings
by SoAI · Bundled
A dedicated llama.cpp runtime for GGUF embedding models, used by Knowledge collections and the SoAI embeddings endpoint.
Llama.cpp Embeddings is a separate GGUF embedding runtime. It serves the embeddings endpoint only, with no chat completions, completions, Responses, media, or tool calling.
Use it for a dedicated local embedding model for Knowledge collections or embedding API work. Once the model is in the catalog, select it in Chat under Chat configuration > Knowledge > Embedding model. Like the other local model plugins, it can be installed, configured, searched, downloaded, and cloned.
Version 1.2.1
Install from a file
In SoAI, open Plugins → Add plugin → Upload plugin and select the downloaded .soaiplugin file.
Install from a URL
Copy this URL, then open Plugins → Add plugin → Download plugin from URL in SoAI and paste it there.
https://soai.to/v1/embedding/1.2.1/542b4b064f89ecd3ac8dfc0de473a4cf1cb6673e92176c1556858034018003ed/embedding.soaiplugin
SHA-256 checksum
542b4b064f89ecd3ac8dfc0de473a4cf1cb6673e92176c1556858034018003ed
Previous versions 4
Version 1.2.0
Install from a file
In SoAI, open Plugins → Add plugin → Upload plugin and select the downloaded .soaiplugin file.
Install from a URL
Copy this URL, then open Plugins → Add plugin → Download plugin from URL in SoAI and paste it there.
https://soai.to/v1/embedding/1.2.0/0e2180e1e42ec17ae3317cd95ebe42709a49ca45e825a1cc97e4e29253b8e896/embedding.soaiplugin
SHA-256 checksum
0e2180e1e42ec17ae3317cd95ebe42709a49ca45e825a1cc97e4e29253b8e896
Version 1.1.1
Install from a file
In SoAI, open Plugins → Add plugin → Upload plugin and select the downloaded .soaiplugin file.
Install from a URL
Copy this URL, then open Plugins → Add plugin → Download plugin from URL in SoAI and paste it there.
https://soai.to/v1/embedding/1.1.1/fb423444665923191da1ebbfb537b087ad5fa7db7acec23d443712d61294053f/embedding.soaiplugin
SHA-256 checksum
fb423444665923191da1ebbfb537b087ad5fa7db7acec23d443712d61294053f
Version 1.1.0
Install from a file
In SoAI, open Plugins → Add plugin → Upload plugin and select the downloaded .soaiplugin file.
Install from a URL
Copy this URL, then open Plugins → Add plugin → Download plugin from URL in SoAI and paste it there.
https://soai.to/v1/embedding/1.1.0/0ea53c2cb74aced7f0d0aeb3db3c1a643409d5b3f6b993ca25df477d318252ed/embedding.soaiplugin
SHA-256 checksum
0ea53c2cb74aced7f0d0aeb3db3c1a643409d5b3f6b993ca25df477d318252ed
Version 1.0.1
Install from a file
In SoAI, open Plugins → Add plugin → Upload plugin and select the downloaded .soaiplugin file.
Install from a URL
Copy this URL, then open Plugins → Add plugin → Download plugin from URL in SoAI and paste it there.
https://soai.to/v1/embedding/1.0.1/4f42bbd275df40cfa1e8ce60069bde9d20339301836874d6f5e9a7c851e99eb7/embedding.soaiplugin
SHA-256 checksum
4f42bbd275df40cfa1e8ce60069bde9d20339301836874d6f5e9a7c851e99eb7