Back to Plugin Store

vLLM

vLLM backend.

By SoAI · Bundled

Project homepageSource code

ChatEmbeddingsVisionTool calling

Version 1.0.1

Requires SoAI
1.0.0 or newer
Platforms
Linux · ARM64Linux · x64macOS · Apple Silicon
Download size
135.8 KB
Expanded size
762.1 KB
License
MIT

Install from a file

In SoAI, open Plugins → Add plugin → Upload plugin and select the downloaded .soaiplugin file.

Download plugin

Install from a URL

Copy this URL, then open Plugins → Add plugin → Download plugin from URL in SoAI and paste it there.

https://soai.to/v1/vllm/1.0.1/a02501ea5e317a2934b069af044e9e52b1939909e35138c381a62adb7a88d3e6/vllm.soaiplugin
SHA-256 checksum
a02501ea5e317a2934b069af044e9e52b1939909e35138c381a62adb7a88d3e6