Llama.cpp
Installation​
pip install superduper_llama_cpp
API​
superduper allows users to work with self-hosted LLM models via "Llama.cpp".
| Class | Description | GitHub | API-docs |
|---|---|---|---|
superduper.ext.llamacpp.LlamaCpp | Completes a prompt with natural language (LLM) | Code | Docs |
superduper.ext.llamacpp.LlamaCppEmbedding | Embeds text | Code | Docs |