Overview & Capability
Lightweight command-line tool and Python library for running prompts against dozens of cloud and local models, managing embeddings, and piping data.
Key Highlights
- Extensive plugin ecosystem for Claude, OpenAI, Gemini, Ollama, and Groq
- Store and query full prompt/response history in local SQLite
- Pipe stdin/stdout for instant shell script automation
Robbie's Independent Take
Verified: 2026-10-11
Excellent candidate for local execution with zero cloud lock-in. For 7B-8B parameter models, budget at least 8 GB of unified memory or VRAM (Q4_K_M quantization). For 32B-70B models, aim for 24 GB+ to maintain interactive throughput without CPU offload penalties.
Alternatives & Replaces
- Custom curl API wrappers