Introduction
Rubeus is an unopionionated edge worker for buliding with Large Language Models (LLMs). Catering to a range of LLM providers, Rubeus extends beyond a unified API, becoming a powerful ally that expertly handles retries, fallbacks, and load distribution. The essence of Rubeus isn't merely about initiating requests—it's about ensuring these requests are handled intelligently and efficiently. With Rubeus, you're harnessing the power of language models, Axios-style! 💼🚀
Key Features
- 🌐 Interoperability: Write once, run with any provider. Switch between __ models from __ providers seamlessly.
- 🔀 Fallback Strategies: Don't let failures stop you. If one provider fails, Rubeus can automatically switch to another.
- 🔄 Retry Strategies: Temporary issues shouldn't mean manual re-runs. Rubeus can automatically retry failed requests.
- ⚖️ Load Balancing: Distribute load effectively across multiple API keys or providers based on custom weights.
- 📝 Unified API Signature: If you've used OpenAI, you already know how to use Rubeus with any other provider.
Supported Providers
| Provider | Support Status | Supported Endpoints |
|---|---|---|
 OpenAI |  Supported | /completion, /embed |
 Anthropic | Supported | /complete |
 Cohere | Supported | generate, embed |
 Google Bard |  Coming Soon | |
 LocalAI | Coming Soon |