Aisbf
Routes AI requests across cloud providers, local workers, and failover paths via an OpenAI-compatible gateway, with features like prompt-aware routing, multi-provider orchestration, context condensation, resilience, quotas, and analytics.
AISBF is an open-source AI service broker framework that provides a control plane for routing AI requests across multiple cloud providers, local workers, and failover paths through a single OpenAI-compatible gateway. It solves the problem of managing multiple AI providers and ensuring resilience and privacy. It targets developers, IT, and operations teams in organizations of various sizes, as well as individual developers and early adopters. It is positioned as a transparent, founder-led project that offers both hosted and self-hosted deployment options, with a focus on privacy and local-first routing.
Key features
- Prompt and context-aware routing
- Multi-provider orchestration
- Security and privacy controls
- Context condensation
- Resilience and failover
- Rate limits, quotas and analytics
- Multi-user operations
- Streaming and real-time APIs
- TOR and local-first deployment
- No social media activity within the last 30 days
- API
- Docs
- Software developers
- Engineering teams
- DevOps sre teams