Manifest

An open-source LLM gateway that routes requests to multiple AI providers, automatically fixes broken requests, and provides observability. It solves the problem of unreliable LLM API calls and provider downtime for developers and teams building AI agents. The product targets AI builders, engineering teams, and platforms that need to manage inference consumption and ensure reliability. It is positioned as an open-source, self-hostable alternative to closed gateways, offering full control and transparency.

Key features

• Model fallbacks
• Autofix broken requests
• Full body logs
• Self-host option
• Local model routing
• Bring your own key
• Cost visualization
• Open source