Respan

Respan is a platform that unifies observability, evals, prompt optimization, and an LLM gateway. It solves the problem of managing and monitoring LLM calls by routing traffic through one endpoint, providing traces, metrics, and evaluation tools. It targets developers, ops, and data teams in startups and enterprises. It is delivered as a SaaS platform with an API, offering a free tier and enterprise options.

Key features

• One API for every model
• Automatic fallbacks
• Response caching
• Spend limits and budgets
• Evaluators with LLM judges
• Deterministic code checks
• Human review
• Production traffic sampling
• Compare model/prompt scores
• Deploy evaluators on live traffic