Promptfoo

An automated testing platform for AI applications, agents and RAG pipelines that identifies and helps fix vulnerabilities such as prompt injections, jailbreaks, data leaks and insecure tool use. It sells to developers and enterprise teams building and operating AI applications, including financial services, insurance, telecommunications and real estate organizations. It is delivered as open-source and SaaS with CI/CD and IDE integrations, on-premise or cloud deployment, and continuous monitoring in development workflows.

Key features

• Automated red teaming for agents and RAGs
• Prompt injection testing
• Jailbreak testing
• Data and PII leak detection
• Business rule violation testing
• Insecure tool use detection
• Toxic content generation testing
• Real-time guardrails against jailbreaks
• Model security testing and monitoring
• MCP proxy for secure communications
• Code scanning in IDE and CI/CD
• Prompt, model and RAG evaluations
• CI/CD pipeline integrations
• Remediation guidance in pull requests