Promptotype

A platform for structured prompt engineering that helps developers design, test, and monitor LLM tasks. It solves the problem of managing prompt templates and validating outputs against expected schemas. It targets developers and data professionals in B2B settings, including small to large companies. The platform offers a playground, automated testing, and fine-tuning capabilities, delivered as a SaaS with a free tier.

Key features

• Design prompt templates in extended playground
• Define test queries with expected JSON schemas
• Auto-fill expected results from model runs
• Test prompts on entire query collections
• Manage prompts and models in one place
• Support for function calling
• Track history of runs and tests
• Schedule periodic automated tests
• Get result summary by email
• UI for fine-tuning models from collections