Prefect

The product is a workflow orchestration platform for Python that schedules, retries, caches, and recovers data pipelines, ML workflows, and agent tasks to replace brittle cron jobs and custom monitoring. It is for developers, data and operations teams in startups to enterprises that run mission-critical workflows in production. Compared to Airflow, it uses plain Python functions with branching and runtime task creation instead of static DAGs, provides durable execution with built-in state and crash recovery, and offers a managed control plane with no scheduler to host.

Key features

• Python @flow and @task decorators
• Automatic retries and caching
• Scheduling and triggers
• Durable execution and crash recovery
• Backfills and alerts
• Centralized observability and logging
• Hybrid and VPC execution
• Managed serverless compute
• Work pools and deployments