ApiTap

A transfer engine that moves entire database tables between systems at high speed while using a fixed amount of memory, solving the problem of slow and resource-heavy data migration. It is designed for developers and data engineers who need to move large datasets efficiently, often in batch or incremental modes. The tool is open-source, delivered as a Python package with a Rust core, and emphasizes measured performance and data integrity through checksum validation.

Key features

• Single function API
• Raw binary COPY passthrough
• Parallel range pipes
• Incremental append and merge modes
• Watermark stored in destination
• Checksum-validated transfers
• Bounded memory usage
• Supports Postgres, ClickHouse, GCS, GitHub