cloudpy

It is a drop-in replacement for pandas that executes dataframe operations on cloud servers to handle large datasets that do not fit in local memory and to access data across multiple machines. It sells to developers and data practitioners in businesses who use pandas for data analysis and need to process dataframes of hundreds of gigabytes without out-of-memory errors. It is positioned as requiring only a one-line import change while keeping the existing pandas interface, tooling and workflow, without switching to hosted notebooks, new libraries or AWS configuration.

Key features

• Drop-in replacement for pandas
• One-line import change
• Store 100s of GB dataframes in cloud
• Proxy function calls to remote server
• Load data exceeding local memory
• Keep existing pandas interface and workflow
• Access data across multiple machines
• Low local memory usage under 4MB