LakeSoul is a high-performance, unified table storage framework for big data lakes, supporting both streaming and batch data in a single format. Built on top of Apache Spark and leveraging Apache Arrow and Parquet, LakeSoul provides ACID transactions, schema evolution, and time travel. It is designed for large-scale data lake architectures that require consistency, efficiency, and easy integration with modern data stacks.

Features

  • Supports ACID transactions on data lakes
  • Handles both batch and streaming data seamlessly
  • Schema evolution and data versioning support
  • Time travel queries for historical data access
  • Optimized for Apache Spark and Parquet
  • Native integration with Apache Arrow and cloud storage

Project Samples

LakeSoul Screenshot 1

Project Activity

See All Activity >