Delta-rs is a native Rust library for Delta Lake, a Linux Foundation project. By building the library in Rust from scratch based on the delta lake protocol, the delta-rs community immediately benefited from memory safety, a highly efficient compiler, and high performance when processing large amounts of data simultaneously.

However, since Python was also extremely popular within the data community with many data processing frameworks available, providing native binding to its ecosystem was key to making the adoption of the library easier. Besides, it provides a doorway for the community to learn Rust.

In this talk, Florian will cover briefly what delta-rs is and its implementation. Then he will focus on how combining Rust and Python code bases to have the best of two worlds levaraging pyo3 library. This session will provide practical and useful ideas for building a Python application on top of Rust’s blazing-fast and memory-efficient execution.