Data Engineering Weekly Notes
Jun 15 – Jun 21 · 2026-W25
1 event this week
⚡⚡ GENIUS Act CIP rule detailed Compliance
⚡⚡⚡ Warsh's first FOMC + Iran ceasefire + Reg NMS proposal Markets
⚡⚡ Flink 2.3.0 with Native S3 FS Data Engineering
🧠 Feynman Takeaway
Apache Flink 2.3.0 released: Native S3 FileSystem, changelog SQL operators, materialized table refresh — the biggest Flink release of 2026.
Flink 2.3.0: Native S3 FileSystem, Changelog Operators
In plain English
Apache Flink 2.3.0 released with: Native S3 FileSystem (no Hadoop dependency needed!), FROM_CHANGELOG/TO_CHANGELOG SQL operators for streaming CDC data, materialized table refresh strategies, and 15 FLIPs (Flink Improvement Proposals). This was the most significant Flink release of the year.
Analogy
Before Flink 2.3.0, reading from S3 required a heavy Hadoop dependency. Now Flink can talk to S3 directly — like removing the middleman from a conversation. The changelog operators handle the 'before and after' of database changes natively in SQL.
Why it matters
The Native S3 FS was a big deal for cloud-native streaming: simpler deployments, smaller container images, and better performance for S3-based lakehouse architectures.