DIFF.BLOG
New Following Discover Jobs
More
Top Writers Suggest a blog Upvotes plugin
Report bug Contact About Privacy
Sign up
Topics
Follow your own topics →
Menu
New Following Discover Jobs Top Writers
More
Suggest a blog Upvotes plugin Report bug Contact About
Sign up
Privacy Policy
The home for great developer writing.
We surface the best developer writing from thousands of independent blogs, updated daily.
Join Diff.blog
TOPICS

Announcing On-Demand State Repartitioning for Apache Spark™ Structured Streaming on Databricks

· Mooncake · Sept. 14, 2026, 9:45 p.m.
engineering data engineering state management data-processing apache spark Databricks
Summary
This blog post discusses the new feature of on-demand state repartitioning in Apache Spark™ Structured Streaming on Databricks, which aims to optimize the management of stateful streams. It walks through the implementation details, benefits of the feature, and how it can influence production workloads.
Read full post on www.databricks.com →
MORE POSTS LIKE THIS
Databricks vs. Oracle in 2026
Mooncake · Oct 23, 2026
Platform Lakehouse
Migrate Apache Spark Workloads to GPUs at Scale on Amazon EMR with Project Aether
NVIDIA Corporation · Dec 17, 2025
Data Center / Cloud Data Science
Monads in Lean
Eli Bendersky · Nov 11, 2026
Misc lean
DuckDB Explained: When a Database on Your Laptop Beats SQLite, Polars and BigQuery
Aleksei Aleinikov · Oct 20, 2026
duckdb duckdb-vs-sqlite
Nuthatch: a blockchain indexer in one static Rust binary (redb, content-addressed Parquet, DataFusion, DBSP)
Users Rust Lang · Oct 4, 2026
Blockchain data analysis
Trading a Cloud Identity for Your Own: Workload Attestation on Managed Compute
Netflix, Inc. · Sep 25, 2026
identity AWS EMR
Discover more posts →
AUTHOR
RECENT POSTS FROM THE AUTHOR
Choose how you want to continue.
Continue with GitHub Continue with Google
By continuing, you agree to our Privacy Policy.