Introducing Spark Connect – The Power of Apache Spark, Everywhere

1 · Michael Xu · July 7, 2022, 6:13 p.m.
At last week’s Data and AI Summit, we highlighted a new project called Spark Connect in the opening keynote. This blog post walks through the project’s motivation, high-level proposal, and next steps. Spark Connect introduces a decoupled client-server architecture for Apache Spark that allows remote connectivity to Spark clusters using the DataFrame API and unresolved... The post Introducing Spark Connect – The Power of Apache Spark, Everywhere appeared first on Databricks....