DIFF.BLOG
New Following Discover Jobs
More
Top Writers Suggest a blog Upvotes plugin
Report bug Contact About Privacy
Sign up
Topics
Follow your own topics →
Menu
New Following Discover Jobs Top Writers
More
Suggest a blog Upvotes plugin Report bug Contact About
Sign up
Privacy Policy
The home for great developer writing.
We surface the best developer writing from thousands of independent blogs, updated daily.
Join Diff.blog
TOPICS

Accelerating Apache Parquet Scans on Apache Spark with GPUs

· NVIDIA Corporation · April 3, 2025, 4:37 p.m.
Data Center / Cloud Data Science Development & Optimization accelerated data analytics data-processing apache spark Apache Parquet Performance Optimization
Summary
This blog post discusses the optimization of Apache Parquet scans on Apache Spark using GPU acceleration. It explores the advantages of utilizing GPUs for processing data stored in Parquet format, particularly in terms of performance improvement in handling large data sets typical in enterprise environments.
Read full post on developer.nvidia.com →
MORE POSTS LIKE THIS
Accelerating JSON Processing on Apache Spark with GPUs
NVIDIA Corporation · Jan 29, 2025
Data Science Development & Optimization
Announcing On-Demand State Repartitioning for Apache Spark™ Structured Streaming on Databricks
Mooncake · Sep 14, 2026
engineering data engineering
GPU-Native Operators in Ray Data
Anyscale · Aug 25, 2026
software development data-processing
A Tale of Two Flink Autoscalers
Netflix, Inc. · Aug 21, 2026
Autoscaling Stream Processing
A Fast Path for Fixed-Length Lists in Parquet
gunnarmorling · Jul 22, 2026
data storage Apache Parquet
Polars for Machine Learning: Zero-Copy to PyTorch and XGBoost
Ahmed Nabil · Jul 15, 2026
Data Science 2026
Discover more posts →
AUTHOR
RECENT POSTS FROM THE AUTHOR
Choose how you want to continue.
Continue with GitHub Continue with Google
By continuing, you agree to our Privacy Policy.