#
DIFF.BLOG
New
Following
Discover
Jobs
More
Top Writers
Suggest a blog
Upvotes plugin
Report bug
Contact
About
Privacy
Sign up
The home for great developer writing.
We surface the best developer writing from thousands of independent blogs, updated daily.
Join Diff.blog
TOPICS
Async inference in practice: a video-indexing service on Ray Serve
·
Anyscale
·
Aug. 19, 2026, 12:36 a.m.
Machine Learning
software development
Ray Serve
Async inference
Summary
The blog post discusses the implementation of asynchronous inference in a video-indexing service using Ray Serve, showcasing practical applications and insights related to enhancing machine learning workflow efficiency.
Read full post on anyscale.com →
MORE POSTS LIKE THIS
Optimizing LLM Serving Efficiency: Moving Beyond KV Cache Reuse to Token-Load Awareness with Ray Serve LLM
Anyscale ·
Aug 25, 2026
Machine Learning
software development
Non-trivial data analysis using coding agents
Shape Of Code ·
Nov 8, 2026
claude
coding agent
A maximally tiny language model
Langur Monkey - Toni Sagristà Sellés ·
Nov 7, 2026
Machine Learning
Natural Language Processing
Claude Fable 5.2 and Mythos 5.2: Power, Price and Limits
Aleksei Aleinikov ·
Nov 11, 2026
claude-fable-5-2
claude-mythos-5-2
Goodfire Announces a Blind Cop to Watch AI
Flying Penguin Blog ·
Nov 6, 2026
Security
Machine Learning
Retry the Transient, Escalate the Rest
Narendra Nag ·
Nov 2, 2026
Development
AI
Discover more posts →
AUTHOR
RECENT POSTS FROM THE AUTHOR
Choose how you want to continue.
Continue with GitHub
Continue with Google
By continuing, you agree to our
Privacy Policy
.