Speed Up Streaming Queries With Asynchronous State Checkpointing

1 · Michael Xu · May 2, 2022, 6:42 p.m.
Background / Motivation Stateful streaming is becoming more prevalent as stakeholders make increasingly sophisticated demands on greater volumes of data. The tradeoff, however, is that the computational complexity of stateful operations increases data latency, making it that much less actionable. Asynchronous state checkpointing, which separates the process of persisting state from the regular micro-batch checkpoint,... The post Speed Up Streaming Queries With Asynchronous State Checkpointing ap...