Streaming Cassandra at WePay - Part 2

1 · WePay · July 15, 2019, 4:17 p.m.
In the first half of this blog post series, we explained our decision-making process of designing a streaming data pipeline for Cassandra at WePay. In this post, we will break down the pipeline into three sections and discuss each of them in more detail: Cassandra to Kafka with CDC agent Kafka with BigQuery with KCBQ Transformation with BigQuery view Cassandra to Kafka with CDC Agent The Cassandra CDC agent is a JVM process that is intended to be deployed on each node in a Cassandra cluster. ...