👩💻 Join our community of thousands of amazing developers!
In the first half of this blog post series, we explained our decision-making process of designing a streaming data pipeline for Cassandra at WePay. In this post, we will break down the pipeline into three sections and discuss each of them in more detail: Cassandra to Kafka with CDC agent Kafka with BigQuery with KCBQ Transformation with BigQuery view Cassandra to Kafka with CDC Agent The Cassandra CDC agent is a JVM process that is intended to be deployed on each node in a Cassandra cluster. ...