Learn how to setup Postgres change data capture (CDC) to Kafka in under 10 minutes. Setup a robust pipeline with backfills, inserts, updates, and deletes.
Alternative: Download with curl
Alternative: Copy/paste raw Kafka docker-compose.yaml
Create directory and start services
Alternative: Download with curl
Alternative: Clone the repository
Verify services are running
docker ps
:Up
).Open the web console
Login with default credentials
sequin_playground
with a sample dataset in the public.products
table.Let’s take a look:Navigate to Databases
Select playground database
sequin-playground
database:View contents of the products table
products
table. Run the following command:psql
command.products
table:products
table to your Kafka topic:Navigate to Sinks
Select sink type
Note "Source" configuration
sequin-playground
database is selected and all schemas and tables are included. Leave these defaults:Setup a backfill
Inital backfill
card, select the public.products
table to initate a backfill when the sink is created.Configure "Kafka Configuration"
host.docker.internal:9092
products
)Test the connection
Create the sink
products
table. Then, it will receive all changes to the products
table in real-time.Click “Create Sink” to finish setting up your Kafka sink.Messages tab
products
table to your Kafka topic.View in Kafka CLI
read
events from the initial backfill of the products
table.Make some changes
products
table and see them flow to your topic.In your terminal, run the following command to insert a new row into the products
table:Update a product's price
Change a product's name
Delete a product
products
table