Get started with Elasticsearch

In this quickstart, you’ll create a real‑time data pipeline that streams changes from a Postgres database into an Elasticsearch index. You’ll:

Boot Sequin
Connect to a sample playground database
Start a local Elasticsearch + Kibana stack
Create an Elasticsearch index
Create a Sequin sink from Postgres to Elasticsearch
Watch your data flow in real‑time

By the end, you’ll have hands-on experience setting up Postgres change data capture (CDC) with Sequin and Elasticsearch.

This is the quickstart for streaming Postgres to Elasticsearch. See the how-to guide for an explanation of how to use the Elasticsearch sink or the reference for details on all configuration options.

Run Sequin

The easiest way to get started with Sequin is with our Docker Compose file. This file starts a Postgres database, Redis instance, and Sequin server.

Create directory and start services

Download sequin-docker-compose.zip.
Unzip the file.
Navigate to the unzipped directory and start the services:

cd sequin-docker-compose && docker compose up -d

Alternative: Download with curl

curl -L https://github.com/sequinstream/sequin/releases/latest/download/sequin-docker-compose.zip -o sequin-docker-compose.zip \
  && unzip sequin-docker-compose.zip && rm sequin-docker-compose.zip
cd sequin-docker-compose && docker compose up -d

Alternative: Clone the repository

git clone git@github.com:sequinstream/sequin.git
cd sequin/docker
docker compose up -d

Verify services are running

Check that Sequin is running using docker ps:

docker ps

You should see output like the following:

CONTAINER ID   IMAGE                           COMMAND                  CREATED          STATUS                    PORTS                              NAMES
bd5c458cabde   sequin/sequin:latest            "/scripts/start_comm…"   11 seconds ago   Up 9 seconds              4000/tcp, 0.0.0.0:7376->7376/tcp   sequin-sequin-1
3bacd89765e7   grafana/grafana                 "/run.sh"                11 seconds ago   Up 11 seconds             0.0.0.0:3000->3000/tcp             sequin-sequin_grafana-1
3ad41319a66c   postgres:16                     "docker-entrypoint.s…"   11 seconds ago   Up 11 seconds (healthy)   0.0.0.0:7377->5432/tcp             sequin-sequin_postgres-1
6139a5fc4e80   redis:7                         "docker-entrypoint.s…"   11 seconds ago   Up 11 seconds             0.0.0.0:7378->6379/tcp             sequin-sequin_redis-1
7e07a5b052de   prom/prometheus                 "/bin/prometheus --c…"   11 seconds ago   Up 11 seconds             0.0.0.0:9090->9090/tcp             sequin-sequin_prometheus-1

Sequin, Postgres, Redis, Prometheus, and Grafana should be up and running (status: Up).

Login

The Docker Compose file automatically configures Sequin with an admin user and a playground database.Let’s log in to the Sequin web console:

Open the web console

After starting the Docker Compose services, open the Sequin web console at http://localhost:7376:

Sequin login page, allowing login with default credentials

Use the following default credentials to login:

Email:

admin@sequinstream.com

Password:

sequinpassword!

View the playground database

To get you started quickly, Sequin’s Docker Compose file creates a logical database called sequin_playground with a sample dataset in the public.products table.Let’s take a look:

Navigate to Databases

In the Sequin web console, click Databases in the sidebar.

Select playground database

Click on the pre-configured sequin-playground database:

The database “Health” should be green.

View contents of the products table

Let’s get a sense of what’s in the products table. Run the following command:

docker exec -i sequin-sequin_postgres-1 \
  psql -U postgres -d sequin_playground -c \
  "select id, name, price from products;"

This command connects to the running Postgres container and runs a psql command.

You should see a list of the rows in the products table:

  id |         name          | price 
----+-----------------------+-------
  1 | Avocados (3 pack)     |  5.99
  2 | Flank Steak (1 lb)    |  8.99
  3 | Salmon Fillet (12 oz) | 14.99
  4 | Baby Spinach (16 oz)  |  4.99
  5 | Sourdough Bread       |  6.99
  6 | Blueberries (6 oz)    |  3.99
(6 rows)

We’ll make modifications to this table in a bit.

Start Elasticsearch & Kibana

We’ll run Elasticsearch locally with Docker using Elastic’s start‑local helper script.

# Download and run the helper script (≈ 1–2 minutes)
curl -fsSL https://elastic.co/start-local | sh

The script:

Downloads the Elasticsearch & Kibana images
Generates credentials
Starts both services via docker‑compose

When the script finishes you’ll see output like:

🎉 Congrats, Elasticsearch and Kibana are installed and running in Docker!

🌐 Open your browser at http://localhost:5601

Username: elastic
Password: <elastic-password>

🔌 Elasticsearch API endpoint: http://localhost:9200
🔑 API key: <api-key>

Copy the API key and API endpoint URL – you’ll need them when configuring the sink.

Create an index

Next create the products index that will receive documents.

curl -X PUT "http://localhost:9200/products" \
  -H "Authorization: ApiKey <api-key>" \
  -H "Content-Type: application/json" \
  -d '{
    "settings": {
      "number_of_shards": 1,
      "number_of_replicas": 0
    }
  }'

Make sure to replace <api-key> with the API key you copied earlier.

You should receive:

{"acknowledged": true, "shards_acknowledged": true, "index": "products"}

Create an Elasticsearch sink

With the playground database connected and the index created, you’re ready to add a sink that pushes changes to Elasticsearch.

Head back to the Sequin console and navigate to the Sinks tab

Click Sinks in the sidebar, then Create Sink.

Select sink type

Choose Elasticsearch and click Continue.

Verify source configuration

In the Source card you’ll see the sequin_playground database and the products table pre‑selected. Leave the defaults.

Add a transform

Open the Transform card, click + Create new transform and use the following Elixir function in a Transform function:

def transform(action, record, changes, metadata) do
  Map.take(record, ["id", "name", "price"])
end

Name the transform products-elasticsearch and click Create transform.

Select the transform

Navigate back to the Sinks tab and select the transform you just created.

If you don’t see the transform you just created, click the refresh button.

Configure a backfill

Open Initial backfill and choose Backfill all rows so the existing data is loaded into Elasticsearch as soon as the sink is created.

Configure Elasticsearch

In the Elasticsearch card enter:

Endpoint URL: http://host.docker.internal:9200
Index name: products
Authentication type: api_key
Authentication value: <api-key> (copied earlier)

Leave the other defaults.

Create the sink

Give it a name, e.g. products-elasticsearch, and click Create Sink.Sequin will first backfill all rows from the products table, then stream every change in real‑time.

Query your data in Elasticsearch

Your backfill should load all rows from the products table into Elasticsearch. When it completes, you should see the sink health is green and the backfill card displays Processed 6 and ingested 6 records in 1s.You can now query your data in Elasticsearch:

curl -X GET "http://localhost:9200/products/_search?pretty" \
  -H "Authorization: ApiKey <api-key>" \
  -H "Content-Type: application/json" \
  -d '{
    "query": {
      "match_all": {}
    }
  }'

You should see the documents from your Postgres table.

See changes flow to Elasticsearch

Let’s test live updates:

Insert a product

docker exec -i sequin-sequin_postgres-1 \
  psql -U postgres -d sequin_playground -c \
  "insert into products (name, price) values ('Organic Honey (16 oz)', 12.99);"

Search for the new product:

curl -X GET "http://localhost:9200/products/_search?pretty" \
  -H "Authorization: ApiKey <api-key>" \
  -H "Content-Type: application/json" \
  -d '{"query": {"match": {"name": "honey"}}}'

Great work!

You’ve successfully:

Started Elasticsearch + Kibana locally
Created an index
Loaded existing data via backfill
Streamed live changes
Queried Elasticsearch

Get started

Sink setup guides

How-to guides

Concepts

Reference

Database setup guides

Tutorials

Get started with Elasticsearch

Run Sequin

Login

View the playground database

Start Elasticsearch & Kibana

Create an index

Create an Elasticsearch sink

Query your data in Elasticsearch

See changes flow to Elasticsearch

Ready to stream your own data

Guide: Connect Postgres

Guide: Setting up an Elasticsearch sink

Run Sequin

Login

View the playground database

Start Elasticsearch & Kibana

Create an index

Create an Elasticsearch sink

Query your data in Elasticsearch

See changes flow to Elasticsearch

​Ready to stream your own data

Guide: Connect Postgres

Guide: Setting up an Elasticsearch sink

Ready to stream your own data