Elasticsearch sink

​

Configuration

• Endpoint URL Base URL of your Elasticsearch cluster (for example, https://your-es-server:9200).
• Index name Name of the Elasticsearch index to write to. The index must exist before Sequin can stream data.
• Authentication type One of api_key, basic, or bearer.
• Authentication value Credential corresponding to the chosen authentication type.
• Batch size (optional) Maximum number of documents per bulk request (default 100, maximum 10 000).

​

Authentication header formats

​

Transform requirements

​

Example transforms

def transform(_action, record, _changes, _metadata) do
  record
end

def transform(_action, record, _changes, _metadata) do
  %{
    id: record["product_id"],
    name: record["product_name"],
    description: record["product_description"]
  }
end

​

Bulk import behaviour

​

API endpoints used by Sequin

• POST /{index_name}/_bulk – indexing, replacing, and deleting documents (always used, even for a single document).
• POST /{index_name}/_search – invoked by Test Connection in the console to verify connectivity.

​

Error handling

• Connection or TLS failures.
• 404 – index not found.
• 401 / 403 – authentication or authorisation failure.
• Mapping conflicts (field type mismatches).
• Malformed bulk payload (usually due to transform output).

​

Limits

• Batch size is limited to 10,000 documents by Sequin. Elasticsearch’s default http.max_content_length (100 MB) may require smaller batches.
• One sink targets one index; multiple indices require multiple sinks.
• Only index and delete bulk operations are issued. Other operations (update, create, etc.) are not used.

​

Routing

def route(action, record, changes, metadata) do
  %{
    index_name: metadata.table_name
  }
end