Reference for configuring and using the AWS SQS sink with Sequin.
https://sqs.<region>.amazonaws.com/<account-id>/<queue-name>
.
For FIFO queues, the queue name must end with .fifo
.
<your-queue-arn>
with your actual queue ARN (e.g., arn:aws:sqs:us-east-1:123456789012:my-queue
).
use_task_role: true
, ensure your ECS task role, EC2 instance profile, or EKS service account has the required SQS permissions.message_grouping
configuration option:
message_grouping: true
(default): Enable message grouping for ordered deliverymessage_grouping: false
: Disable message grouping for maximum throughputmessage_grouping
is enabled, Sequin will set the MessageGroupId
on SQS messages if you’re using a FIFO queue. The default message group for a message is the source row’s primary key(s). You can override this by specifying one or more columns to use for message grouping at the table level.
When message_grouping
is disabled, no MessageGroupId
is set, allowing for higher throughput but without ordering guarantees.
Sequin will order the delivery of messages with the same group according to their commit timestamp.
queue_url
with routing functions.
Example routing function:
use_emulator: true
and emulator_base_url: "http://localstack:4566"
configuration to send messages to the local SQS queue:
1
. You can click on a message to see more details, including the last error response received from SQS.