Event Replay

Detailed technical description of RudderStack's events backup and replay feature.

RudderStack's event replay feature lets you backup your event data and replay it in case of any failures. Some scenarios where you can leverage this functionality include:

• Replay failed events from a particular date to a destination, maybe due to some misconfiguration.

• Replay all the events for a particular source, from a particular date, to a new event stream or warehouse destination.

Supported event types for replay

RudderStack can store the following types of event data and replay it to the specified destinations:

• Raw events captured through various sources. RudderStack stores these events in batches of 100,000 events.

• Event payloads sent by RudderStack in case of delivery failures along with the errors(stored approximately every 30 seconds).

Data storage options

RudderStack offers the following data storage options for the event replay functionality:

• No data retention: RudderStack does not store any event data and hence it cannot be replayed.

• RudderStack S3 Storage (default): Event data is stored in RudderStack's Amazon S3 bucket on a rolling 30-day basis, i.e., RudderStack deletes the event data 30 days after it was stored.

• Choose your object storage: Event data is stored in your object storage. RudderStack currently supports Amazon S3, Google Cloud Storage, Azure Blob Storage, and MinIO as the object storage options.

The following section provides more details on how to set up your object storage.

Object storage setup

If you choose to set up your own object storage for backing up and replaying the events, follow the steps below depending on your cloud provider:

Amazon S3 Google Cloud Storage Azure Blob Storage MinIO

• Create your object storage bucket.

• Configure the relevant permissions for your bucket.

• Contact our customer success team to share your S3 bucket name, AWS access key ID, and AWS secret access key.

• Create your object storage bucket.

• Configure the relevant permissions for your bucket.

• Contact our customer success team to share your bucket name and the credentials JSON.

• Login to the Azure portal and create a storage account.

• Click on Containers under Blob service and create a new container.

• Contact our customer success team to share your account name, container, and access key.

• Login to your MinIO service and set up your bucket.

• Contact our customer success team to share your access key ID and secret access key.

Contact us

For more information on the event replay feature, you can contact us or start a conversation in our Slack community.