Skip to main content
All CollectionsIntegrationsData firehose
Get started with Data firehose
Get started with Data firehose

Data firehose is a powerful tool that allows you to sync events from Dotdigital to various external data storages or warehouses.

Gareth Burroughes avatar
Written by Gareth Burroughes
Updated this week

Events are triggered when an action takes place within your marketing activity, for example, one of your contacts opens an email. Exporting your event data in this way lets you analyse and use your marketing data more effectively, providing deeper insights and helping you to make data-driven decisions.

Private preview

This feature is currently in public preview to CXDP customers. Apply to join the preview.


Benefits of Data firehose

  • Export a wide range of engagement-based event data, including email campaigns, SMS campaigns, and more.

  • Choose from multiple data storage options such as Amazon S3, and SFTP/FTPS databases.

  • Access raw data for detailed analysis and reporting, helping to uncover trends and optimise your marketing strategies.

  • Combine Dotdigital marketing data with other information in your data warehouse for powerful insights.

  • Handle large volumes of data efficiently.


Data flow overview

Data firehose lets you export raw engagement data from the platform to various data storages and warehouses. The data flow process involves the following steps:

  • Data collection

  • Engagement data events are captured and processed into our events processor from various sources such as email campaigns, SMS campaigns, and other marketing activities.

  • Data processing

  • Data is processed and transformed into CSV files that are ready to be synced with the target data storage.

  • Data firehose

  • The processed data is then synced to the chosen data storage or warehouse, such as Google Amazon S3, or FTP server.


Data sync options

Data Firehose offers two primary mechanisms for syncing data:

  • One-off
    Export a snapshot of historical data up to a specified date. It is useful for initial data migration or one-time analysis.

  • Data sync frequency
    Data firehose offers three options for sync frequency: every 15 minutes, hourly, or daily.

  • Continuous sync
    Enables a continuous export of data at regular intervals, such as hourly or daily. This makes sure that the data in your storage is always up-to-date with the latest engagement activities.

You can choose between these mechanisms based on their specific needs and preferences.


Event types

Data firehose allows you to export various types of events:

Event

Description

Email click

Data on email link clicks, including click date, campaign ID, and URL clicked.

Email open

Information on email opens, including open date, campaign ID, and device used.

Email reply

Data on email replies, including reply date, campaign ID, and reply content.

Email send

Information about emails that have been sent, including send date, campaign ID, and recipient details.

Email view

Data on email views, including view date, campaign ID, and device used.

Email soft bounced

Information on emails that have soft bounced, including bounce date and reason.

Email hard bounced

Information on emails that have hard bounced, including bounce date and reason.

Email unsubscribed

Data on email unsubscribes, including unsubscribe date, campaign ID, and recipient details.

Email ISP complained

Information on ISP complaints, including complaint date, campaign ID, and ISP details.

Email mail blocked

Data on emails that have been blocked by mail servers, including block date and reason.

Landing page view

Information on landing page views, including view date, page URL, and visitor details.

Page view

Data on page views, including view date, page URL, and visitor details.

Push notification click

Information on push notification clicks, including click date, notification ID, and URL clicked.

Push notification error

Data on errors encountered during push notification delivery, including error date and reason.

Push notification send

Information on push notifications that have been sent, including send date, notification ID, and recipient details.

SMS click

Data on SMS link clicks, including click date, campaign ID, and URL clicked.

SMS remove

Information on SMS removals, including removal date, campaign ID, and recipient details.

SMS send

Data on SMS messages that have been sent, including send date, campaign ID, and recipient details.

Transactional click

Information on transactional email link clicks, including click date, campaign ID, and URL clicked.

Transactional open

Data on transactional email opens, including open date, campaign ID, and device used.

Transactional remove

Information on transactional email removals, including removal date, campaign ID, and recipient details.

Email campaign send

Data on email campaign sends, including send date, campaign ID, and recipient details.

Transactional email campaign send

Information on transactional email campaign sends, including send date, campaign ID, and recipient details.

Did this answer your question?