How are data feeds set up?

Feeds are configured from Dock > Data Sources.

From here, you can add feeds from a wide range of different Data Sources using Peak’s data connectors.

Once you have chosen a Data Source, Peak guides you through a configuration process comprising the following stages:

1. Connection

2. Import Configuration

3. Destination

4. Trigger

For more information on how to configure each of the different types of Connector, see the following sets of articles:					
Database Connectors						
Applications Connectors						
File Storage Connectors

Connection

This stage is used to specify exactly where the Data Source is located and any credentials that will be required to access it, for example, host names, usernames and passwords.

Import Configuration

This stage is used when configuring feeds from a database or application.

It enables you to select specific database tables or data that will be ingested by the feed.

For more information about the supported load types and when to use them see the following article:				
Load types supported in Feeds						

Destination

The Destination stage enables you to choose a where your data will be stored.

The destinations available will depend on the data warehouse your Peak organization uses. For example, Redshift users have S3 and Redshift as options, while Snowflake users have S3 and Snowflake.

For more information, see Choosing a destination for a data connector.

Trigger

When configuring a Data Feed, the last stage of the process enables you to set up Triggers and Watchers.

To find out more about this process, see Setting a Trigger for your Data Feed.

Triggers

Triggers let you to define when a data feed is run.

There are three types:

• Schedule 
  Schedule when the feed runs, for example, every x days or hours.
  A basic and advanced (cron) scheduler is available.

• Webhook
  Webhook triggers are used to trigger a data feed when data on a separate system has been updated.

• Run Once
  Trigger the feed to run only when the user clicks “Run”.

Watchers

Watchers can be added to feeds to provide notifications of feed events to Peak users or other systems.

There are two types of watcher:

• User Watcher
  These are users of your organization that will receive a notification within the platform if a feed event occurs.

• Webhook Watcher
  These are used to trigger or send notifications to other systems or applications when a feed is updated.
  They could include external applications such as Slack, or internal Peak functions such as Workflows.