Orchestration Components

Cassandra Query

Cassandra Query This component retrieves data on a Cassandra server and loads it into a table. This stages the data, so the table is reloaded each time. You may then use transformations to enrich...

Couchbase Query

Couchbase Query This component retrieves data on a Couchbase server and loads it into a table. This stages the data, so the table is reloaded each time. You may then use transformations...

Text Output

Text Output Component This component creates text files on a specified Amazon S3 bucket, and loads them with data from an Amazon Redshift table or view. The data can be output to...

Youtube Query

YouTube Query This component integrates with the 'YouTube Data API' (https://developers.google.com/youtube/v3/docs/) to retrieve data from YouTube and load it into a table. Warning: This component is destructive as it truncates or recreates its target table...

EMR Load

EMR Load Component Load data into an existing table from objects stored on an EMR cluster. Many of the configuration settings on this component have sensible defaults, mirroring the defaults provided by...

Create External Table

Create External Table This component enables users to create a table that references data stored in an S3 bucket. Note that this creates a table that references the data that is held...

JIRA Query

Jira Query This component uses the JIRA API to retrieve data and load it into a table. This stages the data, so the table is reloaded each time. You may then use...

Email Query

Email Query This component uses IMAP to retrieve email data and load it into a table. This stages the data, so the table is reloaded each time. You may then use transformations...

PayPal Query

PayPal Query This component uses the PayPal API to retrieve data and load it into a table. This stages the data, so the table is reloaded each time. You may then use...

Add Partition

Add Partition Allows users to define the S3 directory structure for partitioned external table data. This works by attributing values to each partition on the table. On S3, a single folder is...