Orchestration Components

Start Component

Start Component All orchestration jobs require at least one (usually exactly one) Start component. Apart from a name, this requires no configuration, but becomes the starting point for an orchestration job. Properties...

Run Transformation Component

Run Transformation Component Run a transformation job to completion. After the transformation completes, other orchestration components can be linked to this one depending upon success or fail. Properties Property Setting Description Name...

S3 Load Component

S3 Load Component Note: This feature is only available for instances hosted on AWS. Load data into an existing table from objects stored in Amazon Simple Storage Service (Amazon S3). Many of...

And Component

And Component The "And" orchestration component waits for all of its inputs to complete before continuing the job. The order the input components run in is irrelevant, since they must all complete...

Or Component

Or Component The "Or" orchestration component waits for any of its inputs to complete before continuing the job. Once any of the inputs complete, the tasks defined after the "Or" component are...

End Success Component

End Success Component The "End Success" component can be used to mark the overall status of the job as a success, even if certain parts of it were not successful. It also...

End Failure Component

End Failure Component The "End Failure" component can be used to mark the overall status of the job as a failure, even if it would otherwise have been successful. It also serves...

Create Table Component

Create Table Component Create or replace a table. Warning: Depending on the chosen settings, this component is destructive. Take care when running this component as it may remove existing data. Properties Property...

SNS Message Component

SNS Message Component Note: This feature is only available for instances hosted on AWS. This component sends a simple message to an SNS topic. Using this component is the best way to...

RDS Query Component

RDS Query Note: This feature is only available for instances hosted on AWS. Run an SQL Query on an RDS database and copy the result to a table, via S3. This component...