Turning a Backup of Matillion ETL into a new pre-release Instance.

These instructions explain how to take a backup of an existing Matillion instance and then switch the new instance to the pre-release repository. This will then allow you to upgrade the instance to the pre-release version.

Pre-release versions of Matillion are designed to allow users to test Matillion ETL in their own environment and feedback before general release. All feedback should be via support@matillion.com

Pre-releases of Matillion ETL are fully supported however caution should be exercised when using them in a production environment

Pre-release users will be notified in the usual way that upgrades are available when the final public update is available. They may be invited onto future pre-releases of Matillion again via the “updates available” notification.

The following is a series of instructions for backing up a Matillion ETL instance and switching channels in order to access the pre-release version of Matillion ETL.

 

1. Backup a Matillion instance to an EBS Snapshot (Main Article)

  1. On the AWS Console, select EC2 from the top-left menu
  2. Click ‘Running Instances
  3. Find your Instance and select it
  4. At the lower-right of the page, click on the link for your Root Device
  5. From the small popup, select the link for your EBS ID
  6. Right Click the volume and Create Snapshot
  7. Enter name and description then Create
Making Backups
 

2. Create an AMI Image from the Snapshot

  1. On AWS Console, select EC2.
  2. On the EC2 Dashboard, find ‘Snapshots’ on the left-hand side under the heading ‘Elastic Block Store’.
  3. Select desired snapshot. Note only 50 are shown at a time by default and you may need to navigate manually to the end of the list.
  4. Right-click the selected snapshot and select “Create Image
  5. Name the image as appropriate.
  6. In ‘Virtualization Type’ select ‘Hardware-assisted virtualization’ (HVM).
  7. In ‘Architecture’ select ‘x86_64
  8. Use the default ‘RAM disk ID’ and ‘Kernel ID
  9. Finally, click Create.
Creating Images
 

3. Launch a new instance from the AMI

Now launch a new EC2 Instance from the image while using the same settings as the existing AMI. A brief overview of how to accomplish this is given below.

  1. On AWS Console, select EC2.
  2. On the EC2 Dashboard, select Instances from the left-hand menu (or use the ‘Running Instances’ link).
  3. Click ‘Launch Instance’.
  4. Click ‘My AMIs’ from the left-hand menu.
  5. Find the Image we just created and click Select beside it.
  6. Choose an instance size - this MUST be the same size as the one you imaged!
  7. Select an IAM role (probably the same one as used with the instance we created a snapshot of).
  8. Click ‘Add Storage’.
  9. Click ‘Add Tags’. Use the ‘Name’ tag and give that a value to name the instance.
  10. Click ‘Configure Security Groups’. Elect to ‘Select an existing security group’ and choose the group associated with the instance the image was created from using the drop-down menu.
  11. Click ‘Review and Launch’ then ‘Launch’.
  12. Select the keypair that you’ll use to securely connect to this Matillion ETL instance.
  13. Launch Instances (this may take a few minutes).
Launching Image
 

4. Switch to the pre-release channel

  1. Ssh into your EC2 instance (if putty)

  2. Edit /etc/yum.repos.d/matillion.repo by changing the line ending:

/repo

to ending

/repo-amzn-aws-redshift-prerelease

WARNING: If the current file does NOT end with /repo then proceed NO FURTHER and contact Matillion support!

Note: To edit this file, you may need to elevate permissions using sudo.
 

5. Update the software and restart the instance with the following commands

  1. sudo yum clean all
  2. sudo yum update
  3. sudo service tomcat8 restart
 

You are now running the pre-release version on the cloned instance!

Be sure to test your workloads, etc. Be aware schedules will have migrated and will run on both instances. SQS will listen from old and new.

Once you are confident your jobs are running you may want to shut down your original Matillion ETL instance.