Getting Started

How to get matillion taskmanager using api query

Hi, we get using default 'matillion api' profiles? or need to create any new profiles?

Encryption Function

Hi, I want to apply encrytion in table column using matillion component Tried this function "aes_encrypt(column)" in 'calculator','sql script' components but return error but In Redshift aginity its works fine.please...

Requesting oauth2 token return error invalid client id

I need to integrate an API service that uses OAuth 2.0 but is not listed in the dropdown under Project > Manage Oauth. Following this post [[https://redshiftsupport.matillion.com/customer/portal/articles/2877639?b_id=8915]] I wanted to...

Mongo with Bash Script

Hi, I'm trying to generate mongodb data as json file into s3 bucket using bash script. but i have some connection issue in scripting. Error : MongoDB shell version: 2.6.12...

Jython boto3 delete all files in S3 sub-folders

Hello I have bucket with several folders. One of this folders is ETLWork folders. ETLWork folder has several sub-folders like external_table1, external_table2 ... How can I delete all files in...

Jython Invalid bucket name s3://mocsdw01/FromFTP/

import boto3 BUCKET = FromFTP # name of the s3 bucket file_key = 'AIP5_DLY_PCO_PO_20180714202419.asc.txt' s3 = boto3.resource('s3') obj = s3.Object(BUCKET, file_key) for line in obj.get()['Body']._raw_stream: print(line) botocore.exceptions.ParamValidationError: Parameter validation failed:...

GCP Cloud SQL or just BigQuery?

We are users of the GCP platform and currently trialling Matillion. In our previous work (before Matillion) we already have invested in the use of CLoud SQL as a replication...

Migration

Hello Support, Are there instructions available if we want to migrate from mongoDB to already existing "Postgres RDS Instance with Multi-AZ Failover"? We have Matillion m4.large instance running with MongoDB,...

Mongo DB Json Extract

Hi, I have field in mongodb as greater than 65535 array of JSON data.. I'm used varchar(max). It only get 65535 character count from source to redshift. Any option to...

streaming ETL

Hi....is anyone using Matillion in a streaming fashion where it is reading directly from Kinesis or Kafka?