We are users of the GCP platform and currently trialling Matillion. In our previous work (before Matillion) we already have invested in the use of CLoud SQL as a replication layer and then transform data into BigQuery. I cannot see the ability to write to Cloud SQL in the Matillion product. So I have 2 questions: 1. Is it possible to write to Cloud SQL data base? 2. Do others who are using Matillion for GCP use Cloud SQL in this way or do they just work with BigQuery without a CLoud SQL for replication layer?
1 Community Answers
Arawan Gajajiva —
Hi Tim -
Thanks for the question! Our Data Transformation products are purpose built to work with the related Cloud Datawarehous platform. For GCP, we offer Matillion ETL for BigQuery, which requires a BigQuery dataset as a target. You cannot use Matillion ETL for BigQuery to write directly to a Cloud SQL instance.
Things you can do are:
Fetch data from a Cloud SQL database instance using the Database Query component.
Unload data from a BigQuery table or view into a file in a Cloud Storage bucket using the Cloud Storage Unload component.
You could, for instance, unload data that you have Transformed within BigQuery into a CSV. You might then use that CSV file to load data into a Cloud SQL database.