Hi I am replicating rds mysql database tables on to redshift. everything is working fine. Even updated rows I am able to track using last_updated_time stamp and modifiying in redshift using a transformation job.
But I am not able to figure out how to track deleted rows in mysql tables and delete them in redshift as well. Please help on this.
Thanks in advance.
1 Community Answers
Kalyan Arangam —
Please look into the Detect changes component. It provides an Indicator field with various statuses for each row by comparing incoming data with existing data in Redshift. If a row does not exist in the source data (MySQL) and exists in target, the row get a ‘D’(delete) in the indicator column. See more about it here -