Name is required.
Email address is required.
Invalid email address
Answer is required.
Exceeding max length of 5KB

Create Temp Tables in Redshift

Is there a way to create temp tables in Redshift using standard components like the RDS Query component?

In Redshift, temp tables (tables created with CREATE TEMPORARY...) can be written to more quickly because it doesn't mirror blocks as it's writing them, so write performance can be twice as fast.

When I'm staging data that I know I'm going to dump after finishing my ELT, I'd love to be able to put that data into temporary tables to get that bit of performance gain.

But, other than creating the tables manually, I don't see a way in Matillion to specify in components that I want the destination table to be a temporary table.

2 Community Answers

Matillion Agent  

David Lipowitz —

Hi Matt,

Thanks for the question.

Unfortunately, we don’t support table creation with TEMPORARY keyword because Matillion is a multi-threaded application. Temporary tables are only visible to the session they are created in and there’s no guarantee that subsequent operations requiring the temp table will the same thread/session.

Hope that makes sense and please let us know if you have any more questions.

Best Regards,
Dave


Matt Burr —

Thanks, David. It does make sense.

Post Your Community Answer

To add an answer please login