Name is required.
Email address is required.
Invalid email address
Answer is required.
Exceeding max length of 5KB

Database Query Compression Type Options

Is it possible to set/change the compression type that is used for a Database Query component? If so, how is this toggled? If not, what compression type is used by default and is there an alternative approach to using the DB Query component to allow one to control the compression type?

In case it is pertinent the source connection is Oracle DB.

3 Community Answers

Matillion Agent  

Paul Johnson —

Hi Daniel,
The compression type for staging files is gzip and it cannot be altered. Is there a particular reason you need this?

Regards,
Paul


Daniel Coulson —

Hi Paul,

Thanks for the quick response. I am just trying to get an idea of the level of compression being used here...so that I can come up with a decent average percentage of compression for each file that gets dropped into S3. If you can provide any kind of level and compression ratio values that would help out a lot.

Daniel


Matillion Agent  

Paul Johnson —

Hi Daniel,

The level of compression achieved by gzip depends upon the source data, but is usually good (i.e. between 5x and 10x) because the output from a Database Query is usually very repetitive.

Please see this article for a more detailed discussion.

Best regards,
Paul

Post Your Community Answer

To add an answer please login