Name is required.
Email address is required.
Invalid email address
Answer is required.
Exceeding max length of 5KB

MongoDB Component


I'm updating my mattillion version 1.36.7 and now iam facing some iisue in mongodb components from basic mode.

Some fields in mongodb but not display in basic mode.

I'm tried that flatted array options too, but i tried in advanced mode using query, those fields retrieving data from mongodb.

I need some clarification.


1 Community Answers

Matillion Agent  

Arawan Gajajiva —

Hi Mathan -

Because MongoDB is schemaless, the default behavior of the MongoDB Query component is to scan the first 100 rows of data to determine the schema of the documents in the collection. If there are fields in documents beyond the first 100, they will not be detected for this reason, and as a result, will not be shown as fields in the Data Selection.

In the scenario where not all of the fields in your collection are found, there are two things you can do:

  1. You can override the default value of 100 rows to scan by setting the Row Scan Depth Connection Option. Note that setting a high value may decrease performance.
  2. You can manually define the schema of the MongoDB collection through the steps outlined in this article: Fixed Schema Definitions with MongoDB

Hope this helps!


Post Your Community Answer

To add an answer please login