Mapping

Skip Invalid Records

This is a valuable feature in our data processing capabilities. It empowers you to seamlessly process your data without the need to halt the entire process due to problematic records. With this feature, your data pipeline can gracefully handle invalid or erroneous data entries, ensuring uninterrupted processing and allowing you to focus on the valid data while addressing data quality issues separately.

This feature is by default disabled. It means if there is some invalid record inside the payload, then the processing will be stopped.

If you set the parameter to true, then the payload will be processed and all invalid records will be logged into the log file.

Properties

How to Change Settings

For a manual instance, you can just change the parameters in any property files.

For a provisioned instance, you must change the right property file: application-app_{ENV}.properties. Do not change it in application.properties.

Restart is needed to apply this change.