Cell-by-cell validation

Cell-by-cell validation validates data between two tables. It is applied to all or specific tables to compare data between source and target data sources. LeapLogic provides the provision to perform cell-by-cell validation on cluster where execution happens on a cluster instead of an edge node.

To enable cell-by-cell validation on cluster:

Go to the validation deployment folder or directory (/home/impadmin/idw-Leaplogic-X.XX/application/validation/conf/validation/).
Open configs.properties property file.
Data validation execution property can be set to:
- Enable cluster mode: data.validation.execute.on.cluster=Y
- Disable cluster mode: data.validation.execute.on.cluster=N
After changing the parameters, restart the validation service.

In cluster mode, cell-by-cell validation is performed on the Hadoop cluster. Moreover, validation is performed only between the same platforms, for example, Redshift to Redshift, Teradata to Teradata, etc. That is, validation will not be performed on cross-platforms. If you disable cluster mode, the validation runs on the edge node.