Step 3. Update the Source Configuration

On Source Configuration page, you can configure the input for parsing or pre-processing the input dataset. This helps to filter and process the input dataset as per your use case.

Follow the below steps to update the source configuration:

Steps:

Prerequisites
Step 1. Provide Primary Inputs
Step 2. Add the Additional Inputs
Step 3. Update the Source Configuration
Step 4. Configure the Recommendation Settings

In Source File Configuration, you can configure the source file parsing mechanism to modify the file pattern according to your needs (combination of file nomenclature and extension). To do so,

Click Modify.
Delete () or add () File Pattern/File Type/File Tags to modify the file pattern.
Click to save the changes.

In Complexity Distribution, you can transfer the complexity of queries or files from a higher to a lower level. Let’s say, if multiple queries have a similar pattern, a recognized query eases the analysis of the remaining queries. In such cases, you can lower the query or file complexity from the higher level.
Providing the complexity distribution values helps in complexity calculation, cost estimation, etc. To customize the predefined complexity,

Click Modify.
Provide the complexity values that you need to transfer to the lower complexity level.
Click to update the changes.

To retrieve the statement type of queries from the input execution log files, turn on the Query Execution Logs toggle. Otherwise, the SQL statement type will be extracted from the queries through analysis.

Note:

If the source code type is EDW Execution Log and the target is Kyvos, you can provide usernames in the User Name field. This will generate an output report containing associated data related to the specified usernames from the records in the query logs.

In Skip Columns, select the column(s) that are not present in the execution logs. To successfully execute the execution log assessment, the input artifacts should adhere to a specific pattern with a predefined number of columns. If the input artifacts fail to contain the specified number of columns that may result in execution errors. To avoid this, identify and select the missing columns in the skip columns.

In Skip Tables, upload the CSV file to exclude input tables that contain certain patterns, such as system tables, etc. to retrieve a cleaner data lineage graph.

In Pre-assessment Utility, upload the utility (JAR, SHELL, ZIP) file for parsing or pre-processing the input dataset. That is, prior to the actual assessment of input workloads the inputs are pre-processed. This helps to filter and process the input dataset as per your use case.
In Execution Command, provide command to execute the utility. The structure of the input path is:
{INPUT_PATH}/procedure
{INPUT_PATH}/querylog
{INPUT_PATH}/dml
{INPUT_PATH}/ddl
{INPUT_PATH}/dml/tableinfo
{INPUT_PATH}/etl/abinitio
{INPUT_PATH}/etl/informatica
{INPUT_PATH}/etl/datastage
{INPUT_PATH}/schedular/control
{INPUT_PATH}/schedular/autosys
{INPUT_PATH}/analytics/sas
In Execution Timeout, provide time in HH:MM:SS format. Once the execution timeout expires, the assessment does not try to process the utility and executes without it.

Notes:

If the selected Source Code Type is BI Report and Source is Tableau, IBM Cognos, SAP BO, or SSRS, then in Database Type select the underlying source database (Teradata, SQL Server, etc.).
If the selected Source Code Type is Analytics Script and Source is SAS:
- In Default Database Type, select the underlying source database such as Teradata, Oracle, SQL Server, etc.
- To get information about file resemblance or duplicacy, turn on Duplicacy toggle. This will generate a Duplicacy sheet into the SAS_Code_Assessment report. This sheet provides the file resemblance index by comparing each file with all the other input files. It marks all files that meet or exceed the pre-defined similarity threshold as duplicates. The files which the system is able to successfully compare are marked as Success in the Status column otherwise an error message is displayed.

Click Recommendation Settings to configure baseline recommendations

Next Step:

Step 4. Configure the Recommendation Settings