ETL License Deduction Criteria
This topic provides information about the license deduction criteria used in LeapLogic to transform your legacy ETL workloads to a modern cloud platform.
In This Topic:
Informatica
This section details the Informatica license deduction criteria. License quota is deducted for units when converting Informatica workloads to target equivalents, where unit refers to transformation.
The license deduction logic is determined based on File similarity and Complexity. Here is a detailed explanation of each criterion:
File similarity
File similarity checks whether the source file is related or similar to an already executed file. A higher file similarity value indicates that you already executed a similar file. The license quota deduction depends on whether the file similarity value falls below the predefined threshold. Specifically, if the file similarity value is below the threshold, then the system will deduct the license quota. Conversely, if the file similarity value exceeds the threshold, it won’t incur any license quota deduction, indicating that the file has been processed before. For instance,
- If the file similarity value is 70% (below the threshold) and the threshold is 80%, then system deducts the unit quota.
- If the file similarity value is 92% (above the threshold) and the threshold is 80%, then the system will not deduct unit quota.
Complexity
One of the criteria to determine the license quota deduction is based on the complexity of each unit. The unit complexity is categorized into SIMPLE, MEDIUM, and COMPLEX. The complexity weightage for the deductible unit quota is outlined as follows:
- If the unit complexity is SIMPLE, the deductible unit quota is 1.
- If the unit complexity is MEDIUM, the deductible unit quota is 3.
- If the unit complexity is COMPLEX, the deductible unit quota is 5.
For instance, consider the example provided in the image below for the file Case1.xml. This workflow contains a total of 7 transformations (units), all of which are successfully transformed. Among these successfully transformed units:
- 4 transformations are categorized as simple complexity with a weightage of 1. Consequently, the deductible unit quota for these units is 4.
- 3 transformations are categorized as medium complexity with a weightage of 3. Consequently, the deductible unit quota for these units is 9.
So, the total deductible unit quota for the Case1.xml file is 13.
The Summary sheet (refer the above image) in Transformation_Report.xlsx file showcases detailed information about the license deductible quota.
- File Name: Displays the name of the file.
- Folder Name: Displays the name of the folder.
- Workflow: Displays the name of the workflow.
- Conversion Percentage: Displays the auto-conversion percentage of each workflow.
- File Similarity: Indicates whether the file is similar to the already executed file. If the value is Yes, then the file is similar to an already executed file else No. If the file is similar to the already executed file, then the Deducted Script Quota, Deducted Block Quota, and Deducted Unit Quota will be zero and will not deduct any quota.
- Complexity: Displays the complexity of each workflow.
- Total Transformation: Displays the number of total transformations.
- Success Transformation: Displays the number of successfully transformed transformations.
- Deductible Units: Displays the unit quota that needs to be deducted based on the complexity of transformed transformations.
- Deducted Unit Quota: Displays the actual unit quota deducted.
The Translation_Report sheet in Transformation_Report.xlsx file provides a comprehensive report of the conversion. It includes information about workflows, mapplets, mappings, transformations, and more.
- File Name: Displays the name of the file.
- Folder_Name: Displays the name of the folder.
- Workflow: Displays the name of the workflow.
- Mapplet: Displays the name of the mapplet.
- Mappings: Displays the associated mappings.
- Transformation: Displays the associated transformation.
- Transformation_Name: Displays the name of the transformation.
- Used_By_Workflow: Displays the associated workflow.
- Target_File_Name: Displays the name of the target file.
- Function_Name: Displays the function associated with the transformation.
- Status: Indicates the conversion status of each function. If the value is SUCCESS the function is converted successfully, else FAIL.
The Transformation_License_Report sheet provides a comprehensive report of the conversion along with the unit quota deduction.
- File Name: Displays the name of the file.
- Folder_Name: Displays the name of the folder.
- Workflow: Displays the name of the workflow.
- Mappings: Displays the associated mappings.
- Type: Displays the type of each mapping.
- Transformation_Name: Displays the associated transformation.
- TRANSFORMATION_TYPE: Displays the type of the transformation.
- Conversion Status: Indicates the conversion status of each transformation. If the value is SUCCESS the transformation is converted successfully, else FAIL.
- Complexity: Displays the complexity of each transformation.
- Deductible Units: Displays the unit quota that needs to be deducted based on the complexity of transformed transformations.
- Deducted Unit Quota: Displays the actual unit quota deducted.
Let us look at the consolidated license deduction logic.
|
ETL Script Name |
Unit |
File Similarity (File Similarity Threshold value = 80%) |
Complexity |
Number of successfully transformed units |
Quota Deduction (Count of Successful Conversions) |
Reason |
|
Script 1 |
Transformation |
10% (below threshold value) |
1 complex transformation, 2 medium transformations, 6 simple transformation |
9 transformations |
17 |
Deduct 17 unit quotas as the file similarity is below the threshold and the complexity of the 1 query is complex with a weightage of 5, 2 queries are medium with a weightage of 3, and 6 queries are simple with a weightage of 1. |
|
Script 2 |
Transformation |
92% (above threshold value) |
2 complex transformation, 5 medium transformations, 11 simple transformation |
18 transformations |
0 |
No quota will be deducted as the file similarity is above the threshold |
DataStage
This section details the DataStage license deduction criteria. License quota is deducted for units when converting DataStage workloads to target equivalents, where unit refers to component or stage.
The license deduction logic is determined based on File similarity and Complexity. Here is a detailed explanation of each criterion:
File similarity
File similarity checks whether the source file is related or similar to an already executed file. A higher file similarity value indicates that you already executed a similar file. The license quota deduction depends on whether the file similarity value falls below the predefined threshold. Specifically, if the file similarity value is below the threshold, then the system will deduct the license quota. Conversely, if the file similarity value exceeds the threshold, it won’t incur any license quota deduction, indicating that the file has been processed before. For instance,
- If the file similarity value is 0% (below the threshold) and the threshold is 80%, then the system deducts the unit quota.
- If the file similarity value is 92% (above the threshold) and the threshold is 80%, then the system will not deduct unit quota.
Complexity
One of the criteria to determine the license quota deduction is based on the complexity of each unit. The unit complexity is categorized into SIMPLE, MEDIUM, and COMPLEX. The complexity weightage for the deductible unit quota is outlined as follows:
- If the unit complexity is SIMPLE, the deductible unit quota is 1.
- If the unit complexity is MEDIUM, the deductible unit quota is 3.
- If the unit complexity is COMPLEX, the deductible unit quota is 5.
For instance, consider the example provided in the image below for the file TSTCASE2.xml. This file contains a total of 20 stages, all of which are successfully transformed. Among these successfully transformed units:
- 6 stages are categorized as simple complexity with a weightage of 1. Consequently, the deductible unit quota for these units is 6.
- 14 stages are categorized as medium complexity with a weightage of 3. Consequently, the deductible unit quota for these units is 42.
So, the total deductible unit quota for TSTCASE2.xml file is 48.
The Summary sheet (refer the above image) in Transformation_Report.xlsx file showcases detailed information about the license deductible quota.
- File Name: Displays the name of the file.
- Job Name: Displays the name of the job.
- Job Type: Displays the type of the job such as parallel job or sequence job.
- Conversion Percentage: Displays the auto-conversion percentage of each job.
- File Similarity: Indicates whether the file is similar to the already executed file. If the value is true, then the file is similar to an already executed file else false. If the file is similar to the already executed file, then the Deducted Script Quota and Deducted Unit Quota will be zero and will not deduct any quota.
- Complexity: Displays the complexity of each script.
- Total Stages: Displays the number of total stages.
- Success Stages: Displays the number of successfully transformed stages.
- Deductible Units: Displays the unit quota that needs to be deducted based on the complexity of transformed stages.
- Deducted Unit Quota: Displays the actual unit quota deducted.
The Translation_Report sheet in Transformation_Report.xlsx file provides a comprehensive report of the conversion. It includes information about jobs, stages, and the conversion status of stages. If the value of conversion status is true, then the stage is converted successfully to the target equivalent else false.
- File Name: Displays the name of the file.
- Job Name: Displays the name of the job.
- Stage Name: Displays the name of the stage.
- Stage Type: Displays the type of each stage.
- Conversion Status: Indicates the conversion status of each stage. If the value is SUCCESS the stage is converted successfully, else FAIL.
The Transformation_License_Report sheet provides a comprehensive report of the conversion along with the unit quota deduction.
- File Name: Displays the name of the file.
- Job Name: Displays the name of the job.
- Stage Name: Displays the name of the stage.
- Stage Type: Displays the type of each stage.
- Conversion Status: Indicates the conversion status of each stage. If the value is SUCCESS the stage is converted successfully, else FAIL.
- Complexity: Displays the complexity of each stage.
- Deductible Units: Displays the unit quota that needs to be deducted based on the complexity of the transformed stages.
- Deducted Unit Quota: Displays the actual unit quota deducted.
Let us look at the consolidated license deduction logic.
|
ETL Script Name |
Unit |
File Similarity (File Similarity Threshold value = 80%) |
Complexity |
Number of successfully transformed units |
Quota Deduction (Count of Successful Conversions) |
Reason |
|
Script 1 |
Component/ stage |
10% (below threshold value) |
1 complex stage, 2 medium stages, 6 simple stages |
9 stages |
17 |
Deduct 17 unit quotas as the file similarity is below the threshold and the complexity of the 1 query is complex with a weightage of 1, 2 queries are medium with a weightage of 3, and 6 queries are simple with a weightage of 1 |
|
Script 2 |
Component/ stage |
92% (above threshold value) |
2 complex stage, 5 medium stages, 11 simple stages |
18 stages |
0 |
No quota will be deducted as the file similarity is above the threshold |
Leaplogic