Lineage
End-to-end data and process lineage identify the complete dependency structure through interactive and drill-down options to the last level.
Typically, even within one line of business, multiple data sources, entry points, ETL tools, and orchestration mechanisms exist. Decoding this complex data web and translating it into a simple visual flow can be extremely challenging during large-scale modernization programs. The visual lineage graph adds tremendous value and helps define the roadmap to the modern data architecture. It deep dives into all the existing flows, like Autosys jobs, applications, ETL scripts, BTEQ/Shell (KSH) scripts, procedures, input and output tables, and provides integrated insights. These insights help data teams make strategic decisions with greater accuracy and completeness. Enterprises can proactively leverage integrated analysis to mitigate the risks associated with migration and avoid business disruption.
LeapLogic’s lineage helps to trace the complete data flow in steps. The visual representation helps to track how the data hopped and transformed along the way, with details of parameter changes, etc. It provides backward and forward lineage showing the hops and reference points of data lineage with a complete audit trail of the data points of interest. They also help temporarily ignore peripheral, unwanted data points like system tables, bridge tables, etc. and establish useful correlations between data points to uncover hidden patterns and results. Users can deep dive into certain flows leveraging next-gen features like contextual search, advanced filters according to workload type, an interactive visual interface, graph depth, and more.
Let’s see how you can efficiently use the lineage feature to your advantage.
To view the required lineage, choose the Process or Data tab and then enter the keywords in the search field.
In addition, the filter search icon allows you to include or exclude particular nodes to obtain the required dependency structure. You can also choose the direction of the lineage. By default, the Dependency Direction is Left to Right Hierarchy. You can also choose Right to Left Hierarchy direction as required. Moreover, you can also increase the Hierarchy Levels to nth level.
In lineage, you can see the dependencies of the selected nodes (the selected node is emphasized). Nodes and their edge functions are interlinked.
Nodes |
Edges |
Column |
call |
Chart |
Write |
Page |
Read |
Job |
Execute |
File |
Other |
Tables |
|
View |
|
Workflows |
|
Report |
|
Query |
|
Flat File |
|
DB_TYPE |
|
Bridge Table |
|
You can apply:
Feature | Icon | Use |
Filter | | Used to filter the lineage. |
Reload | | Assists in reloading graphs. |
Save | | Used to save the lineage. |
Download | | Used to download the file. |
Expand | | Used to enlarge the screen. |