Skip to the content
LeaplogicLeaplogic
  • Home
  • About Us
  • Contact
SIGN IN
  • Home
  • About Us
  • Contact

  • Getting Started
    • Before You Begin
    • Creating an Account
    • Logging into LeapLogic
    • Reset Password
    • Quick Tour of the Web Interface
    • LeapLogic in 15 minutes
      • Prerequisites
      • Step 1. Log into LeapLogic
      • Step 2. Create Assessment and Get Insights
      • Step 3. Create Transformation Pipeline and See Results
      • Step 4. Edit or Optimize the Transformed Code
      • Step 5: Complete the Transformation Lifecycle
  • Introduction to LeapLogic
    • Overview
    • High Level Architecture
    • Supported Legacy and Cloud Platforms
    • Key Features
  • Workload Assessment
    • Overview
    • Value Proposition
    • Creating Assessment
      • Prerequisites
      • Step 1. Provide Primary Inputs
        • Automation Coverage
      • Step 2. Add the Additional Inputs
        • Table Stat Extraction Steps
          • Teradata
          • Oracle
          • Netezza
      • Step 3. Update the Source Configuration
      • Step 4. Configure the Recommendation Settings
    • Assessment Listing
    • Understanding Insights and Recommendations
      • Volumetric Info
      • EDW
        • Oracle
          • Highlights
          • Analysis
          • Optimization
          • Lineage
          • Recommendations
          • Downloadable Reports
        • Vertica
          • Highlights
          • Analysis
          • Optimization
          • Lineage
          • Recommendations
          • Downloadable Reports
        • Snowflake
          • Highlights
          • Analysis
          • Optimization
          • Lineage
          • Recommendations
          • Downloadable Reports
        • Azure Synapse
          • Highlights
          • Analysis
          • Optimization
          • Lineage
          • Recommendations
          • Downloadable Reports
        • SQL Server
          • Highlights
          • Analysis
          • Optimization
          • Lineage
          • Recommendations
          • Downloadable Reports
        • Teradata
          • Highlights
          • Analysis
          • Optimization
          • Lineage
          • Recommendations
          • Downloadable Reports
        • Netezza
          • Highlights
          • Analysis
          • Optimization
          • Lineage
          • Recommendations
          • Downloadable Reports
        • Google Big Query
          • Highlights
          • Analysis
          • Optimization
          • Lineage
          • Recommendations
          • Downloadable Reports
        • Redshift
          • Highlights
          • Analysis
          • Optimization
          • Lineage
          • Recommendations
          • Downloadable Reports
        • PostgreSQL
          • Highlights
          • Analysis
          • Optimization
          • Lineage
          • Recommendations
          • Downloadable Reports
        • Duck DB
          • Highlights
          • Analysis
          • Optimization
          • Lineage
          • Recommendations
          • Downloadable Reports
        • ClickHouse
          • Highlights
          • Analysis
          • Optimization
          • Lineage
          • Recommendations
          • Downloadable Reports
        • Exasol
          • Highlights
          • Analysis
          • Optimization
          • Lineage
          • Recommendations
          • Downloadable Reports
        • DB2
          • Highlights
          • Analysis
          • Optimization
          • Recommendations
          • Lineage
          • Downloadable Reports
      • ETL
        • Informatica
          • Highlights
          • Analysis
          • Lineage
          • Downloadable Reports
        • Ab Initio
          • Highlights
          • Analysis
          • Lineage
          • Downloadable Reports
        • DataStage
          • Highlights
          • Analysis
          • Lineage
          • Downloadable Reports
        • Talend
          • Highlights
          • Analysis
          • Lineage
          • Downloadable Reports
        • SSIS
          • Highlights
          • Analysis
          • Lineage
          • Downloadable Reports
        • Informatica BDM
          • Highlights
          • Analysis
          • Lineage
          • Downloadable Reports
        • Oracle Data Integrator
          • Highlights
          • Analysis
          • Downloadable Reports
        • Pentaho
          • Highlights
          • Analysis
          • Downloadable Reports
        • Azure Data Factory
          • ARM Template
          • Highlights
          • Analysis
          • Downloadable Reports
        • Matillion
          • Highlights
          • Analysis
          • Downloadable Reports
        • SnapLogic
          • Highlights
          • Analysis
          • Downloadable Reports
      • Orchestration
        • AutoSys
          • Highlights
          • Analysis
          • Downloadable Reports
        • Control-M
          • Highlights
          • Analysis
          • Lineage
          • Downloadable Reports
        • SQL Server
          • Highlights
          • Analysis
      • BI
        • OBIEE
          • Highlights
          • Analysis
          • Lineage
          • Downloadable Reports
        • Tableau
          • Highlights
          • Analysis
          • Lineage
          • Downloadable Reports
        • IBM Cognos
          • Highlights
          • Analysis
          • Downloadable Reports
        • MicroStrategy
          • Highlights
          • Analysis
          • Lineage
          • Downloadable Reports
        • Power BI
          • Highlights
          • Analysis
          • Lineage
          • Downloadable Reports
        • SSRS
          • Highlights
          • Analysis
          • Downloadable Reports
        • SAP BO
          • Highlights
          • Analysis
          • Lineage
          • Downloadable Reports
        • WebFOCUS
          • Highlights
          • Analysis
          • Downloadable Reports
      • Analytics
        • SAS
          • Highlight
          • Analysis
          • Lineage
          • Downloadable Reports
        • Alteryx
          • Highlights
          • Analysis
          • Lineage
          • Downloadable Reports
      • Integrated Assessment (EDW, ETL, Orchestration, BI)
        • Highlights
        • Analysis
        • Optimization
        • Lineage
        • Recommendations
    • Managing Assessment Reports
      • Downloading Report
      • Input Report Utility
      • View Configuration
    • Complexity Calculation Logic
    • Key Benefits
    • Ad hoc Query
  • Metadata Management
    • Overview
    • Introduction to Data Catalog
      • Managing Data Catalog
        • Building Data Catalog
        • Insights to Data Catalog
        • Managing the Repository and Data Source
      • Creating Repository (Repo)
      • Creating Data Source
    • Tag Management
    • Key benefits
  • Batch Processing using Pipeline
    • Introduction
    • Designing Pipeline
      • How to create a pipeline
        • Configuring Migration Stage
          • Schema Optimization
        • Configuring Transformation Stage
          • On-premises to Cloud
          • Cloud-to-Cloud
          • LeapLogic Express
        • Configuring Validation Stage
          • Data Validation
            • Table
            • File
            • File and Table
            • Cell-by-cell validation
          • Query Validation
            • Query Validation (When Data is Available)
            • Query Validation (When Data is Not Available)
          • Schema Validation
        • Configuring Execution Stage
        • Configuring ETL Conversion Stage
          • Ab Initio
          • Informatica
          • Informatica BDM
          • Matillion
          • DataStage
          • SSIS
          • IICS
          • Talend
          • Oracle Data Integrator
          • Pentaho
          • SnapLogic
        • Configuring Mainframe Conversion Stage
          • Cobol
          • JCL
        • Configuring Orchestration Stage
          • AutoSys
          • Control-M
        • Configuring BI Conversion Stage
          • OBIEE to Power BI
          • OBIEE to AWS QuickSight
          • Tableau to Amazon QuickSight
          • Tableau to Power BI
          • Tableau to Superset
          • Tableau to Looker
          • IBM Cognos to Power BI
        • Configuring Analytics Conversion Stage
          • SAS
          • Alteryx
        • Configuring Script Conversion Stage
    • Key Features
      • How to schedule a pipeline
      • Configuring Parameters
  • Pipeline Reports
    • Overview of Pipeline Report
    • Pipeline Listing
    • Reports and Insights
      • Migration
      • Transformation
        • On-premises to Cloud
        • Cloud-to-Cloud
        • LeapLogic Express
      • Validation
        • Data
          • File
          • Table
          • File and Table
        • Query
          • Query Validation Report (When Data is Available)
          • Query Validation Report (When Data is not Available)
        • Schema
      • Execution
      • ETL
        • Ab Initio
        • Informatica
        • Informatica BDM
        • Matillion
        • DataStage
        • SSIS
        • IICS
        • Talend
        • Oracle Data Integrator
        • Pentaho
        • SnapLogic
      • Mainframe
        • Cobol
        • JCL
      • Orchestration
        • AutoSys
        • Control-M
      • BI
        • OBIEE to Power BI
        • OBIEE to Amazon QuickSight
        • Tableau to Amazon QuickSight
        • Tableau to Power BI
        • Tableau to Superset
        • Tableau to Looker
        • IBM Cognos to Power BI
      • Analytics
        • SAS
        • Alteryx
      • Shell Script
      • Common Model
    • Automation Level Indicator
      • ETL
        • Informatica
        • Matillion
        • DataStage
        • Informatica BDM
        • SnapLogic
        • IICS
        • Ab Initio
        • SSIS
        • Talend
        • Pentaho
      • Orchestration
        • AutoSys
        • Control-M
      • EDW
      • Analytics
        • SAS
        • Alteryx
      • BI
      • Shell Script
    • Error Specifications & Troubleshooting
  • SQL Transformation
    • Overview
    • Creating and Executing the Online Notebook
      • How to Create and Execute the Notebook
      • Supported Features
    • Configuring the Notebook
      • Transformation
      • Unit Level Validation
      • Script Level Validation
    • Notebook Listing
  • Operationalization
    • Overview
      • Basic
      • Advanced
      • Cron Expression
    • Parallel Run Pipeline Listing
  • Transformation Source
    • Introduction
    • Creating Transformation Source Type
  • Governance
    • Summary of Governance - Roles and Permissions
    • User Creation
      • Creating a new User Account
    • Adding Roles and permissions
      • How to add Roles and Permissions to a new user?
    • Adding Group Accounts
    • Default Quota Limits
    • Product Usage Metrics
  • License
    • EDW
    • ETL
  • Script/ Query Log/ Code Extraction Prerequisites
    • Cloud
      • Azure Data Factory
      • Snowflake
      • Azure Synapse
      • Google BigQuery
      • Redshift
      • Azure SQL Database Hyperscale
      • Aurora PostgreSQL
    • EDW
      • Oracle
      • Netezza
      • Teradata
      • Vertica
      • SQL Server
      • Db2
      • MySQL
      • PostgreSQL
    • ETL
      • DataStage
      • Informatica
      • SSIS
      • Talend
      • ODI
      • IICS
      • DBT
      • Pentaho
      • Matillion
      • SnapLogic
      • Ab Initio
      • SAP BODS
      • TAC
      • WebFOCUS
    • BI
      • IBM Cognos
      • OBIEE
      • Tableau
      • Metabase
      • MicroStrategy
      • PowerBI
      • LeapLogic Utility for SAP BO
      • SAP BO Universe and Web Intelligence
      • SSRS
    • Analytics
      • SAS
      • Alteryx
    • Orchestration
      • AutoSys
      • Control-M
      • SQL Server
    • Mainframe
  • LeapLogic Desktop Version
    • Overview
    • Registration and Installation
    • Getting Started
    • Creating Assessment
      • ETL
      • DML
      • Procedure
      • Analytics
      • Hadoop
    • Reports and Insights
      • Downloadable Reports
      • Reports for Estimation
    • Logging and Troubleshooting
    • Sample Scripts
    • Desktop vs. Web Version
    • Getting Help
  • LeapLogic (Version 4.9) Deployment
    • System Requirements
    • Prerequisites
    • Deployment
      • Extracting Package
      • Placing License Key
      • Executing Deployment Script
      • Accessing LeapLogic
    • Uploading License
    • Appendix
    • Getting Help
  • Removed Features
    • Configuring File Validation Stage
    • Variable Extractor Stage
      • Variable Extractor Report
    • Configuring Meta Diff Stage
      • Meta Diff
    • Configuring Data Load Stage
      • Data Load
    • Configuring Multi Algo Stage
  • FAQs
  • Tutorial Videos
  • Notice
Home  »  Advanced Configuration (Optional)

Advanced Configuration (Optional)

This section covers the steps to configure a few optional components as required.

  • HTTPS mode
  • Ab Initio ETL Enablement to deploy Ab Initio component
  • Workload Assessment Performance Tuning for bulky workloads
  • Onboarding of a new tenant in Governance application
  • Configuring LDAP authentication mechanism
  • Steps for upgrading the LeapLogic build
  • Enable automated service monitoring and rectification


HTTPS Mode

By default, LeapLogic services run in HTTP mode. LeapLogic also supports HTTPS mode. This section covers the process of configuring HTTPS for LeapLogic services. You may like to either install your SSL certificate or create a new one.

Follow the below steps to enable a valid SSL certificate.

Prerequisites: The application must be running on the domain for which the certificate has been issued and the value of the IDW_HOST env variable will be the domain name itself.

  1. Configure the below properties in the idw-env.sh file.

PROPERTY NAME DESCRIPTION
WEB_PROTOCOL By default, the property is set to “http”. Update the value to: “https”
IS_HTTPS_ENABLED_WM By default, the property is set to “false”. Update the value to: “true”
IS_WM_HTTP_PORT_ENABLED By default, the property is set to “true”. Update the value to: “false”

  1. Configure the below property in the idw-default-env.sh file.

PROPERTY NAME DESCRIPTION
KEYSTORE_DEFAULT_ALIAS Add the alias name of the certificate. By default, the property is set to “hostname -f”. Update it as per your hostname or IP with which you will login.

  1. Import the certificate into the Java Keystore
  2. Rename the certificates to wm-tomcat.cer and wm-tomcat.jks, if required.
  3. Place both the files (.cer and .jks) in the directory: IDW_HOME/conf/

Note:

If the SSL certificates are created using the automated script, then skip the above step.

  1. Set the password in idw-default-env.sh KEYSTORE_DEFAULT_PASSWORD=”password”. By default, it is “password” only.

Note:

If you have generated the SSL certificate on your own, please configure the password which you have given while generating the certificate.

  1. Proceed with the normal deployment process by executing configure.sh, init.sh

Note:

In case of self-signed certificate, follow the steps to create the self-signed certificate given below. However, if you already have the required certificates directly execute enable-https.sh and start-all.sh scripts.

Following are the steps to create a self-signed HTTPS certificate for LeapLogic services.

The IDW_HOME/bin folder for IDW directory contains enable-https.sh script file. Execute the enable-https.sh file to configure HTTPS for LeapLogic services.

This script does the following:

  • Updates the LeapLogic services as per the HTTPS configuration.
  • Configures LeapLogic to use the Keystore file created in the previous step.

${IDW_HOME}/bin/enable-https.sh

Note:

If you are deploying with the property export IS_HADOOP_CLUSTER_PRESENT=”true”;

Then after executing ./enable-https.sh, execute the below two commands.

chmod +x idw-deployment.sh
./idw-deployment.sh

Lastly, start all the services.

${IDW_HOME}/bin/start-all.sh


AbInitio ETL Enablement

This section provides information for the deployment of the AbInitio ETL suite. Before deployment, certain prerequisites need to be taken care for a hassle-free experience.

Prerequisites

  • dos2unix should be installed on the edge node.
  • The edge node should be accessible using SSH.
  • wget command must be available on the edge node.

Deployment

Open and edit the AbinitioUDFRegister.hive file from the path IDW_HOME/application/workload-migration/lib/abinitio-external-libs/hive_udf. Replace ${HDFS_LIB_DIRECTORY} with hdfs:///tmp. Following this, create your Hive schema and use it to execute the updated script to register the UDFs.

Steps to register the UDFs in the Hive database:

  1. Create a new database in Hive
  2. Navigate to the following location IDW_HOME/application/workload-migration/lib/abinitio-external-libs/hive_udf
  3. Update the required variables and schema name in registerUdf.sh file and execute it


Workload Assessment for Large Files

Workload Assessment engine needs some configurational changes for efficient performance.

Following are the lists of properties that should be modified if the size of query execution logs is too large.

  1. Modify IDW_HOME/application/assessment/bin/workload-assessment-execution.sh
    • -Xms{file size * 1/4} for example -Xms3g for a file of size 10 GB
    • -Xmx{file size * 1/2}
    • -XX:MetaspaceSize = {file size * 1/15}
    • -XX:MaxMetaspaceSize = {file size * 1/10}
  2. Modify IDW_HOME/application/assessment/conf/assessment-site.properties
    • spark.executor.instances = {file size * 1/4}
    • spark.executor.memory = {file size * 1/4}
    • spark.driver.memory={file size – (file size * 1/4)}
    • spark.sql.shuffle.partitions = {file size * 5}
    • assessment.cleanser.querylog.partition = {file size * 20}
    • assessment.analyzer.querylog.partition = {file size * 20}
    • assessment.reporting.partition = {file size * 14}
    • spark.addtional.properties = spark.yarn.executor.memoryOverhead ={file size * 1/5}
    • Please note that for the above property, that is “spark.addtional.properties”, add “spark.yarn.executor.memoryOverhead={file size * 1/5}|” e.g. “spark.yarn.executor.memoryOverhead=3G|”. Please leave the remaining values as it is.

If the value is in decimal, round it off to the nearest whole number.


New Tenant Onboarding

Onboarding a new tenant in the LeapLogic application is easy and configurable. Follow the below given steps to do the same.

export TENANT_NAME=””;
export TENANT_DESCRIPTION=””;


LDAP Authentication

While LeapLogic is deployed, the authentication mechanism is typically configured only once, where you have two options: Authentication through a database or through LDAP.

Authentication through Database

This section provides the steps to configure user authentication through the database on the customer’s premises. This is the default authentication type. By default, a user namely “idwadmin” is already created.

Authentication through LDAP (Optional)

This section provides the steps to configure user authentication through LDAP within an enterprise.

  • Configure the below property for enabling user authentication through LDAP

export IS_LDAP_ENABLED=true

Note:

This feature offers a variety of configurations as given below, however, it has limited capabilities and will work in certain scenarios only such as where administrator access can be provisioned, etc.

The properties that need to be configured in the idw-env.sh file for LDAP are as follows.

Property Name Description
export LDAP_CONNECTION_URL=VALUE_LDAP_CONNECTION_URL e.g. ='ldap:// < LDAP server host > :,< LDAP server port >'
export LDAP_ROOT_BASE=VALUE_LDAP_ROOT_BASE e.g. CN=Users, DC = < LDAP Directory Distinct Name Value > DC=com
export LDAP_MANAGER_DN=VALUE_LDAP_MANAGER_DN e.g. cn= < Manager User Distinct Name >, CN= Users, DC=< LDAP Directory Distinct Name Value > DC=com
export LDAP_MANAGER_PASSWORD=VALUE_LDAP_MANAGER_PASSWORD Manager User Password
export LDAP_USER_BASE_DN=VALUE_LDAP_USER_BASE_DN e.g. cn={0},CN=Users, DC= < LDAP Directory Distinct Name Value > DC=com
export LDAP_USER_DEFAULT_COMPANY=VALUE_LDAP_DEFUALT_COMPANY Organization name
export DEFAULT_ADMIN_USERNAME=${IDW_DEFAULT_USER} This property needs to be set only when LDAP properties are configured. The value for this property needs to be set as 'Administrator' if the LDAP flag is true


Build Upgrade

Following are the steps to upgrade the LeapLogic build from one version to another.

  1. Navigate to the <Deployment folder>/bin/upgrade
  2. Set the permission

chmod -R 777 upgrade

  1. Update the path of old and new deployment in the upgrade-env.sh file
    1. export OLD_DEPLOYMENT_PATH=?
    2. export NEW_DEPLOYMENT_PATH=?

    Example: export OLD_DEPLOYMENT_PATH=/home/impadmin/idw-leaplogic-4.5-cl6-release
    export NEW_DEPLOYMENT_PATH=/home/impadmin/idw-leaplogic-4.6-release

  1. Execute the following command to start the upgrade process

./upgrade.sh


Service Monitoring, Alerts and Restart

This feature allows any service which is down to get restarted on its own. It also sends out a notification on the configured email id.

PROPERTY NAME DESCRIPTION
MONIT_ENABLED Enables monitoring and automated rectification when configured as “true”. Can also be set as “false”
MONIT_PORT Port on which this runs e.g. 8686
MONIT_EMAIL_TO_NOTIFY The email where an automated notification will be sent in case any service is down e.g. info@leaplogic.io

To learn more, contact our support team or write to: info@leaplogic.io

Copyright © 2025 Impetus Technologies Inc. All Rights Reserved

  • Terms of Use
  • Privacy Policy
  • License Agreement
To the top ↑ Up ↑