Data Warehouse Modernization
Accelerated Data Platform Modernization from Cognos Data Manager to Talend
An American multinational finance and insurance corporation required a solution to seamlessly migrate its aging IBM Cognos Data Manager platform to Talend to modernize its data platform, improve efficiency, and ensure ongoing production support.
Client Challenges and Requirements
- Detailed assessment of identified Cognos ETLs from different LOBs like Premium, Claims, Marketing System, Business Process Management Unit, Reinsurrance, Premium Audit, Compliance Tracking System, etc.
- Convert Cognos ETL in current environment to Talend 6.4.
- End-to-end testing.
- Production support for all converted applications.
Bitwise Solution
- Setup environment, install and configure required software.
- Detailed Analysis & Design Document for all LOBs.
- Convert ETLs covering dimensions, fact loads and lookup builds of different complexities.
- Develop custom Java code to generate schema by reading Database Tables.
- Unit test results documentation in the form of comparison output reports using comparison jobs that were built for data validation in Talend.
- Schedule on production box using scheduler (TAC) or Autosys.
- Prepare documentation from a change management perspective.
- Active job monitoring of converted scheduled jobs, maintain log of all job status.
- Acknowledge and resolve incident tickets / issues as per priority.
- Develop reports for stakeholders to get holistic picture of business performed by company for respective month.
- Understand the applications and update artifacts for future use.
Tools & Technologies We Used
Bitwise ETL Converter
Cognos Data Manager
Oracle
Talend 6.4
TAC or Autosys
GitHub
Unix
Key Results
Completed migration to Talend environment in 2 months
Optimized performance by pulling only required fields or contexts into Talend
35% savings in conversion time using Bitwise ETL Converter accelerator
20% savings in regression testing using Bitwise Data Validation utility
