Data Warehouse Modernization
Cognos Data Manager Conversion to Talend Big Data for Multinational Insurer
An American multinational finance and insurance corporation required a solution for conversion of its IBM Cognos Data Manager ETL system to Talend 6.4
Client Challenges and Requirements
- Detailed assessment of identified 50 Cognos ETL
- Convert up to 50 Cognos ETL in current environment to Talend 6.4
- Deliver Fully Unit Tested code for the converted Talend ETLs
Bitwise Solution
Environment setup as well as installation and configuration of required s/w for new client
High level Analysis & Design Document
Conversion of 50 ETLS covering dimension & fact loads and lookup builds of different complexities
Unit test results documentation in the form of comparison output reports using comparison jobs that were built for data validation in Talend
Scheduling on production box using scheduler (TAC)
Documentation from a change management perspective
Tools & Technologies We Used
Bitwise ETL Converter
Cognos Data Manager
Oracle
Talend 6.4
TAC or Autosys
GitHub
Unix
Key Results
Created custom Java code to generate schema for Talend components by reading Database Tables
Optimized performance by pulling only required fields or contexts into Talend
Created joblets for context parsing and logging
