Data Warehouse Modernization
Automated ETL Migration from DataStage to Azure Data Factory
A Canadian public research university, in a journey to modernize its legacy on-premise Netezza data warehouse on Azure, required a solution to efficiently migrate ETL developed in DataStage to Azure Data Factory (ADF) to reduce costs and enhance its EDW, reporting and analytics applications.
Client Challenges and Requirements
- 143 Parallel Jobs and 12 Sequence Jobs to be converted from DataStage to ADF.
- Strict timeline due to IBM DataStage and Netezza licenses nearing expiration.
- Challenges due to default behavioral differences between source and target technologies.
Bitwise Solution
Bitwise migration services using proprietary automated ETL Conversion solution to accelerate migration timeline within budget requirements.
Tools & Technologies We Used
DataStage
Oracle
Synapse
Python
Bitwise ETL Converter
Azure Data Factory (ADF)
Bitwise data validation utility
Key Results
Expedited conversion of 63 SCD jobs with customization in auto conversion.
20-30% Cost Savings achieved in Azure.
Avoidance of DataStage license renewal costs by completing migration in tight timeline despite delays on customer end.
5/5 Customer Satisfaction Score based on consistency of communication and quality, timeliness of deliverables.