Modernize Data Loads to CRM with Azure Data Factory

A major metal solutions provider had a legacy application built in on-prem TIBCO Scribe to feed data into its Microsoft Dynamics 365-based CRM system. The organization needed to modernize its processes to support future growth and expansion while addressing pain areas that it had been living with for several years.

Client Challenges and Requirements

• Jobs had to be executed in sequence for individual companies as they did not have the ability to run in parallel thus delaying data availability in CRM (Dynamics 365)
• Jobs not easily scalable so roll out to new companies required extensive enhancements resulting in long time to market
• Jobs encountered frequent failures so a dedicated team was required to manage and maintain operations to keep lights on
• Repetitive manual involvement meant the team could not contribute to new engagements

Bitwise Solution

• Tailor-made Web UI-based orchestration framework aimed at providing control to support and sales teams in managing the data loads through the click of a button
• Support for Azure AD SSO and role-based authentication for Web UI
• ADF Trigger based initiation for instant data availability in the CRM system
• Automated email notifications for various jobs stages
• Support to cater to business priorities while providing a configurable solution to update priorities through a Web UI
• Consolidation of source files before processing through ADF which enables ADF spark clusters to be utilized to their full potential thus requiring far less computing to churn out the output.

Tools & Technologies We Used

Key Results

8x faster time to market for newly onboarded entities

100% automated data loads / 5x faster data availability in CRM

Enables business users bandwidth, fueling future engagements

Optimized and high-productive operations / Reduced overall costs