SNP Helps Protective Insurance Seamlessly Migrate its On-premises Datawarehouse to Microsoft Azure

Opportunity: Protective Insurance Driving Smarter Decisions with Highly Secure Data by Migrating to Azure

During the lifespan of every IT environment, enterprises must assess the best path to manage, simplify and optimize their data warehouse migration, to increase efficiency, maintain security and improve cost effectiveness. One example of such success is the data warehouse migration solution SNP Technologies deployed for Protective Insurance. A company that provides large-scale transportation and insurance for some of the largest fleets in the trucking and package delivery industry, which operate with zero margin for error. For a company known for the reliability of its underwriting and claims processes, migrating to Microsoft Azure meant enhancing their existing strengths and discovering new opportunities to leverage their data.

Their current landscape consisted of 41+ Internal/External sources, 2316 Informatica ETL jobs, 14k+ Active Ad-hoc reports, 95 Active BO universes and over 6 dashboards which they were looking to migrate to Azure. Protective Insurance engaged SNP Technologies to establish a strong framework in Microsoft Azure enabling Protective Insurance to expand their use of Azure Data Platform and BI computing resources and define the architecture and roadmap to migrate and modernize their existing data engineering platform and Business Intelligence (BI) services in a safe and secure manner.

Microsoft introduced SNP Technologies to Protective Insurance in 2021 to provide an assessment. SNP followed a streamlined approach and an inhouse converged cloud adoption framework for migration. It started with having a clear picture of why Protective Insurance wanted to migrate, then after the assessment of the business situation, SNP Technologies started with defining the methods and tools, which were required for migration. Following this, the migration started.

SNP assessed four key areas for the client:

Data landscape focussing on:

  • End to end data architecture
  • Key data assets, capabilities for DG, DQ, MDM etc.

ETL Landscape

  • ETL capabilities, tools and activities
  • ETL detailed inventory listing and complexity

Data Support Services

  • Data support tools, SLAs
  • Data support process including manual processes

Reporting & Dashboards

  • IT assets, tools, processes for reporting and dashboards
  • Business insights on critical reports and automation maturity

Utilizing the same framework, the client was facilitated with an assessment and migration plan. For the same:

  • Pre-sales activity continued for approximately 3 months where, multiple client meets were organized to analyze the business case in detail.
  • Realization of the gaps and bottlenecks was done using self-discovery sessions.
  • Considerable amount of time was spent to simplify the process by removing the complications.
  • Business adaptation framework was the key to the migration process.
  • Design sessions via interviews and workshops were organized to decide on the application, data warehouse, and infrastructure design.
  • Security and regulatory compliances that needed to be adhered were defined.
  • The tools and methodology to be used were established once done with strategizing the process, iterative methodology (agile) was used to move candidate workloads to Azure.
  • SNP created interdependent application groups and then they were put into sprints based on numerous design principles and application requirements.
  • SNP ensured that the process was completed to a degree that all in scope and data warehouse requirements were easily decommissioned with cost efficiency.

 

The Solution: Delivering Value with Microsoft Azure

The client had been trying to migrate their data warehouse to Cloud for the past many months and were struggling. They benefited from SNP Technologies working closely with Protective’s team foran in-depth analysis of their 12 business areas, current DWH, Informatica ETL processes and BI reports was done to determine the modernized architecture using Azure PaaS resources, the remediation required, and the level of effort that would be associated with modernization. We did these through various discussions with Protective’s business team, discovery of the existing DWH objects, ETL processes and BI reports. This also highlighted the importance of modernization, which helped their business in standardizing the business logic, encryption of PII fields, self-serving BI by implementing different measures which were lacking in their existing systems. The migration also enabled the customer to have a functioning business continuity with a cost model that helped move their capital expenditures to operational expenditures.

Solution Architecture:

After numerous reviews of the findings, proposed architectures, and approval of the recommendations by Protective Insurance, SNP Technologies started implementing the modernization process of their existing data warehouse to Azure PaaS. This Architecture was designed keeping Microsoft’s well architecture framework pillars in mind.

Scalability:
  • Used scalable Azure managed infrastructure components such as Azure Databricks, Azure Synapse Analytics. Depending on the workloads: compute power, storage sizes can be independently scaled up or down.
  • Designed scalable ingestion and transformation process components.
  • Using these pipelines, ingesting any source to the data lake can be easily implemented.
  • Using the audit columns extracting the data in INC/Full load can be easily implemented.
  • Since the raw data is available in Data Lake, other teams such as Business Analysts, Data Science can utilize the data.
Operational Efficiency:
  • The complete solution can be easily deployed into higher environments.
  • SNP has implemented Azure DevOps Build and Release pipelines for efficient operations on production.
  • SNP has implemented Audit and Logging mechanisms at every stage of the process, which helps for easy and smooth operations.
  • Capabilities like restart/resuming failed jobs using Azure Monitors
Security:
  • PII Encryption at all layers, Data Masking
  • ADLS security using ACL’s
  • RBAC Policies
  • All resources are Private Networks
Repeatability:
  • SNP has implemented various components for this assignment which are generic forany Data warehousing projects.
  • Utilities like Informatica Mapping to SQL converter can be reused to migrate any Informatica job to Azure Databricks using Spark SQL.
  • The modern architecture is designed considering the future analytical road maps for PIC. This architecture is capable enough to ingest streaming data, store and process the same.
  • The modern architecture is ready to serve for Advanced Analytics use cases such as Data Science teams, Business Analysts etc.,
  • Reduced cost of ownership and maintenance costs to almost zero due to PaaS services in the Architecture.

Through the engagement with SNP Technologies, Protective Insurance is looking to achieve the following goals achieved its business goals:

Establishing a secure, reliable framework in Microsoft Azure that enables migration of the Data, Data Platform and BI components including ETL, Governance Tools, Security Models, ODS, DataMarts, EDW and BI Reports & Dashboards along with Self Service BI capabilities.

  • Get a modernized data Platform and BI Architecture to:
  • Bring agility and reduce time to Insights
  • Increase scalability
  • Enhance operational efficiency
  • Meet their security and governance guidelines
  • Help them optimize costs.

To get Protective Insurance production ready, SNP leveraged multiple technologies such as data factory, Azure databricks, Azure synapse analytics, Azure key vault, Power BI.

 

For more information on SNP's Migration Services, contact our experts here
Migrate its On-premises Datawarehouse to Microsoft Azure
Business
Jatinder Virdee Linkedin Profile

Jatinder Virdee

Jatinder Virdee leads the Digital and Content Marketing initiatives at SNP Technologies. She is responsible for Website Content Audit & Management, Content Writing, Digital & Social Media Marketing, Brand Management, Email Marketing, Marketing Automation and Managing Multiple Microsoft Partner Programs & Events.