Sai Sara
Senior Data Engineer at CVS Health: Driving Data Excellence and Innovation
- Role
- Senior Data Engineer at CVS Health
- Location
- Chicago, IL, US
- LinkedIn followers
- 500 followers
Experience
Senior Data Engineer
Feb 2022 — Present · Chicago, IL, US
Led a data migration project from on-prem systems to Hive tables and from Hadoop to Cloud. Migrated MongoDB\'s collections to Hive by establishing a pipeline between 2 servers. Constructed ETL pipelines using Spark/Pyspark, loaded data into Azure\'s ADLF Gen 2 storage. Experience with Azure Synapse, creating a centralized data warehouse that allows for easy querying and analysis from multiple sources. Used Apache Airflow to design, develop, and maintain data pipelines. Developed Spark applications using Scala & Python for data processing and analytics. Wrote Map Reduce Jobs, HIVEQL, Pig, Spark. Import data using Sqoop into Hive and HBase from existing SQL Server. Experience in Azure ADF to ingest data from multiple sources like on-premises databases, cloud applications, or external APIs into ADLS Gen 2 storage. The data was transformed using Azure Databricks and loaded into Azure Synapse for analysis. Experience in Azure Synapse, I have created a centralized data warehouse that allows analysts and data scientists to easily query and analyze data from multiple sources. Data can be extracted from ADLS Gen 2 and transformed using Azure Databricks before being loaded into Synapse. Experience with Snowflake for storing and querying large amounts of data at Walgreens. Developed Spark applications by using Scala and Python and implemented Apache Spark for data processing from various streaming sources. Extensive experience in designing, developing, and maintaining data pipelines using Apache Airflow. Transfer data in logical stages from System of records to raw zone, refined zone and produce zone for easy translation and de normalization. Setting up Azure infrastructure like storage accounts, integration runtime, service principal id, app registrations to enable scalable and optimized utilization of business user analytical requirements in Azure. Developed and implemented large-scale data platform for real-time and batch processing, improving data.
Education
Trine University
Master's degree, Computer/Information Technology Administration and Management
Find verified contacts for anyone on LinkedIn
Unifers gives sales teams verified emails and direct dials, enriched profiles, and outreach that lands in the inbox.
Free plan included · No credit card required
This profile is compiled from publicly available professional sources. Unifers is not affiliated with or endorsed by LinkedIn. Request removal of this profile.