Sai Ch
Sr Data Engineer| AWS & Azure Cloud | Snowflake | Big Data | python | Powering Seamless Data Integration & Analytics
- Role
- Sr Data Engineer at Anthem, Inc
- Location
- Charlotte, NC, US
- LinkedIn followers
- 500 followers
Experience
Sr Data Engineer
Mar 2023 — Present
Utilized Snowflake as a Software as a Service (SaaS) solution and transferred DB2 data to Snowflake through the use of Snow SQL and data movement servers.• Created pipelines using AWS infrastructure to integrate with Snowflake.• Responsible for loading data into S3 buckets from the internal server and the Snowflake data warehouse.• Implemented the installation and configuration of a multi-node cluster on Amazon Web Services (AWS) EC2 forcloud-based projects.• Using Amazon Web Services (Linux/Ubuntu), launch Amazon EC2 Cloud Instances and configure launched instances for specific applications.• Collaborated closely with cross-functional teams to integrate Snowpipe with AWS S3, creating a seamless and automated flow of data from cloud-based sources to Snowflake.• Work with a team on making decisions on how to migrate the data from on prem to cloud,which tools can be used for ETL or ELT on cloud.• Worked on a project involving the ingestion of JSON files into Snowflake, developing strategies to handle dynamic data structures and ensure schema-on-read flexibility.• Developed Spark applications using Pyspark and Spark-SQL for data extraction,transformation and aggregation from multiple file formats for analyzing & transforming the data to uncover insights into the customer usage patterns.• Led the implementation of a real-time data ingestion solution using Snowpipe, automating the continuous loading of streaming data into Snowflake data warehouse.• Worked on Snowflake Schema, Data Modeling and Elements,and Source to Target Mappings, Interface Matrix and Design elements. Performed data quality issue analysis using Snow SQL by building analytical warehouses on Snowflake.• Utilized Amazon EMR for processing Big Data across a Hadoop Cluster of virtual servers on Amazon EC2 and Amazon S3.• Designed and implemented action filters, parameters, and calculated sets for dashboards and worksheets in Tableau.
Education
R.V.R. & J.C. College of Engineering
Bachelor's degree, Electrical, Electronics and Communications Engineering
Find verified contacts for anyone on LinkedIn
Unifers gives sales teams verified emails and direct dials, enriched profiles, and outreach that lands in the inbox.
Free plan included · No credit card required
This profile is compiled from publicly available professional sources. Unifers is not affiliated with or endorsed by LinkedIn. Request removal of this profile.