Satish R

Experience

1. Senior Data Analyst

   Elevance Health

   Sep 2023 — Present · Atlanta, GA, US

   Engaged in ELT oriented Use-Cases by using Kafka streams, Java-based consumer and producer applications to ingest data into Snowflake, created and reviewed functional specification document with technical team.• Designed and implemented streaming ingestion patterns, including moving data from on-premises to the cloud in Azure, using incremental loads, full loads, and batch design patterns and pipelines.• Utilized SQL to perform data aggregations, joins, subqueries, and create views for efficient data retrieval.• Managed end-to-end data flow journey and architecture design, as well as the CI/CD process on Azure cloud platforms.• Developed and deployed container-based applications using Kubernetes pods, effectively running multiple images in the production environment.• Created and managed streaming pipelines with robust monitoring and data reconciliation mechanisms in place to ensure the accuracy of the source-to-target data journey.• Constructed a framework to monitor Snowflake tasks, counts, pipes, and send email alerts, significantly reducing manual monitoring efforts.• Implemented a Python-based framework for automating database regression testing and alerting.• Built a Snowflake Metadata driven Framework to enhance efficiency and consistency in data processing.• Designed a low code - no code orchestration framework specifically tailored for Snowflake jobs.• Used Flyway Migration in CI/CD processes to automate SQL scripts and facilitate seamless deployment.• Utilized Apache Airflow pipelines to address various business use cases and employ DBT for modularized business logic transformations, testing, and documentation.