Nvg Krishna

About Nvg Krishna

As a data engineer at CVS Health, I design and deploy end-to-end data pipelines using GCP…

Experience

1. Data Analytics Engineer

   CVS Health

   Jan 2023 — Present

   Designed, developed, and maintained highly scalable and fault-tolerant ETL & ELT pipelines using SQL, Python, and Apache Spark to ingest, transform, and process large volumes of structured and semi-structured data from multiple sources. • Migrated legacy data warehouse workloads to GCP cloud platforms, improving query performance by 70% and reducing infrastructure costs and implemented data quality checks, validation rules, and monitoring, ensuring high data accuracy and reliability. • Designed and deployed end-to-end data pipelines using GCP Data Fusion to ingest, transform, and load healthcare data from diverse sources, achieving 30% reduction in data processing time.• Leveraged DAG-based workflow orchestration tools like Apache Airflow, enabling the scheduling and monitoring of 6 complex data workflows, resulting in 60% improvement in workflow efficiency.• Implemented GCP-based data security controls using Cloud KMS, IAM, VPC Service Controls, and TLS encryption to protect healthcare data at rest and in transit, ensuring compliance with HIPAA and industry security standards while maintaining data integrity.• Built & deployed scalable data ingestion frameworks to support real-time and batch data processing, enabling near-real-time analytics and reporting in the healthcare domain. Integrated and transformed data from various healthcare data systems, including HL7 and FHIR data formats, ensuring data conformity and consistency.• Utilized GCP\'s cloud-based data storage systems such as BigQuery, Cloud Storage, and Firestore to efficiently store, retrieve, and manage healthcare data. Implemented data partitioning and clustering strategies, reducing data query time by 20% and optimizing overall data storage costs by 30%.• Collaborated with cross-functional teams, including data scientists, analysts, and healthcare professionals, to understand data requirements and deliver tailored solutions.