Nikhil K

Sr Gcp Data Engineer @Georgia-Pacific LLC

Atlanta, GA, US

Developed ETL pipelines on GCP using Apache Beam and Dataflow to process large-scale data in real-time,resulting in a 20% improvement in data processing time. Built and deployed data pipelines using Cloud Composer and Cloud Functions, enabling seamless integrationwith other GCP services such as Big Query, Pub/Sub, and Cloud Storage. Implemented monitoring and alerting mechanisms using Stack driver, enabling proactive issue identificationand resolution in GCP data pipelines. Designed and executed end-to-end testing strategies for GCP data pipelines, ensuring the accuracy andcompleteness of data from ingestion to analysis. Utilized DevOps practices and tools such as Jenkins, Terraform, and Ansible to automate GCP infrastructuredeployment and configuration, resulting in a 50% reduction in deployment time. Worked with Python, SQL, and Bash scripts to develop custom data transformations and data quality rules,resulting in a 25% reduction in data processing errors. Developed and maintained CI/CD pipelines on GCP using Cloud Build and Cloud Run, enabling seamless codedeployment and testing in a controlled environment. Implemented data versioning and lineage tracking using tools such as Data Catalog and Data Studio, enablingauditability and traceability of healthcare data in GCP. Conducted capacity planning and scaling of GCP data pipelines using Kubernetes and Cloud Autoscaling,ensuring optimal performance and cost-efficiency. Developed multi-cloud strategies in better using GCP (for its PAAS). Designed and developed Spark jobs with Scala to implement end-to-end data pipelines for batch processing. Developed data pipeline using Flume, Kafka, and Spark Stream to ingest data from their weblog server andapply the transformation. Developed data validation scripts in Hive and Spark and perform validation using Jupiter Notebook by spinningup the query cluster in EMR.

Sacred Heart University

Master of Science - MS, Business Analytics