Swapna K

About Swapna K

Experienced Senior Data Engineer with over 7 years of success delivering scalable, cloud-native data platforms across healthcare, telecom, and financial services. Specialized in designing batch and real-time data pipelines using PySpark, SQL, and Azure Databricks, and implementing Medallion architecture for structured, business-ready datasets. Proficient in Snowflake, Synapse, and Delta Lake for building cost-efficient, high-performance data warehouses and Lakehouses. Skilled in orchestrating end-to-end workflows using Apache Airflow, Kafka, and Event Hub to support reliable streaming and event-driven processing. Strong background in dbt, CI/CD automation (Terraform, GitHub Actions, Azure DevOps), and containerization (Docker, Kubernetes) to support modular, scalable, and version-controlled deployments. Experienced in managing cross-cloud environments (Azure, AWS, GCP) with secure data storage, governance (Unity Catalog, Azure Purview), and lineage tracking. Committed to building clean, auditable data ecosystems that support compliance, operational efficiency, and strategic analytics. Known for modernizing legacy ETL systems and enabling enterprise-wide intelligence through trusted, well-modeled datasets and reporting layers in tools like Power BI and Tableau.

Experience

1. Senior Data Engineer

   Amgen

   Feb 2023 — Present · US

   Amgen leverages advanced biology and technology to fight serious diseases and improve lives globally. At the core, I worked on integrating large volumes of clinical, research, and operational data while ensuring accuracy and regulatory compliance. The focus was on building reliable, scalable data platforms that delivered timely insights to help research and business teams make better decisions faster.

Education

• University of North Texas

  Master's degree