Ashley Walker

About Ashley Walker

Cloud-agnostic Data Engineer with 6+ years of experience designing, deploying, and optimizing robust data architectures and scalable ETL pipelines across Azure, AWS, and GCP. Expertise in using Airflow, ADF, dbt, and Terraform to build secure, high-performing data platforms that ensure data integrity and regulatory compliance. Proven track record in delivering cost-effective data solutions aligned with business objectives and agile methodologies. Adept at collaborating with cross-functional teams to streamline data processes and enhance operational performance.

Experience

1. Sr Data Engineer

   Capital One

   May 2022 — Present · US

   Developed and maintained hybrid data pipelines using Azure Data Factory (ADF) to ingest sensitive card transactions from Azure SQL DB to ADLS Gen2 and subsequently to Synapse Analytics, ensuring data integrity and scalability. • Designed robust data architectures with Azure Data Lake Storage for raw/curated zones, implementing access controls via RBAC and managed identities to support compliance requirements. • Built and deployed cross-cloud ETL jobs using Airflow (AWS MWAA) and ADF triggers to integrate Azure-hosted APIs with Redshift, enhancing data processing capabilities. • Created dbt models in Synapse and Redshift for real-time fraud scoring, reinforcing scalable data warehousing solutions. • Implemented row-level security in Synapse for regulatory compliance (PCI-DSS) to secure sensitive information. • Established CI/CD pipelines using Azure DevOps for deploying ADF pipelines and Synapse artifacts, aligning with Agile methodologies and automation processes. • Integrated Azure Databricks for real-time streaming jobs using Spark Structured Streaming, enabling efficient processing of large datasets. • Optimized query costs in Synapse through partitioning and materialized views, demonstrating proficiency in database management. • Monitored pipeline health using Azure Monitor and Log Analytics for real-time performance tracking, contributing to proactive operational process optimization. • Collaborated with stakeholders to deliver comprehensive fraud analytics dashboards using Power BI and Redshift Spectrum, supporting cross-functional decision-making.

Education

• San Jacinto College

  Associate Degree

  2017 — 2019