Dimple D

About Dimple D

I am a Data Engineer with over 4 years of experience designing scalable ETL pipelines…

Experience

1. Data Engineer

   Epsilon

   Oct 2024 — Present · Irving, TX, US

   Engineered and deployed enterprise-grade ETL pipelines using Apache Spark and AWS Glue, leveraging partitioning, bucketing, and optimized job configurations to reduce processing times by 20%, which accelerated data availability for analytics and business reporting.Designed & implemented modular SQL-based data models in Redshift and BigQuery, introducing a standardized KPI framework and semantic layer that streamlined dashboard development and shortened delivery cycles by 30% for BI teams.Built time-series forecasting models in Python Prophet, Statsmodels) and embedded them into ingestion pipelines, enabling more accurate resource allocation and minimizing system downtime during high-volume data spikes.Automated 90% of recurring workflow tasks by integrating Apache Airflow and Prefect for scheduling and orchestration, while configuring Azure Monitor alerting to proactively detect failures, thereby reducing manual interventions and improving SLA compliance.Developed and secured IAM role and policy automation within AWS environments, aligning data access with compliance mandates, reducing manual provisioning errors, and strengthening the company’s audit readiness.Designed and deployed real-time streaming ingestion frameworks using Kafka and AWS Kinesis, scaling throughput by 5x to support mission-critical reporting applications and operational dashboards with near real-time visibility.Led the migration of legacy on-premise systems to AWS S3 and Azure Synapse, implementing robust data lifecycle management policies that achieved 99.9% data integrity, while cutting storage costs by optimizing data tiering and archival strategies.

Education

• Central Michigan University

  Master's degree, Information Technology

• Siddharth Institute of Engineering & Technology, Puttur

  Bachelor's degree, Computer Science