Aman Benare

Data Engineer @CGI

CA

Designed and built a scalable data lake on AWS S3 integrating data from APIs, SaaS platforms, and internal systems• Developed PySpark pipelines using AWS Glue to process multi-terabyte datasets and deliver analytics-ready data to Redshift• Reduced pipeline execution time by 40% through Spark optimization (partitioning, joins, storage formats)• Built metadata-driven ingestion frameworks using Lambda & Step Functions for scalable API ingestion• Designed star schema data models in Redshift for marketing, product, and subscription analytics• Orchestrated pipelines using Airflow (MWAA) with dynamic DAGs handling hundreds of datasets• Implemented data quality validation, schema evolution handling, and automated alerting systems• Migrated legacy ETL pipelines to AWS-native architecture, improving scalability and reducing costs• Built CI/CD pipelines and infrastructure using Terraform and Docker-based deployments

Krupanidhi School of Management - Bangalore, India

Bachelor of Commerce (Data Analysis Specialization)