Ashwini Walake

About Ashwini Walake

AWS Data Engineer with 3.7 years of deep expertise in designing, building, and optimizing scalable data solutions in AWS cloud and hybrid environments.1. Proficient in AWS Data Services: S3, Glue, Redshift, DynamoDB, Athena2. Hands-on experience with Hadoop, HDFS, Hive, and Impala3. Hands-on experience with CloudFormation for infrastructure automation4. Strong expertise in data security using AWS KMS and Secrets Manager/IAM5. Experienced in ETL development with PySpark, Python, and SQL6. Expertise in enterprise data warehousing with Teradata7. Leveraged Apache Iceberg for ACID transactions, schema evolution.8. Migrated data from Mainframe, Teradata, Guidewire, Huon SnowflakeProject & Domain Expertise:1. AWS Data Engineer with 3 years of experience designing, developing, and modernizing large-scale, cloud-native data platforms in the insurance domain.2. Expertise in migrating on-premises systems such as Guidewire, Huon, and ACMO to a cloud-based architecture using a wide range of AWS services.3. Skilled in building end-to-end ETL pipelines using AWS Glue, Amazon EMR with PySpark, and Apache Iceberg for high-volume batch and near real-time processing.4. Designed and implemented multi-layered architecture including Base Layer, Master Layer, Power Mart, and Business Mart, with Snowflake as the central cloud data warehouse (migrated from Redshift).5. Developed robust ingestion frameworks using Glue Jobs, custom Python scripts, S3, and DynamoDB for schema tracking and control.6. Leveraged Apache Iceberg to support ACID transactions, schema evolution, partition pruning, and time-travel capabilities in the data lake.7. Built CI/CD pipelines using GitHub and Jenkins, ensuring efficient and traceable deployments across stages.8. Actively contributed across all environments: QA, SIT, UAT, PRE-PROD, and PROD, ensuring smooth CI/CD deployment, testing, and release management.9. Automated orchestration using Control-M and AWS Lambda for seamless, event-driven pipeline executions and alerts.10. Built modular DBT models using macros, snapshots, seeds, and tests, Implemented incremental model\'s transformations in Snowflake.11. Enabled secure processing and key management using AWS KMS and AWS Secrets Manager for credential storage and data encryption.12. Developed interactive dashboards and reports using Qlik, integrating with Snowflake and cloud-based data marts.13. Core technologies: AWS Glue, EMR, Spark, Apache Iceberg, Snowflake, S3, DynamoDB, Lambda, CloudWatch, KMS, Secrets Manager, Redshift, IAM, Control-M, Jenkins, GitHub, Qlik.

Experience

1. Aws Data Engineer

   Tata Consultancy Services

   Sep 2022 — Present · Pune, IN

   AWS Data Engineer with 3.7years of deep expertise in designing, building, and optimizing scalable data solutions in AWS cloud and hybrid environments.1. AWS Services: S3, Glue, EMR, Lambda, DynamoDB, CloudWatch, Redshift, KMS, Secrets Manager,IAM,EC22. Data Processing: PySpark, Apache Iceberg, SQL, Python3. Data Warehouse: Snowflake, Redshift, Teradata,Mainframe,DBT4. Orchestration: Control-M5. IaC & DevOps: AWS CloudFormation, GitHub6. Environments Managed: QA, SIT, UAT, PRE-PROD, PROD7. Monitoring: AWS CloudWatch, Glue Logs, Lambda Logs8. Big data : Hadoop, HDFS, Hive, and ImpalaProject & Domain Expertise:AWS Data Engineer with 3.7years of experience designing, building, and modernizing scalable cloud-native data platforms, primarily in the insurance domain. Proficient in AWS services such as S3, Glue, EMR (PySpark), Lambda, DynamoDB, Redshift, CloudWatch, KMS, and Secrets Manager. Expertise in building multi-layered data architectures including Base Layer, Master Layer, Power Mart, and Business Mart, with Snowflake as the centralized warehouse (migrated from Redshift). Skilled in end-to-end ETL development using Glue Jobs, EMR, Python, SQL, and Apache Iceberg for high-volume batch and near real-time processing. Developed ingestion frameworks with schema tracking using DynamoDB, and leveraged Iceberg for ACID compliance, schema evolution, partition pruning, and time travel. Built data validation and reconciliation processes against legacy systems like Guidewire, Huon, and PolicyStar. Enabled secure, scalable, and efficient pipelines across QA, SIT, UAT, PRE-PROD, and PROD environments. Automated orchestration with Control-M and AWS Lambda for event-driven workflows and alerts. Integrated CloudWatch for monitoring and SLA tracking.Ensured secure data handling via KMS encryption and Secrets Manager. Enabled business insights using Qlik dashboards powered by Snowflake marts. Delivered CI/CD using Jenkins and GitHub, supporting reliable deployments.

Education

• Dr. Babasaheb Ambedkar Technological University

  Master of Technology - MTech, Electrical, Electronic and Communications Engineering Technology/Technician

• Dr. Babasaheb Ambedkar Technological University

  Bachelor of Technology - BTech, Electrical, Electronic and Communications Engineering Technology/Technician