Sourabh Rai

Senior Associate L1 @Publicis Sapient

Bengaluru, IN

Built a reusable Airflow DAG framework to generate and deploy YAML driven DAGs on Amazon S3, improving pipeline onboarding and standardization.• Migrated SAP-based workflows to the AWS stack (Redshift, S3, Airflow), enhancing scalability and maintainability.• Developed modular ETL pipelines with multi-level validation (schema, row, column) to ensure data quality.• Decoupled and modernized legacy batch systems into cloud-native workflows, enhancing flexibility and efficiently processing terabytes of data.• Created a JSON-configured orchestration system using a handshake mechanism and parallel execution on EMR, reducing end-to-end job runtime while standardizing and monitoring the data migration process

Shri Vaishnav Institute of Technology and Science, Indore

B.E, Computer Science