Sourabh Kumar Singh

About Sourabh Kumar Singh

I’m a Software Engineer at EPAM Systems with experience in data engineering and backend…

Experience

1. Junior Software Engineer

   EPAM Systems

   Dec 2023 — Present · Gurugram, IN

   Data Engineering Responsibilities- ETL & Big Data Processing: Designed, maintained, and optimized large-scale ETL pipelines using Airflow, Spark, Scala, Python, and Hive to support critical business workflows- Platform Migration Contribution: Contributed to a major initiative migrating 180+ ETL pipelines from a vendor-managed platform to an in-house big data platform, enabling cost savings and improved scalability- Pipeline Optimization: Enhanced Spark and Hive queries to reduce data processing times, strengthen stability, and ensure uninterrupted availability of data pipelines- Production Reliability: Resolved numerous production issues, implemented monitoring solutions, and integrated data quality checks (Airflow + Spark) to improve governance and trust in analytics workflows- Cross-Team Collaboration: Worked closely with platform engineering teams to deliver migration and optimization goals without impacting stakeholder data availability.Backend Engineering Projects- Quiz Management Application: Built a Java backend application using Spring Boot, Spring Data, Hibernate, and MySQL with RESTful APIs to support CRUD operations- AI Travel Recommendation System: Developed a microservices-based recommendation platform with authentication features (Email Verification, Forgot Password), improving user experience and security- Testing & Quality: Wrote comprehensive unit and integration tests using JUnit and Mockito to ensure reliability and maintainability- Full-Stack Development: Designed and deployed backend features while following clean code practices and Agile methodology for iterative delivery- Innovation & Performance: Continuously identified and implemented optimizations to improve scalability, reliability, and maintainability of systems.