Adamya Singh
Big Data & Cloud Engineer | Hadoop, Spark, AWS (EMR/EKS), Kafka, Python
- Role
- Dwh Bi Developer Big Data & Cloud Production Engineer at Amdocs
- Location
- Agra, UP, IN
- LinkedIn followers
- 500 followers
About Adamya Singh
Big Data & Cloud Engineer with 1.5 years of experience in managing large-scale Hadoop/Spark production systems, optimizing batch pipelines, and supporting AWS migration. Skilled in stabilizing data platforms, automating operational workflows, and acting as a key bridge between on-prem and cloud engineering teams.
Experience
Dwh Bi Developer Big Data & Cloud Production Engineer
Jun 2024 — Present · Pune, IN
Reduced production incidents by 20–30% through proactive monitoring, log analysis, and automated validation checks.Ensured 99%+ SLA compliance across business-critical Hadoop/Spark batch pipelines.Diagnosed and resolved recurring failures across HBase, Hive, Kafka consumers, cutting escalations by ~25%.Acted as the primary production SME, bridging legacy Hadoop systems with AWS cloud engineering to align workflows and eliminate environment gaps.Supported and validated the migration of 50–100+ Spark/Hadoop jobs to EMR/EKS, ensuring functional parity across S3, Databricks, and on-prem systems.Built an end-to-end Python-based automated Excel tracker, aggregating data from multiple nodes, MySQL, and CLI outputs — saving manual effort and becoming a key artifact for the migration team.Developed Python/Shell automation utilities that enhanced monitoring accuracy and improved operational efficiency by 30–40%.Managed complex ingestion flows from 5-6 external sources, ensuring data integrity, reconciliation, and production stability across all environments.Handled regular production on-call responsibilities, ensuring quick incident resolution and maintaining platform reliability.Created structured documentation for 30+ batch workflows, improving troubleshooting speed and enabling smoother team onboarding.
Education
Birla Institute of Technology, Mesra
Bachelor of Technology - BTech, Information Technology
Find verified contacts for anyone on LinkedIn
Unifers gives sales teams verified emails and direct dials, enriched profiles, and outreach that lands in the inbox.
Free plan included · No credit card required
This profile is compiled from publicly available professional sources. Unifers is not affiliated with or endorsed by LinkedIn. Request removal of this profile.