Mani Bharataraju

About Mani Bharataraju

https://manibharataraju.substack.com/• Senior Data Engineer at Amazon Web Services with 12+ years of expertise in architecting and implementing enterprise data solutions, leading technical strategy, and driving organizational best practices.• Implemented large-scale data platforms, delivering strategic insights that directly influenced business decisions and operational improvements.• Extensive experience implementing data solutions across Healthcare, Digital Marketing, and Supply Chain domains.• Led the design and implementation of cloud-native data warehouse solutions using MPP databases like Amazon Redshift, establishing architectural patterns and best practices adopted across team.• Pioneered performance optimization initiatives for complex SQL workloads, resulting in significant query performance improvements and cost reductions.• Developed critical ETL pipelines using Apache Spark, designing scalable solutions for data extraction, transformation, and integration across multiple data marts.• Expertise in migrating from legacy workflow orchestration systems to Apache Airflow based orchestration, enabling robust data pipeline management and monitoring. • Developed robust data processing frameworks using Python, incorporating advanced error handling, monitoring, and optimization techniques.• Demonstrated expertise in data visualization using Tableau and D3.js.• Full Stack expertise in building UI applications using React and Javascript.

Experience

1. Senior Data Engineer

   Amazon Web Services (AWS)

   Jul 2023 — Present · Bengaluru, IN

   Currently working on backend design and architecture for an AI agent focusing on scalable, reliable systems that enable intelligent automation.2. Designed and implemented the end-to-end infrastructure and CI/CD pipeline for our enterprise Data Lake migration using AWS CDK.3. Lead the migration of data pipelines from Hammerstone scheduler to Managed Workflows for Apache Airflow (MWAA).4. Participate in and lead design reviews to evaluate the architecture and design of data systems and pipelines.5. Modelled and developed a smart allocation engine to optimise supply allocation for parts requiring break-fix, by dynamically analysing various supply types across different nodes in the supply chain.

Education

• BITS Pilani Work Integrated Learning Programmes

  Master of Technology - MTech, Data Science and Engineering

• Modern Era Convent,New Delhi

  Class XII and X

  1999 — 2009

• Amrita Vishwa Vidyapeetham

  Bachelor's Degree, Computer Science

  2009 — 2013

Skills

• C++
• Pl/Sql
• Hive
• Unix
• Data Warehousing
• Java
• Apache Spark
• Teradata
• Data Structures
• Impala
• Microsoft Sql Server
• Scala
• Python
• Informatica
• Html
• Sqoop
• C
• Programming
• Shell Scripting
• Sql
• Hadoop
• Mapreduce
• Microsoft Office
• Greenplum