Neelima Kommineni

About Neelima Kommineni

I am a highly skilled Data Engineer / Big Data Developer with over 7 years of experience designing, developing, and optimizing large-scale data pipelines, ETL workflows, and cloud-based data solutions across the retail, banking, and technology sectors. I have worked with clients including Walmart, US Bank, Google, and Accenture, delivering batch and real-time processing solutions that combine structured and unstructured datasets from multiple sources such as POS systems, Salesforce/nCino, IoT feeds, and third-party APIs.My expertise spans cloud platforms including AWS (S3, EMR, Glue, Lambda, Redshift), Azure (Data Factory, Synapse Analytics, Databricks, Logic Apps, Function Apps), and GCP (BigQuery, Dataflow, Pub/Sub, Cloud Functions), and I have hands-on experience with Big Data technologies like Hadoop, Spark (PySpark/Scala), Hive, Kafka, Sqoop, and Oozie. I specialize in data modeling, query optimization, workflow orchestration, data quality frameworks, and building secure, scalable, and cost-efficient cloud-native architectures.Throughout my career, I have developed high-volume ETL/ELT pipelines, implemented real-time streaming solutions, migrated legacy data warehouses to cloud platforms improving performance by 40% or more, and automated manual workflows to reduce effort and improve reliability. I have also collaborated with cross-functional teams—including data scientists, QA, business analysts, and product managers—to gather requirements, design analytical solutions, and implement machine learning use cases such as customer personalization, demand forecasting, fraud detection, and operational intelligence.I am passionate about mentoring junior engineers, establishing best practices for cloud-native architecture, data governance, and CI/CD, and delivering solutions that ensure high availability, fault tolerance, compliance, and regulatory reporting standards. My experience spans distributed systems, cloud platforms, BI and analytics tools, and I am committed to driving data-driven decision-making through innovative, scalable, and reliable data solutions.

Experience

1. Senior Data Engineer

   Walmart

   Jul 2024 — Present

   I have experience building and maintaining large-scale batch and real-time data pipelines using Python, PySpark, SQL, Kafka, and Spark Streaming to process high-volume data across supply chain, sales, inventory, and customer analytics. I have designed and optimized ETL/ELT workflows for POS systems, e-commerce platforms, vendor feeds, APIs, and IoT data, and led the migration of a legacy data warehouse to Google BigQuery, improving query performance by 40% while reducing infrastructure costs. I work closely with data science, product, and business teams to enable machine learning use cases such as demand forecasting and personalization, while ensuring data quality, security, scalability, and production reliability through cloud-native architectures and best practices.

Education

• SRK Institute of Technology

  Bachelor of Technology - BTech, Electrical, Electronics and Communications Engineering

• Washington University of Science and Technology (WUST)

  Master's degree, Information Technology