Nihas N M

About Nihas N M

Lead Data Engineer with 11.5 years of experience in designing and managing large-scale data platforms across on-premise and cloud ecosystems. I specialize in Databricks, Apache Spark, Delta Lake, Hadoop, Hive, and AWS (S3, Lambda, Glue, Airflow), with hands-on expertise in Python, PySpark, Scala, and automation frameworks.I hold multiple certifications — Databricks Generative AI Associate, Data Engineer Professional & Associate, and AWS Developer Associate — showcasing my ability to bridge data engineering with cloud and AI-driven solutions.Over the years, I have- Delivered 40% cost optimization through AWS-native solutions- Improved pipeline performance by 30%–50% with PySpark redesigns and automation- Reduced reconciliation effort by 50% using a Scala-Spark QA automation tool.I thrive in leading teams, mentoring engineers, and driving Agile delivery, with a passion for building AI-ready, scalable, and secure data ecosystems that enable smarter business decisions.Always open to connecting with professionals in data engineering, AI, and cloud transformation.

Experience

1. Data Engineer Associate Manager

   Accenture

   Jun 2025 — Present

   Architect, design, and optimize scalable data pipelines and ETL workflows using Apache Spark, Databricks, and Delta Lake, ensuring high performance and reliability.• Delivered 40% cost savings by building cloud-native AWS solutions (S3, Airflow, Lambda) with performance-driven design and resource optimization.• Implemented robust data governance, quality checks, and validation frameworks, improving accuracy, consistency, and trust in enterprise data pipelines.• Automated data workflows and CI/CD pipelines, accelerating deployment cycles and reducing manual effort significantly.• Enforced security, compliance, and best practices in handling sensitive enterprise and regulatory data.• Mentored and coached junior engineers, driving code quality through technical design reviews, documentation, and best practice adoption.• Developed Python-based frameworks and automation scripts for ingestion, validation, monitoring, and alerting, improving operational efficiency and reducing failure recovery time.

Education

• Sathyabama Institute of Science & Technology, Chennai

  Master of Computer Applications - MCA, Computer Science

  2010 — 2013

• Hindusthan College Of Arts And Science

  Bachelor of Science - BS, Computer Science