Somasekar M.

About Somasekar M.

Lead Data Engineer/Architect with over a decade of experience designing and delivering scalable, resilient, and future-ready data platforms across banking, finance, retail, and commercial domains. I specialize in building high-performance data pipelines and modern cloud-native architectures on AWS, GCP and Databricks enabling both real-time streaming and advanced analytics workloads.Skilled in Medallion Architecture and Data Lakehouse patterns, creating unified, high-quality, and governed data ecosystems that drive actionable insights and support advanced analytics initiatives. Currently, I am experimenting with Generative AI (GenAI) and Large Language Models (LLMs) to explore data preparation, embedding pipelines, retrieval-augmented generation (RAG), and AI-assisted insights within modern data platforms.My expertise spans Apache Spark (Scala, PySpark, Spark SQL), Kafka, Hive, Snowflake, DynamoDB, and orchestration tools like Airflow/MWAA and Control-M. I am passionate about simplifying complex data ecosystems, improving reliability, and unlocking business value through automation, Spark/Databricks pipelines, and AI-driven engineering practices.Proven track record of leading teams end-to-end, from data strategy and architecture to production deployment, always prioritizing scalability, resilience, and operational excellence while enabling organizations to leverage their data to drive advanced analytics and smarter decision-making.

Experience

1. VP - Data Architect Sr Software Engineer (Data)

   高盛

   Jan 2025 — Present · Dallas-Fort Worth, TX, US

Education

• Sri Venkateswara University

  Master of Computer Applications (M.C.A.), Computer Programming, Specific Applications

  2004 — 2007