Soumak Das

About Soumak Das

With 10+ years of experience architecting and deploying enterprise-grade data platforms, I bridge the gap between traditional cloud data warehousing and modern AI engineering.I specialize in designing highly scalable, fault-tolerant Lakehouse architectures across the Azure ecosystem. My focus is on transforming siloed, complex data into \"AI-ready\" assets—ensuring that organizations can seamlessly power both high-concurrency BI dashboards and advanced Large Language Model (LLM) applications.Coming from a heavy consulting and Financial Services background, I understand that pipelines cannot just be fast; they must be bulletproof. When building systems for regulatory reporting (like IFRS17), I treat data engineering like software engineering. I prioritize ACID compliance, automated data lineage, strict CI/CD practices, and end-to-end observability to guarantee zero data loss and complete audibility. What I Do Best: • Enterprise Data Architecture: Designing Lakehouse and Data Warehouse topologies that play to the strengths of both Databricks (heavy engineering/ML) and Snowflake (concurrency/serving). • AI Data Engineering:Building the infrastructure for Retrieval-Augmented Generation (RAG) applications. I design pipelines that extract, chunk, and embed unstructured data (PDFs, claims, logs) into Vector Databases for secure, hallucination-free LLM grounding. • Governance & Security: Implementing centralized data governance, Row/Column-Level Security, and automated lineage using Unity Catalog and MS Purview. • Performance Tuning: Rescuing failing PySpark jobs, eliminating data skew, and right-sizing clusters to drastically reduce Azure cloud spend. Technical Arsenal: • Cloud & Platforms: Azure, Databricks, Snowflake, Microsoft Fabric. • Processing & Frameworks: PySpark, Delta Lake, Apache Spark, dbt, Structured Streaming. • Languages: Python, Advanced SQL. • AI & ML: Azure OpenAI, LangChain, Databricks Vector Search, Feature Stores. • Governance & Orchestration: Unity Catalog, MS Purview, Azure Data Factory (ADF), Airflow.I am passionate about building the engines that make data truly actionable. If you are looking to modernise your data stack, scale your pipelines, or make your enterprise data AI-ready, let\'s connect.

Experience

1. Associate Manager

   EY

   Jan 2026 — Present · Kolkata, IN

Education

• St Joseph's Convent Higher Secondary School

  Secondary Education, Secondary Education

  1998 — 2010

• DAV Public School

  Higher Secondary, Science

  2010 — 2012

• Great Learning

  AI Academy Program

• West Bengal University of Technology, Kolkata

  Bachelor of Technology - BTech, Electronics and Communications Engineering

  2012 — 2016

Skills

• Customer Service
• Training
• Telecommunications
• Powerpoint
• Microsoft Excel
• Rail
• Agile Methodologies
• Good Listener
• Management
• Project Management
• Adobe Photoshop
• Matlab
• Leadership
• Quick Learner
• Pl/Sql
• Microsoft Office
• Sales
• Photoshop
• C++
• Java
• Microsoft Word
• Research
• C