Sandeep Devaiah

About Sandeep Devaiah

An astute go getter,aspiring leader,performing a role of an IC and an excellent team player having widespread working experience on niche technologies like Hadoop, Datawarehousing. Working on large datasets and exposure to converting some of the complex logics on traditional data ware house to run on the hadoop ecosystem.

Experience

1. Engineering Leader

   Linkedin

   Aug 2022 — Present · Bengaluru, IN

   Data Platform Modernization & TransformationSpearheaded LinkedIn\'s data platform modernization, moving hundreds of pipelines to a unified, dbt-based transformation framework (inDBT) on Spark and Hadoop. This significantly improved developer velocity, governance, and standardization.Defined the long-term technical vision for scalable, declarative data authoring, leveraging Airflow for orchestration to build a sustainable foundation for production data workflows.Efficiency, Governance, & Cross-Functional LeadershipDrove company-wide compute and storage efficiency programs, analyzing Spark/Hadoop workloads and implementing optimization that achieved multi-million dollar annual CAPEX savings via compute reduction, compaction, and retention.Partnered across Infra, UMP, CPS, and GGW to establish end-to-end lifecycle governance—from authoring to storage—aligning lineage and retention under a single strategy, including Pinot for real-time analytics.Influenced the design and rollout of next-gen infrastructure (e.g, Nimbus orchestration, Hydrofoil compute), ensuring platform readiness for critical enterprise initiatives using Airflow and Iceberg standards.Adoption, Enablement, & Performance CultureBuilt organizational alignment and adoption at scale, leading migration playbooks and hands-on enablement for 200+ engineers/analysts to successfully adopt dbt, Iceberg, and Airflow as core development standards.Established a performance/observability culture by launching data quality, cost visibility, and efficiency dashboards (leveraging Jupyter Notebooks) that transformed platform governance and usage measurement.Mentored and guided multiple platform teams, shaping architectural decisions, establishing reusable design patterns, and promoting a long-term culture of craftsmanship and innovation.

Education

• Birla Institute of Technology and Science, Pilani

  Master of Technology - MTech

• Visheswaraya Institute of Technology

  Bachelor of Engineering (BE), Engineering

  2003 — 2007

• Pre University St Josephs Arts and Science College

  12th

  2001 — 2003

• High School Presidency School

  10th

Skills

• Hadoop
• Oracle
• Requirements Analysis
• Business Process
• Requirements Gathering
• Analysis
• Business Objects
• Customer Relationship Management (Crm)
• Agile Methodologies
• Project Management
• Teradata
• Program Management
• Microstrategy
• Extract, Transform, Load (Etl)
• Data Warehousing
• Etl
• Crm
• Databases
• Sdlc
• Apache Pig
• Solution Architecture
• Sql
• Microstrategy Reporting
• Testing
• Business Intelligence
• Business Analysis
• Team Management