Find Unlimited Emails.For Free.
Discover prospects, find their business emails, and build your pipeline with Unifers.
Start for FreeJagan Kothapalli
Lead Data Lake Platform Engineer @Whitehaven Coal
Signup · Get unlimited contacts
WORK HISTORY
Lead Data Lake Platform Engineer @Whitehaven Coal
Sydney, AU
As Lead Data Engineer at Whitehaven Coal, I am driving the evolution of the company’s enterprise data platform on Microsoft Fabric, delivering scalable solutions that unlock value from critical operational and financial data.Platform Enhancement: Leading initiatives to enhance and standardize the Fabric-based data platform, focusing on reusability, automation, and governance across ingestion, transformation, and consumption layers.Use Case Delivery: Designing and implementing end-to-end data pipelines for priority business use cases, enabling faster access to insights for decision-makers across operations, finance, and sustainability.Framework Development: Extending pattern-driven onboarding frameworks (developed from past experience) to accelerate integration of new data sources, ensuring consistency and reduced cycle times.Collaboration & Leadership: Engaging with business stakeholders, architects, and analysts to align data solutions with strategic objectives. Providing technical leadership and mentoring to engineering teams.Innovation & Best Practices: Introducing modern data engineering practices using Fabric Notebooks (PySpark/SparkSQL), Lakehouses, Delta patterns, and Power BI to create robust, analytics-ready datasets.Technology Stack: Microsoft Fabric (Lakehouse, Data Pipelines, Synapse Data Engineering, Notebooks), Azure SQL DB, Databricks, Power BI, Git/Azure DevOps, Python/PySpark.This role allows me to combine hands-on engineering with platform leadership, ensuring Whitehaven Coal’s data foundation supports its growth, operational efficiency, and sustainability goals.
EDUCATION
Narayana Engineering College
Bachelor of Engineering (B.E.), Electrical and Electronics Engineering
SKILLS
ABOUT JAGAN KOTHAPALLI
I’m a Senior Data Engineer & Platform Architect with 17+ years of experience designing and delivering data solutions across global enterprises and Fortune 500 organisations. Over the last decade, I’ve specialised in building modern, scalable cloud-based analytics platforms using Microsoft Fabric, Azure, Databricks, and metadata-driven architectures.Across every project, I noticed a recurring pattern: teams spend 70–80% of their time re-building the same ingestion pipelines, schemas, logging patterns, alerting flows, workspace structures, and Lakehouse layers — again and again.So instead of starting from scratch on every new engagement, I decided to solve this problem once.Today, I’m the creator of PODS – a Microsoft Fabric–based accelerator designed to help organizations deploy enterprise-grade data platforms in weeks instead of months.PODS includes:Metadata-driven ingestion & transformationReusable REST API ingestion frameworkAutomated workspace creationUnified Lakehouse medallion architecture (Bronze/Silver/Gold)Logging, lineage, observability (SQL + KQL)Domain-oriented design patternsReady-to-deploy templates, codebase, and documentationMy mission is simple:Build data platforms that scale, reduce repetitive effort, improve governance, and accelerate delivery for any organisation.I share insights on:Microsoft Fabric architectureMetadata-driven platform patternsAPI ingestion frameworksReal-world transformation strategiesHow to build data platforms that don’t collapse under complexityBuilding a reusable accelerator + reusable codebaseIf you’re building a modern data platform, want guidance on Fabric architecture, or want to explore how PODS can help your organization — let’s connect.
This profile is compiled from publicly available professional sources. Unifers is not affiliated with or endorsed by LinkedIn. Request removal of this profile.