Harsha Gowtham

Senior Data Engineer @California Energy Commission

Los Angeles, CA, US

Leading data engineering initiatives for the California Energy Commission, focusing on the integration and analysis of large-scale energy data using a sophisticated tech stack that includes dbt, Snowflake, AWS S3, SQL, and Python.Expertise in handling and querying meter interval tables with billions of records, leveraging advanced SQL techniques to extract actionable insights.Spearheading the implementation of Data Vault modeling within our EDW 2.0 pipeline to enhance data storage and retrieval processes, ensuring scalability and robustness.Utilizing Snow pipe for efficient data ingestion, facilitating real-time analysis and reporting across multiple pipelines.Collaboratively working with stakeholders to manage and analyze energy consumption data, including metered consumption and gas data, from six major utilities across California, aiding in statewide energy management and policy-making.Managing the intake and processing of quarterly data submissions from utilities across California, dealing with voluminous datasets ranging from terabytes to petabytes in Snowflake, enabling precise energy forecasting and strategic decision-making.