Venkat S

About Venkat S

With 6 years of experience as a Data Engineer, I specialize in building scalable, cloud-native data platforms and end-to-end data pipelines that enable organizations to extract actionable insights from complex datasets. I have strong experience in Databricks, Terraform, and Snowflake, with a track record of designing and optimizing ELT workflows, managing CI/CD pipelines, and integrating structured and streaming data across AWS and Azure environments.I have worked extensively with Databricks clusters, automating infrastructure using Terraform and deploying data workflows through GitHub Actions and Azure DevOps. My background includes integrating real-time data from Kafka and AWS Kinesis, and managing data lakes and warehouses using Redshift, Snowflake, and Azure Synapse.I prioritize building secure and reliable data solutions that align with compliance frameworks such as NIST and HIPAA. I work closely with BI, security, and data science teams to enable governed, self-service analytics and operational efficiency across data platforms.I am passionate about delivering robust, cost-effective, and maintainable data infrastructure. I continuously stay up to date with emerging technologies to help organizations get the most value from their data.

Experience

1. Data Engineer

   Gordon Food Service

   Mar 2024 — Present · US

   At Gordon Food Services, I l design and development of scalable data pipelines and cloud-native data platforms across AWS and Azure. My primary focus is building robust ETL and ELT workflows using Databricks and Python to process structured, semi-structured, and real-time data from various sources including APIs, cloud storage, and streaming platforms like Kafka and AWS Kinesis.I manage and optimize Databricks clusters, implementing auto-scaling and performance tuning strategies to ensure cost-effective, high-performance processing. I also maintain CI/CD pipelines using Terraform and Azure DevOps to automate infrastructure provisioning and deployment of data workflows. These efforts support integrations with Snowflake and Redshift, enabling high-quality analytics and reporting.In addition to engineering, I work closely with BI, data science, and security teams to ensure data quality, governance, and compliance with standards such as NIST. I’ve built validation frameworks, automated monitoring and alerting, and contributed to secure access control configurations across the data platform. My goal is to deliver a secure, scalable, and well-documented environment that empowers the organization to make data-driven decisions efficiently.

Education

• Sacred Heart University

  Master's degree, Information Technology