Pramod Reddy Battu

Data Engineer @Burlington Stores, Inc.

McKinney, TX, US

As a Data Engineer at Burlington, I play a key role in designing and maintaining scalable, cloud-native data pipelines that power analytics, reporting, and operational insights across merchandising, logistics, and finance. I work extensively with Azure Data Factory, PySpark, Databricks, and Snowflake, ensuring that large volumes of retail and transactional data are ingested, processed, and made analytics-ready for business decision-making.My responsibilities include developing end-to-end ETL workflows that integrate data from diverse sources such as SQL Server, DB2, SharePoint, GCS Buckets, and Azure Data Lake. I optimize workflows by leveraging AWS and Azure services including S3, Glue, Redshift, Lambda, and Kubernetes, while implementing real-time streaming data pipelines using Kafka and Spark Streaming. This enables the business to gain near real-time insights into sales, inventory, and customer behavior.To ensure data reliability and compliance, I’ve built validation frameworks in Python and integrated secure credential management via Azure Key Vault and AWS Secrets Manager. I also work on automation and CI/CD, deploying reusable pipeline templates and DevOps workflows with Azure DevOps, Jenkins, and GitLab, which significantly reduce deployment errors and speed up delivery cycles.Collaboration is central to my role—I partner with BI teams to optimize Power BI models and reduce refresh times, making dashboards faster and more actionable. I also engage in Agile ceremonies, code reviews, and cross-team knowledge sharing to maintain engineering excellence.Through this role, I’ve deepened my expertise in cloud platforms (AWS, Azure, GCP), big data tools (Hadoop, Hive, Kafka, Spark, Cassandra), and modern data architectures including data lakes and data lakehouses, positioning me to build scalable, future-ready solutions that align with Burlington’s growth strategy.

Bankatlal Badruka College of Information Technology

Statistics

University of North Texas

Master's degree, Data Science