Rohan Bitukunti
Data Engineer @Taylor Farms
Signup · Get unlimited contacts
WORK HISTORY
Data Engineer @Taylor Farms
Seattle, WA, US
Currently working on a migration project from Azure Synapse to Databricks, focusing on data migration, process redesign, and optimization to ensure a seamless transition and improved efficiency.• Developed a data warehouse solution on Databricks using Azure cloud services by consolidating multiple data sources, including real-time streaming data, establishing a foundation for the data & AI strategy roadmap.• Leveraged Azure EventHub to continuously ingest streaming data for real-time processing, reducing load times by 90%, and maintained a bronze catalog to store raw event data, ensuring data integrity and consistency.• Implemented data transformation logic to perform DML operations using change tracking columns and configured a continuous DLT pipeline to automate data processing and synchronization between bronze and silver catalogs.• Developed and scheduled a job to run every 5 minutes using Apache Spark and SQL to convert two traditional stored procedures into Databricks (DBX) format, automating the export of processed data in CSV format to Digital Spaces.• Implemented real-time replication of change tracking data to Azure SQL Server through SSIS pipelines, ensuring continuous synchronization at 5-minute intervals for up-to-date information.• Developed an Azure Logic App pipeline to conduct data validation between source and destination tables, facilitating automated email notifications for any identified discrepancies.• Designed an automated system (CI/CD pipeline) using GitHub Actions to manage Azure SQL Server across development, testing, and production stages.• Conducted data validation checks and monitoring to maintain high data quality throughout the replication process.• Collaborated closely with business stakeholders in a Scrum environment, identifying business needs to shape functional requirements and drive data solutions that align with business goals.
EDUCATION
University of Missouri-Kansas City
Master of Science - MS, Computer Science
BV Raju Institute of Technology (BVRIT)
Bachelor of Technology, Information Technology
ABOUT ROHAN BITUKUNTI
I am a Data Engineer with hands-on experience designing and operating real-time…
This profile is compiled from publicly available professional sources. Unifers is not affiliated with or endorsed by LinkedIn. Request removal of this profile.