Ajay Vemula

About Ajay Vemula

Azure Data Engineer with 4 years of experience in designing, developing, and optimizing data pipelines and solutions using Azure Data Factory, Databricks, SQL, PySpark and Microsoft Fabric. Proficient in data modelling, automation, and pipeline optimization. Skilled in implementing secure data solutions with Azure Key Vault and managing deployments via Azure DevOps.

Experience

1. System Engineer- Azure Data Engineer

   Tata Consultancy Services

   Mar 2024 — Present · Hyderabad, IN

   Implemented efficient data pipelines in Azure Data Factory to ingest data from 5 sources, incorporating triggers for seamless automation. • Developed Delta tables in Unity Catalogue using the Medallion Architecture to enhance data quality, scalability, and governance. • Processed structured data formats such as Parquet and CSV, as well as semi-structured data such as JSON format, ensuring efficient transformation. • Built 30+ production-ready pipelines with Azure Data Factory and Databricks, cutting processing time by 30% and improving reliability by 25%. • Created comprehensive handover documentation and conducted detailed knowledge transfer sessions to ensure a seamless support transition process. • Incorporated failure and success notifications for Azure Data Factory pipelines to ensure effective monitoring and timely notifications. • Automated data quality assurance workflows across projects, achieving a 99% accuracy rate and reducing manual interventions by 90%. • Deployed ADF pipelines to test and production environments using Azure DevOps in 10 minutes, improving version control and team collaboration. • Enhanced overall data security and ensured strict compliance with regulatory standards by integrating Azure Key Vault into critical data pipelines.

Education

• Chaitanya Deemed to be University

  Master of Science - MS, Computer Science

• Chaitanya Deemed to be University

  Bachelor of Science, Mathematics and Computer Science