Pavithra Unnam
Azure Data Engineer@HCL| Azure Data Factory |Azure Databricks | Python | Delta Lake | CI/CD | PySpark | Prompt Engineering | Unity Catalog | AI enthusiastic | Prompt Engineering
- Role
- Azure Data Engineer at HCLTech
- Location
- Kanchipuram, IN
- LinkedIn followers
- 500 followers
About Pavithra Unnam
Results driven Azure Data Engineer with 3 years of experience in building, optimizing…
Experience
Azure Data Engineer
Nov 2022 — Present · Chennai, IN
As part of my role at HCLTech, I was involved in designing and implementing scalable ETL solutions using Azure Data Factory (ADF), Databricks, PySpark, SQL, and Python to drive efficient data integration, processing, and analytics.Key Contributions & Achievements:• Designed and implemented end-to-end ETL pipelines in ADF and Databricks, transforming and processing 10TB+ of raw data into structured insights within Azure Data Lake Storage Gen2 (ADLS) using the Medallion Architecture (Bronze, Silver, Gold layers).• Architected and developed metadata-driven frameworks for automated and reliable data ingestion.• Configured secure integrations between Databricks notebooks and ADLS Gen2 using Service Principals and Azure Key Vault, ensuring data security and compliance.• Implemented incremental data loading and optimized pipeline performance, reducing processing time and ensuring high data availability.• Scheduled and monitored ADF pipelines and Databricks jobs, minimizing manual intervention through automation.• Managed Azure Data Lake storage performance, ensuring efficient retrieval and transformation.• Handled incident management and change requests via ServiceNow, supporting over users within SLA timelines.• Led monthly QOS reporting and drove continuous process improvements to enhance data reliability and operational efficiency.Regularly communicated with the stakeholders regarding production outages, ensuring transparency and swift issue resolutionThis project strengthened my expertise in data engineering, automation, and cloud-based analytics, reinforcing the importance of well-structured and secure data pipelines in delivering business value.#DataEngineering #Azure #Databricks #ADF #ETL #PySpark #ADLS #AzureKeyVault #HCLTech #DataIntegration #CloudComputing
Find verified contacts for anyone on LinkedIn
Unifers gives sales teams verified emails and direct dials, enriched profiles, and outreach that lands in the inbox.
Free plan included · No credit card required
This profile is compiled from publicly available professional sources. Unifers is not affiliated with or endorsed by LinkedIn. Request removal of this profile.