Deekshitha Yandapally
Sr. Data Engineer | ETL & ELT | Data Pipelines | Python | PL/SQL | Databricks | Spark | Kafka | Hadoop | Data Analyst | PowerBI.
- Role
- Senior Data Engineer at eBay
- Location
- New York, NY, US
- LinkedIn followers
- 500 followers
About Deekshitha Yandapally
Contact:+15•••••••93 Email: d••••••••@gmail.com A seasoned…
Experience
Senior Data Engineer
Aug 2023 — Present · US
Developed comprehensive cost optimization strategy for Azure cloud resources, implementing automated scaling solutions for Azure Databricks clusters and Azure Synapse SQL pools, reducing monthly cloud spending by 35% while maintaining performance.• Created automated documentation framework using Python and Azure Functions to maintain data lineage across Azure Data Factory pipelines and Azure Synapse Analytics procedures, reducing documentation effort by 40 hours monthly.• Implemented real-time data masking and row-level security in Azure SQL Database and Azure Synapse Analytics, utilizing custom Python scripts for security auditing and compliance reporting, ensuring GDPR compliance across all data platforms.• Designed and implemented incremental loading patterns using Azure Data Factory and Mapping Data Flows, optimizing data ingestion from multiple source systems into Azure Data Lake Storage Gen2, reducing daily processing window by 60%.• Led implementation of machine learning operations pipeline using Azure Databricks and MLflow, integrating with Azure Data Factory orchestration and Azure Synapse Analytics for model deployment, enabling automated retraining and scoring for predictive maintenance models.
Education
JNTUH College of Engineering Hyderabad
Bachelor's degree, Computer Science
Find verified contacts for anyone on LinkedIn
Unifers gives sales teams verified emails and direct dials, enriched profiles, and outreach that lands in the inbox.
Free plan included · No credit card required
This profile is compiled from publicly available professional sources. Unifers is not affiliated with or endorsed by LinkedIn. Request removal of this profile.