Deepthi Reddy
Azure Data Engineer
- Role
- Sr Data Engineer at Datametica Birds
- Location
- Jersey City, NJ, US
- LinkedIn followers
- 500 followers
Experience
Sr Data Engineer
Mar 2024 — Present
Designed and implemented ETL pipelines in Azure Data Factory for seamless cloud and on-prem data integration.Developed Spark SQL scripts in Azure Databricks, optimizing real-time data processing.Automated data ingestion using Azure Logic Apps, enhancing data consistency.Designed Snowflake data models with data warehousing techniques for better management.Managed CI/CD pipelines via Jenkins for streamlined deployments in Azure.Collaborated with DevOps on automated testing and deployment frameworks.Implemented real-time processing with Kafka, Spark Streaming, and Hive.Created Python ETL scripts to optimize data workflows for large datasets.Integrated Azure Functions with APIs for timely data processing.Migrated legacy ETL processes to Azure Synapse Analytics for scalability and cost reduction.Optimized Spark jobs for improved performance and efficiency.Built scalable data pipelines using PySpark and Snowflake for various data formats.
Find verified contacts for anyone on LinkedIn
Unifers gives sales teams verified emails and direct dials, enriched profiles, and outreach that lands in the inbox.
Free plan included · No credit card required
This profile is compiled from publicly available professional sources. Unifers is not affiliated with or endorsed by LinkedIn. Request removal of this profile.