Amruthasai Prathipati
Senior Data Engineer
- Role
- Senior Azure Data Engineer at JPMorganChase
- Location
- Columbus, OH, US
- LinkedIn followers
- 500 followers
About Amruthasai Prathipati
9+ years of extensive IT experience in designing and implementing data solutions as an…
Experience
Senior Azure Data Engineer
Apr 2024 — Present · Columbus, OH, US
Designed and developed scalable PySpark ETL pipelines in Azure Databricks, integrating complex data transformations and large-scale processing for on-prem to cloud data migration.Automated and orchestrated pipelines using Azure Data Factory (ADF), integrating on-prem SQL Server data with ADLS and Azure Synapse, leveraging triggers and Logic Apps for scheduling.Implemented Delta Lake architecture with ACID transactions, schema evolution, partitioning, Z-ordering, and data compaction to optimize performance and storage.Built secure and reusable data models in Azure Synapse and created Databricks authorized views to enforce row-level security and controlled data access.Optimized performance across Databricks clusters, fine-tuning joins, filters, and aggregations to reduce pipeline latency and ensure high throughput for analytical workloads.Integrated Azure Event Hubs and Spark Streaming for near real-time ingestion and processing of structured and semi-structured data (Avro, Parquet) with schema evolution.Automated CI/CD deployment pipelines with Azure DevOps and Terraform, enabling Infrastructure-as-Code (IaC) provisioning for consistent, reproducible Azure environments.Delivered high-availability analytical solutions using Synapse dedicated SQL pools and HDInsight Hive-based transformations, ensuring zero data loss during historical data migration.
Education
University of South Florida
Master's degree, Business Analytics & Information Systems
International Institute of Information Technology Hyderabad (IIITH)
Bachelor of Technology - BTech, Metallurgical Engineering
Find verified contacts for anyone on LinkedIn
Unifers gives sales teams verified emails and direct dials, enriched profiles, and outreach that lands in the inbox.
Free plan included · No credit card required
This profile is compiled from publicly available professional sources. Unifers is not affiliated with or endorsed by LinkedIn. Request removal of this profile.