Sonali Sahoo
Databricks Data Engineer
- Role
- Data Engineer at EPAM Systems
- Location
- Hyderabad, TG, IN
- LinkedIn followers
- 500 followers
Experience
Data Engineer
Apr 2022 — Present · Hyderabad, IN
Designed and developed scalable data pipelines using PySpark in Databricks to process and transform healthcare RWD.• Migrated ETL logic from Snowflake (procedures and views) to Databricks notebooks with optimized performance.• Utilized Amazon S3 for staging and storing raw, intermediate, and final transformed data in Parquet format.• Scheduled and orchestrated data jobs using Apache Airflow, ensuring reliability and monitoring of pipeline executions.• Collaborated with QA and support teams to perform production deployments, monitor job health, and troubleshoot issues as needed.• Contributed to modularizing the pipeline for different healthcare data modules to increase maintainability and scalability.• Participated in production support, identifying and resolving issues during and post-deployment in a timely manner.
Education
Vivekananda Shiksha Kendra
HSc
Ramadevi Women's University
Science
Find verified contacts for anyone on LinkedIn
Unifers gives sales teams verified emails and direct dials, enriched profiles, and outreach that lands in the inbox.
Free plan included · No credit card required
This profile is compiled from publicly available professional sources. Unifers is not affiliated with or endorsed by LinkedIn. Request removal of this profile.