Divya Jyothi P.
Senior Data Engineer | AWS | Azure | PySpark | Snowflake| StreamSets | |Airflow | | Data Lakes | Tableau | Power BI | Data Pipelines | H1B Transfer Open
- Role
- Senior Data Engineer at Boston Scientific
- Location
- Urbana, IL, US
- LinkedIn followers
- 500 followers
About Divya Jyothi P.
Hello,I am a Sr.Data Engineer with 8+ years of experience building scalable cloud data platforms, automated ETL/ELT pipelines, and analytics solutions that enable faster and smarter decision-making. I work across the full data lifecycle—ingestion, transformation, modeling, orchestration, and analytics—spanning healthcare, insurance, and technology domains.I specialize in architecting cloud-native pipelines using StreamSets, AWS Glue, PySpark, and Python, and designing modern data architectures on AWS (S3, Athena, RDS, Glue, Lambda) and Snowflake. My work includes optimizing data models, enabling real-time and batch processing, and improving pipeline performance, reliability, and cost efficiency.Along with engineering expertise, I have strong experience in predictive analytics, statistical modeling, and business intelligence using Tableau, Power BI, and Python,allowing me to bridge both engineering and analytical needs.Across roles as Data Engineer, Cloud ETL Developer, and Data & ML Analyst, I’ve built high-impact solutions, improved pipeline performance, reduced operational bottlenecks, and delivered insights that support business strategy.I’m passionate about cloud platforms, automation, large-scale data processing, and modern data engineering practices that power next-generation analytics.
Experience
Senior Data Engineer
Feb 2024 — Present · MA, US
Predictive Analytics & Cloud Data Platforms)Architecting enterprise-grade StreamSets pipelines to ingest S3/Athena data into RDS, meeting medical analytics compliance.Optimized Glue + PySpark ETL for multi-TB datasets in Snowflake, improving pipeline performance by 35%.Designed S3 data lake layers (raw → curated → transformed) supporting both batch & near real-time ingestion.Built analytical data marts using star/snowflake schema to accelerate reporting by 30%.Implemented incremental loads, partitioning, and validation frameworks reducing reprocessing by 25%.Developed end-to-end PySpark/Python transformation logic for cleansing, aggregations & business rule logic.Automated ETL orchestration using AWS Lambda + Step Functions, improving reliability and consistency.Built Tableau dashboards for pipeline observability, data freshness, and operational KPIs.Wrote optimized SQL, stored procedures & views for Snowflake and PostgreSQL workloads.Provided 24/7 stability for Azure Data Factory pipelines through proactive monitoring and fast RCA.Reduced incident resolution time by 35% using enhanced logging and alerting practices.Managed ServiceNow workflows end-to-end, maintaining 95%+ SLA compliance.Authored technical documentation, SOPs, and runbooks improving support efficiency across teams.
Education
Eastern Illinois University
Master of Computer technology
Find verified contacts for anyone on LinkedIn
Unifers gives sales teams verified emails and direct dials, enriched profiles, and outreach that lands in the inbox.
Free plan included · No credit card required
This profile is compiled from publicly available professional sources. Unifers is not affiliated with or endorsed by LinkedIn. Request removal of this profile.