Shivanjali
Data Engineer | AWS, Snowflake, DataBricks | Data Pipelines, ETL, Data Lakes, Airflow, DBT
- Role
- Data Engineer at NYU Langone Health
- Location
- Arlington, TX, US
- LinkedIn followers
- 500 followers
About Shivanjali
Detail-oriented Data Engineer with almost 3 years of experience designing and optimizing…
Experience
Data Engineer
Sep 2024 — Present · NY, US
Built and ran batch and streaming pipelines on AWS (S3, Glue, Lambda, Redshift, Kinesis) with Databricks and dbt,delivering datasets for healthcare reporting and machine learning. Operated ~15 Apache Airflow DAGs with retries and alerts, maintaining on-time pipeline SLA at 98–99%. Implemented dbt tests (unique, not null, schema) on core models, raising validation pass rates to 97–98%. Optimized Redshift queries and table design, improving common report query times from 12 minutes to 6 minutes. Assisted in setting up Kinesis streams for operational dashboards, achieving ~5-minute event-to-dashboard latency. Supported PHI governance (KMS encryption, column masking, access reviews, CloudTrail) and documented datasets in AWSGlue Data Catalog, improving discovery and ownership. Collaborated with clinicians, analysts, and data scientists to align datasets with reporting and ML requirements, ensuringthe pipelines met business needs.
Education
JNTUH College of Engineering Hyderabad
Bachelor of Technology - BTech
2018 — 2022
Southern Arkansas University
Master's degree
2023 — 2024
Find verified contacts for anyone on LinkedIn
Unifers gives sales teams verified emails and direct dials, enriched profiles, and outreach that lands in the inbox.
Free plan included · No credit card required
This profile is compiled from publicly available professional sources. Unifers is not affiliated with or endorsed by LinkedIn. Request removal of this profile.