Surya R.

About Surya R.

Senior Data Engineer with 6+ years of experience designing and delivering scalable cloud data platforms using Snowflake, BigQuery, Azure Data Factory (ADF), dbt Cloud/Core, Airflow, Fivetran, Python, SQL, and ADLS across healthcare, marketing, and enterprise domains. Skilled in end-to-end ELT automation, advanced data modeling, and query optimization, driving 90%+ operational efficiency gains, 50% performance improvements, and 30–40% warehouse cost savings. Proven expertise in building HIPAA-compliant, enterprise-grade data pipelines with strong governance, data quality, and lineage. Experienced with PySpark, Databricks, Delta Lake, and self-service BI tools in Agile, Git-driven environments, enabling reliable, analytics-ready data delivery for business-critical use cases.

Experience

1. Data Engineer Ii - Dbt

   Centene Corporation

   Aug 2025 — Present · US

   Built and orchestrated end-to-end ELT pipelines using Fivetran, Airflow, and DBT on Snowflake, improving overall data processing efficiency by 30%-Integrated AWS S3 with Snowflake using Snowpipe auto-ingest to ingest both structured and unstructured data (JSON, CSV, XML, PDFs, and logs), enabling near–real-time ingestion and reducing source-to-warehouse latency from hours to minutes-Implemented Snowflake Streams on Snowpipe-ingested tables to capture CDC from S3 files and drive incremental DBT models, reducing data refresh time and warehouse compute costs by 40%-Designed Snowflake pipelines leveraging VARIANT columns and schema-on-read to parse and transform unstructured and semi-structured healthcare data into analytics-ready models-Developed reusable Jinja macros and SQL templates, reducing repetitive transformation logic by 40% and enforcing model consistency across teams-Optimized Snowflake data warehouse layers (staging, intermediate, analytics), cutting query runtimes by 25% and improving downstream analytics performance-Built optimized healthcare analytics models (claims and prior authorization) to track approvals, denials, and turnaround times while ensuring HIPAA and regulatory compliance-Created data mapping and data dictionary documentation, improving data traceability and reducing onboarding time by 35%-Automated workflow orchestration and CI/CD pipelines using Airflow, Python, and GitLab, enabling 100% automated and reliable deployments-Implemented DBT tests and Airflow monitoring, achieving 99% data quality compliance across production datasets.

Education

• Jawaharlal Nehru Technological University Kakinada (JNTUK)

  Bachelor's degree

  2015 — 2019

• Campbellsville University

  Master's degree, Information Technology

• University of Leicester

  Data analyst for business intelligence,UK, Data science