Vamshi J

About Vamshi J

Senior Data Engineer specializing in enterprise-scale Azure and AWS data platforms.Available for contract engagements across the US.Experienced in high-volume banking, insurance, and healthcare data systems.My core focus is building reliable, production-grade data systems using:• Azure (Databricks, ADF, Synapse, ADLS)• AWS (S3, EMR, Glue, Lambda)• Apache Spark (PySpark / Scala), Structured Streaming• Snowflake & modern Lakehouse architectures• Delta Lake & Medallion Architecture• Kafka-based real-time streaming pipelines• CDC-driven Incremental ELT design• Data Modeling (Star Schema, SCD Type 1 & 2)• Terraform & Infrastructure as Code• CI/CD automation and performance tuningDelivered data platforms processing hundreds of millions of records daily within regulated banking and healthcare environments.At Citizens Bank, I support enterprise fraud detection and regulatory analytics pipelines. Previously at Pfizer, I built large-scale clinical and research data processing systems in a compliance-driven healthcare environment.I specialize in rapid onboarding into enterprise architectures, performance optimization, cost-efficient cloud scaling, and building ML-ready datasets that power analytics and predictive modeling initiatives. Open to C2C and 1099 contract engagements Available for immediate start or short transitionIf you\'re hiring a Senior Data Engineer who can quickly integrate into enterprise environments and deliver scalable, cloud-native data platforms — I’m open to connecting.

Experience

1. Senior Big Data Engineer (Enterprise Banking Fraud & Risk Analytics)

   Citizens

   Mar 2023 — Present · Johnston, RI, US

   Architected scalable ELT pipelines using Azure Databricks (PySpark), Azure Data Factory, and ADLS Gen2, integrating 25+ upstream banking systems (Loans, Payments, AML, Cards) into Delta Lake curated layers, reducing month-end regulatory reporting runtime by 30% through incremental CDC and partition optimization.Designed and maintained enterprise reports using Crystal Reports, developing pixel-perfect layouts with complex SQL queries, parameters, and formatted outputs for business reportingBuilt and executed ad-hoc and scheduled reports in Jaspersoft, enabling report distribution, export (PDF/Excel), and automated delivery across business unitsDesigned Azure-based data platform architecture leveraging Databricks, ADLS Gen2, Azure Data Factory, and Synapse Analytics to standardize ingestion and transformation across 25+ banking source systems, enabling consistent data pipelines for risk and regulatory reporting workloads.Implemented Delta Live Tables (DLT) and Databricks Workflows to orchestrate production pipelines, improving reliability to 99%+ job success rate while enforcing centralized governance through Unity Catalog access policies and compliance controls.Worked with Snowflake data warehouse, designing and optimizing SQL transformations and managing curated datasets for enterprise analytics and reportingIntegrated curated datasets into Azure Synapse Analytics and conducted a Microsoft Fabric Lakehouse POC, enabling Power BI semantic models and reducing analytics dashboard latency by 28% for finance and risk teams.Published dataset metadata and lineage into Microsoft Purview, strengthening data governance and audit traceability while improving regulatory validation accuracy by 25%.Developed streaming ingestion pipelines using Azure Event Hubs (Kafka-compatible) with Spark Structured Streaming, improving fraud detection data freshness by 32% for near-real-time.

Education

• JB Institute of Technology (JBIT)

  Bachelor of Technology - BTech, Computer Science