Jayanth G.

About Jayanth G.

I’m a results-driven Data Engineer with over 10 years of experience designing and…

Experience

1. Senior Data Engineer

   JPMorganChase

   Jan 2023 — Present · Chicago, IL, US

   As a Senior Data Engineer, I architected and delivered scalable cloud-native data solutions by building an enterprise-grade Data Lake on AWS, enabling real-time and batch data processing at scale. I led the development of automated data pipelines and integrated Databricks, DBT, and Snowflake to support analytics, reporting, and ML use cases across the enterprise. Enterprise Data Lake Architecture: Designed and implemented a centralized AWS-based Data Lake supporting over 15TB+ of structured and unstructured data, streamlining analytics for multiple business units. Modern ETL/ELT Development: Built and maintained 25+ ETL/ELT pipelines using AWS Glue, PySpark, and DBT—reducing data ingestion time by 40% and enabling near real-time insights for analytics teams. Databricks Integration: Leveraged Databricks and Apache Spark for high-performance data processing, resulting in 2x faster pipeline execution and improved data reliability across complex workflows. Real-Time Data Streaming: Developed real-time data pipelines using AWS Kinesis, Firehose, and Lambda to ingest and analyze streaming data with sub-minute latency, powering time-sensitive dashboards and alerts. Snowflake Optimization: Tuned Snowflake workloads using clustering keys, micro-partition pruning, and materialized views—achieving 40% faster query execution and reducing compute costs by 30%. Data Quality & Automation: Automated schema discovery and transformations using AWS Glue Crawlers and DataBrew, decreasing manual intervention by 60% and improving overall data quality. Workflow Orchestration: Scheduled and monitored data pipelines with Apache Airflow and Azure Data Factory (ADF), improving job reliability and reducing pipeline failures by 35%. Cross-Functional Collaboration: Partnered with engineering, analytics, and data science teams to deliver ML-ready datasets, enabling faster model training and deployment across key business initiatives.

Education

• Jawaharlal Nehru Technological University

  Bachelor's degree