Jatin A.

About Jatin A.

Data Engineer with 6+ years of progressive experience in the design, development & implementation of scalable data pipelines using Spark, Python,SQL & Data Engineering Principles. I have worked in Data-Driven Projects and have good understanding of Big Data and AI terminologies.Leetcode : 270+ Solved (https://leetcode.com/u/JatinAdarsh/)Hacker Rank : 5* Star in SQL & 4* Star in Problem Solving TECH STACKPROGRAMMING / SCRIPTING LANGUAGE :* Python / PySpark* Java* Shell ScriptingDATABASE & DWH :* Snowflake* Databricks* AWS Redshift* SQL ( MySQL & PostgreSQL )* NoSQL ( DynamoDB & MongoDB )Orchestration & REPORTING :* Apache Airflow* IBM Cognos AnalyticsRELAVANT SKILLS :* Anthropic\'s Claude 3.5 Sonnet* Langchain LLM* Apache Kafka* Apache NiFi* ETL / ELT Development* Data Modeling* Data Quality* Hadoop HDFS* MapReduce* Version Control System ( GIT, BITBUCKET )Personal Email Address : j•••••••@gmail.com

Experience

1. Senior Data Engineer

   Enquero

   Sep 2022 — Present

   Built high volume Data Pipelines which processes over 10 million records daily using Apache Spark & Airflow DAGs and load data into Snowflake, enabling the creation of business intelligence dashboards and reports for informed decision-making and strategic planning.* Redesigned the legacy process by implementing the Data Certification Framework using PySpark and Dynamic SQL Queries, which enabled stakeholders to monitor data accuracy and saved 40 hours per week* Engineered the automated Data Refresh Framework using Python, which scaled to 15 TB of data and reduced effort by20%.* Contributed in enhancing an Internal tool which can copy/transform data from one system to another system using PySpark Script.* Worked on implementing Generative AI based solutions on different levels of Data Pipeline using AWS Bedrock and Claude 3.5 Sonnet.

Education

• Dr. A.P.J. Abdul Kalam Technical University

  Bachelor of Technology - BTech

  2014 — 2018