Arihant Jain

About Arihant Jain

Senior Data Engineer | Azure Databricks | ADF | PySpark | SQL | Power BI | Microsoft…

Experience

1. Data Engineer

   Deloitte

   Mar 2022 — Present · Mumbai, IN

   Travelers | Data Engineer• Designed and implemented scalable ETL pipelines utilizing Python and Apache Spark, enhancing data processing efficiency by 30%.• Managed and optimized data warehousing solutions on AWS Redshift, resulting in a 20% reduction in query times.• Developed and maintained robust data quality checks and monitoring systems, ensuring high data accuracy and reliability.• Deployed real-time data processing solutions with Kafka, facilitating near-instantaneous updates for critical applications.Aflac | Data Engineer• Developed SQL test scripts for comprehensive End-to-End Testing, facilitating smooth data transitions between SQL Server and Snowflake, which led to a 40% boost in testing efficiency.• Ensured defect-free performance during two project module go-lives, contributing to a 60% increase in project success rates.• Supported the creation and upkeep of ETL processes for integrating data from various sources into a centralized data warehouse.Bank Of Montreal (BMO)| Data Analyst• Achieved a 50% reduction in deployment times and a 60% decrease in data ingestion times through effective optimization, automation, and code reuse.• Developed and implemented a robust ETL pipeline for migrating 2M+ banking customer records into Salesforce, leveraging Python, AWS services (Glue, S3, AppFlow), and Apache Airflow.• Partnered with cross-functional teams to understand and address a variety of data needs within the organization.• Recognized with the Deloitte SPOT Award for outstanding performance in data engineering projects.