Abhijit Joshi

About Abhijit Joshi

Accomplished Data Engineering Lead with over 15 years of professional experience, specializing in data engineering and infrastructure management. Proven record in leading cross-functional teams and executing strategic technological initiatives. Expert in modern data tools, and cloud platforms including AWS, GCP, Databricks, SQL, Terraform, MLOps, and CI/CD methodologies.Technical: Python, Java, SQL, Docker, Kubernetes, Apache Airflow, Google Cloud Composer, Unix, Google BigQuery, Terraform, Databricks, DBT, MLOps, CI/CD, Advanced Unix/Linux Shell Scripting, GitHub, Kafka, Delta Lakehouse.Leadership: Strategic planning, team leadership, project management, cross-functional collaboration, technical mentorship.Architectural: System design, data modeling, cloud and network architecture, platform management, API design and management.

Experience

1. Staff Data Engineer - Cloud Data & Infrastructure

   Oportun

   Aug 2021 — Present · San Francisco, CA, US

   Managed and architected solutions on Databricks, Airflow, DBT, and AWS, optimizing platforms and code to achieve significant cost savings:$100K monthly on Databricks and $30K monthly on AWS costs related to Databricks services, resulted in 50% savings.Leveraged Terraform for efficient infrastructure management and automation.Guided cross-functional teams in data and infrastructure initiatives.Adopted MLOps and CI/CD methodologies for effective project delivery.Created, deployed, and decommissioned secure, scalable cloud instances using IaaS concepts in a DevOps environment. Practiced test-driven development with CI/CD processes, resulting in robust, scalable systems and rapid cloud infrastructure provisioning with notable cost reductions.

Education

• Walchand College of Engineering(A Govt. Aided Autonomous Institute),SANGLI-M.S

  Bachelor's degree, IT, Computers

Skills

• Jcl
• Ibm Mainframe
• Mainframe
• Db2
• Media & Entertainment
• Informatica Mdm Hub
• Unix
• Informatica
• Unix Shell Scripting
• Cics Webservices
• Informatica Powercenter 9.5.1
• Teradata Sql
• Requirements Gathering
• Job Control Language (Jcl)
• Teradata Data Warehouse
• Z/Os
• Sql
• Team Foundation Server (Tfs)
• Requirements Analysis
• Microsoft Sql Server
• Udb Db2
• Shell Scripting
• Hive
• Cobol
• Web Services
• C
• Hadoop
• Sdlc
• Cics
• Ibm Db2
• Java