Diptarka Dutta

Experience

1. Senior

   EY

   Nov 2022 — Present · Kolkata, IN

   Member of the AI and Data team, specializing in developing and deploying innovative solutions by integrating AI and data engineering principles.AI Engineering Expertise-Generative AI Systems: Designed and implemented systems leveraging large language models (LLMs) with frameworks like RAG, enhancing performance through PEFT techniques-Applications: Developed advanced solutions such as chatbots and fine-tuned models for diverse use cases, delivering enhanced AI capabilities tailored to client needs.Data Engineering Expertise-Led a team to process and transform diverse data formats (CSV, JSON, Oracle DB) into Parquet using Azure Data Factory (ADF) pipelines, orchestrating key modules for Data Ingestion (DI), Data Quality (DQ), and Data Harmonization (DH)-Created a Data Quality (DQ) module in Azure Databricks (ADB), implementing validation, profiling, and cleansing processes, which reduced execution time by 33.3% for subsequent data modules-Optimized PySpark jobs for processing complex JSON data on Dataproc and loaded data into BigQuery, improving job performance and efficiency. Also, streamlined job orchestration using Cloud Composer for smooth workflows.SectorsInsurance, Real estate, Oil and Gas, Banking

Education

• Kalinga Institute of Industrial Technology, Bhubaneswar

  Bachelor of Technology, Electrical, Electronics and Communications Engineering

  2015 — 2019

• Ramakrishna Mission Vivekananda Vidyamandir Malda

  Higher Secondary, Sciencce

  2013 — 2015