Forum Desai
Senior Data Engineer
- Role
- Senior Consultant at Deloitte
- Location
- Mumbai, MH, IN
- LinkedIn followers
- 500 followers
About Forum Desai
Experienced Data Engineer with a strong focus on attention to detail and a proven track record of achieving results. Over six years of industry experience specializing in designing, building and optimizing scalable data pipelines and architectures in GCP. Expertise extends to ETL processes, data warehousing, and big data technologies. Proficient in SQL, Python and various data processing frameworks including Apache Spark and Hadoop. Skilled at constructing scalable pipelines, automating workflows, and utilizing high-performance Frameworks to enhance data integration and processing capabilities. Good hands-on experience with BigData frameworks (Hadoop, PySpark,Spark, Hive), Databases (MySQL, HiveSQL, Postgress), GCP services (BigQuery, Dataproc, Dataflow, Composer, Compute Engine,Cloud Storage, Logging, Monitoring, Gsutil, GCS, PubSub), Monitoring Tools (Airflow), DevOps tools (Jenkins, GitHub) and for unit testing (JUnit, Mockito). Good Programming hold on Java, Python, SQL, PySpark and also had worked on the Linux environment.
Experience
Senior Consultant
Dec 2021 — Present · Mumbai, IN
Part of the development team with the client HSBC Bank- UK RDMRDM stands for Risk Data Modeling, here we have several petabytes of data stored in data warehouse in a random fashion. Later the data is modeled in such a way that risk models are generated, credit card payment defaulters list and much more insights are developed.Responsibilities: From the Risk data mart the data is fetched, which is more than several petabytes of data. There are several tables generated for modeling purposes. Build with a high performance framework using PySpark, GCP and SQL for processing the data in a defined manner. One such model is the portfolio table which is later used by the users to check the basic credentials for various customers and many more details related to that. Also need to automate the same using airflow.Using this data we need to get the insight for how customer behave over period of time. Various customers background about credit risk. This insights help bank in loans and credit card offerings. Tech Stack - Hive, PySpark,SQL, GCP, BigQuery, Dataproc, VM Instances, Airflow, Cloud Storage
Education
Dwarkadas J. Sanghvi College of Engineering
Electronics Engineering
2014 — 2018
Find verified contacts for anyone on LinkedIn
Unifers gives sales teams verified emails and direct dials, enriched profiles, and outreach that lands in the inbox.
Free plan included · No credit card required
This profile is compiled from publicly available professional sources. Unifers is not affiliated with or endorsed by LinkedIn. Request removal of this profile.