Rohit K.
Senior Data Engineer @CGI
Signup · Get unlimited contacts
WORK HISTORY
Senior Data Engineer @CGI
London, GB
Played a key role in the migration from on-premises to GCP for one of Europe’s largest corporate banks.• Modularized logic and code for various payment systems within the bank to fully leverage GCP’s IaaS capabilities.• Optimized Google BigQuery SQL queries for cost and performance efficiency, enabling seamless data extraction from Google Cloud Storage (GCS) and tables using optimized joins, sub-queries, filters, Common Table Expressions (CTEs), and staging areas.• Designed and implemented a dynamic cluster solution using Google DataProc to run PySpark jobs efficiently, ensuring cost-effectiveness with an automated fallback mechanism and dynamic cluster deletion upon job completion.• Developed and implemented “batch-booking” logic for transactional payments, enabling reconciliation of bulk payments across multiple systems.
EDUCATION
Centre for Development of Advanced Computing (C-DAC)
PG-DIPLOMA, Big Data Analytics
University of Mumbai
Bachelor of Engineering - BE, Computer Engineering
ABOUT ROHIT K.
Rohit is a Senior Data Engineer and part of transformative data migration projects, including the successful transition of a major European corporate bank\'s systems to Google Cloud Platform (GCP). By leveraging tools like PySpark, SQL, Airflow, CI/CD pipelines, Google BigQuery, and DataProc, he has modularized payment systems, optimized query performance, and implemented cost-effective dynamic cluster solutions. With a PG-Diploma in Big Data Analytics and a BE in Computer Engineering, he designs scalable pipelines and reconcile complex systems with precision. Motivated by innovation, he aims to enhance operational efficiency and advance cloud-based solutions for diverse industries, ensuring alignment with business needs and regulatory standards.
This profile is compiled from publicly available professional sources. Unifers is not affiliated with or endorsed by LinkedIn. Request removal of this profile.