Rajnish Singh

About Rajnish Singh

Experienced Data and Design Engineer with 7+ years of expertise in IT Industry. Specialized in building scalable data pipelines and data products using GCP services like BigQuery, Cloud Composer, Dataflow, and Cloud Functions. Successfully migrated 35+ TB of on-premises data to GCP with 99.9% system uptime, driving £250M annual savings. Optimized BigQuery queries, improving performance by 40%, and automated 95% of data processes. Skilled in BigQuery SQL, Airflow, Unix, Python, Terraform, PL/SQL, and GitLab. Adept at collaborating with stakeholders to deliver innovative, end-to-end solutions that streamline cloud migrations and enhance data-driven business decision-making.

Experience

1. Design Engineer Professional

   BT Group

   Mar 2022 — Present · Bengaluru, IN

   Optimized over 100+ complex BigQuery stored procedures, reducing execution times by up to 40%, and built 50+ data products for reporting tools like Data Studio and Qlik Dashboards, enhancing business decision-making.Implemented 50+ scalable data pipelines using Cloud Dataflow, Cloud Functions, and Cloud Composer on Google Cloud Platform (GCP), automating 85% of data ingestion processes.Developed and enhanced 60+ Terraform scripts for provisioning, managing, and maintaining GCP services, accelerating infrastructure deployment by 60%.Led PoC and engineered a Cross-Project Event Orchestration framework, reducing cross-project data processing delays by 50% and adopted by 5+ teams across the Consumer customer facing unit as of now.Designed and implemented a robust data file egress solution from GCP to SharePoint Online (SPO) leveraging SquidProxy VM, Cloud NAT, Firewall Rules, VPC Connector, and Microsoft Graph API, improving data delivery efficiency by 90%.Troubleshot and integrated Workload Identity Federation (WIF) into the existing framework, securing 500+ service accounts and streamlining report submission tracking.Crafted comprehensive HDL/LDL design documentation, enabling business stakeholders to make informed decisions and ensuring 99.9% system uptime during the migration of 8+ critical systems from on-premises to GCP.Synthesized data from 6+ sources, producing insights that optimized business processes, resulting in a £250M annual cost savings for the client’s All IP Product migration team.Migrated 30 Cloud Composer and Cloud Function instances from deprecated versions to the latest supported releases, resolving 100% of dependency and library conflicts.

Education

• Sido Kanhu Murmu University, Dumka

  BACHELOR IN COMPUTER APPLICATION - BCA, Computer Applications

  2015 — 2018

• GD DAV PUBLIC SCHOOL, DEOGHAR

  INTERMEDIATE, MATH

  2013 — 2015

• Adwaita Mission High School

  METRICULATION

  2013

• Jain (Deemed-to-be University)

  Master of Computer Applications - MCA, Data Science