Rahul Majumder

About Rahul Majumder

I am a passionate Data Engineer with over 4 years of experience designing, building, and supporting data solutions that transform raw information into actionable business insights. I have delivered end-to-end data engineering projects for global clients, working extensively on Azure, AWS, Databricks, PySpark, Spark Core, Power BI, and SQL.Currently, I work as a Senior Systems Engineer at Infosys, where I develop scalable data pipelines, real-time analytics platforms, and business intelligence dashboards. My expertise includes architecting ETL workflows, ensuring data reliability, and implementing robust cloud solutions that empower organizations to make data-driven decisions.I am certified as a Databricks Data Engineer Associate, Azure and AWS Cloud Data Associate, and have hands-on experience with event-driven data ingestion, DevOps practices (CI/CD), and agile methodologies. I enjoy collaborating with cross-functional teams and stakeholders to solve complex data challenges and optimize data flows for performance and security.My goal is to continue expanding my expertise in advanced data engineering and cloud analytics while delivering tangible business value. I am always open to new learning opportunities, innovative projects, and professional connections within the data community.Key Skills:Data Engineering, ETL, Data PipelinesAzure Databricks, AWS, Azure Data FactoryPySpark, Spark Core, Python, SQLPower BI, Business IntelligenceData Architecture, Cloud ServicesCI/CD, GitHub, Agile, Incident ManagementLet’s connect if you’re interested in discussing data solutions, business analytics, or technology trends!

Experience

1. Senior System Engineer

   Infosys

   Feb 2022 — Present

   Core Competencies: Azure Databricks, PySpark, Azure Data Factory (ADF), SQL, Python, Power BI, CI/CD, Agile, AWS, ETL Development, Data Architecture, ServiceNow.Enterprise BI Data Onboarding Platform • Designed and implemented scalable ETL/ELT pipelines using Azure Databricks, PySpark, SQL, and Azure Data Factory (ADF) to onboard global shipment and master data, processing 2+ TB of data daily. • Built and optimized Power BI dashboards for 50+ business and executive stakeholders, enabling real-time sales performance and market trend analysis and reducing reporting turnaround time by 30%. • Implemented CI/CD pipelines using Azure DevOps and GitHub, improving deployment reliability and reducing production release failures by 40%.Real-Time Distribution Analytics Platform• Engineered real-time data processing pipelines using Azure Event Hub and Databricks Spark Structured Streaming to monitor distributor inventory and order fulfillment across Azure and AWS cloud environments. • Developed complex data transformation and validation logic using Advanced SQL, PySpark, and Python, improving data quality accuracy by 25%. • Optimized Spark jobs through partitioning, caching, and query tuning, reducing job execution time by 30%.Cloud Data Pipeline Operations Support• Monitored and supported Azure Databricks production pipelines with 99.9% SLA compliance, proactively resolving job failures and schema evolution issues. • Integrated upstream and downstream systems using REST APIs, enabling automated data ingestion into Azure Data Lake Gen2 and Azure Blob Storage. • Managed incident tracking and resolution using ServiceNow, collaborating with cross-functional teams to reduce mean time to resolution (MTTR) by 25%.

Education

• Great Lakes Institute of Management

  PGP in Data Sciencs and Engineering, Data Science

  2021 — 2021

• St. John High School

  10th

• Technique Polytechnic Institute

  Diploma, Computer Science

  2013 — 2016

• Heritage Institute of Technology

  Bachelor of Technology, Computational Science

  2016 — 2019

• Bandel St. Johns High School

  Class X

  2003 — 2013