Rajat Gupta

About Rajat Gupta

Data Engineer passionate about building scalable, cloud-native solutions that drive business impact.At Fractal, I design and implement robust data pipelines and automation workflows that streamline operations for global enterprises. My toolkit includes Python, PySpark, Databricks, Azure Data Factory, Logic Apps, and SQL.Key Contributions:• Developed high-volume ETL pipelines for real-time data ingestion and transformation.• Automated reporting and alerts using Logic Apps and SMTP workflows.• Integrated data from SQL Server, REST APIs, and Azure Blob Storage.• Ensured data reliability and performance through rigorous validation and monitoring.I thrive in collaborative environments and enjoy solving complex data challenges. My goal is to continue expanding my expertise in cloud platforms and contribute to impactful, data-driven projects. Let’s connect if you’re working on exciting data engineering problems or looking to collaborate!

Experience

1. Associate Data Engineer

   Fractal

   Aug 2024 — Present · Gurugram, IN

   Working on a transportation load management solution for a global CPG client, aimed at automating manual workflows, improving shipment visibility, and enabling real-time updates using AI-driven agents and integrated systems. Key Contributions:• Built scalable ETL pipelines using PySpark, Databricks, and Azure Data Factory to process large volumes of shipment and carrier data.• Developed backend logic to identify missing shipment attributes and trigger automated email alerts using Azure Logic Apps, SMTP, and dynamic HTML templates.• Integrated data from SQL Server, Azure Blob Storage, and REST APIs, ensuring seamless and consistent data flow across systems.• Conducted unit and integration testing to validate pipeline accuracy and ensure reliable email delivery.• Collaborated with business stakeholders to translate operational needs into reusable, client-agnostic data models and workflows.• Optimized Spark jobs and asynchronous email workflows, achieving 21% faster response times and improved system performance.

Education

• GL Bajaj Institute of Technology and Management

  Master of Computer Applications - MCA, Computer Application

  2022 — 2024

• University of Lucknow

  Bachelor of Computer Application -BCA, Computer Application

  2018 — 2021