Saurabh Rana

About Saurabh Rana

As a passionate Data Engineer, I specialize in building scalable, robust, and high-performance data solutions that empower organizations to harness the full potential of their data. With expertise in Python, SQL, Spark, and cloud platforms, I design and implement data pipelines, ETL workflows, and real-time processing systems that transform complex datasets into actionable insights.Key highlights of my experience include:Designing and optimizing end-to-end data pipelines, ensuring reliability, scalability, and efficiency.Leveraging big data frameworks (e.g, Spark, PySpark) to handle large-scale data processing.Developing cloud-native solutions on platforms like Azure for seamless integration and analytics.Ensuring data quality, consistency, and security across all workflows.I thrive in solving complex data challenges and continuously seek to innovate and refine processes, enabling businesses to make informed decisions with confidence!

Experience

1. Data Engineer

   Lirik Inc

   Oct 2024 — Present · Gurugram, IN

   Successfully led a cloud data warehouse migration from Amazon Redshift to Snowflake, leveraging dbt to build a scalable, modular, and analytics-ready data platform. Designed and implemented dbt models to transform raw data into trusted, business-ready datasets Refactored legacy SQL into dbt best practices (sources, staging, marts, tests, and documentation) Implemented incremental models, snapshots, and data quality tests to ensure accuracy and performance. Built and fine-tuned LLMs using proprietary and domain-specific data stored in Delta Lake. Implemented RAG (Retrieval-Augmented Generation) pipelines with vector search for accurate, context-aware responses. Leveraged Unity Catalog for secure data access, governance, and model management. Developed scalable ML and GenAI pipelines using Databricks notebooks and workflows. Optimized inference performance and cost using Mosaic AI tools and model serving. Ensured responsible AI with monitoring, evaluation, and prompt management.

Education

• Amrapali University Haldwani

  BCA