Virender K.

About Virender K.

Azure Data Engineer with 7+ years of experience in designing, optimizing, and implementing scalable data solutions across industries such as Software, Health, Hygiene, Nutrition, Packaging and Finance. Skilled in Azure Data Factory, Databricks, Apache Spark, SQL, Python and CI/CD automation, with a strong track record of improving data processing efficiency, reducing costs and enhancing system performance.Key Achievements & Expertise: Optimized Azure Data Factory & Databricks pipelines, reducing data processing time by 90%(from 5-6 hours to under 30 minutes), cutting cloud costs by 30%, and improving query performance by 2x. Architected scalable data models supporting $50M+ in annual freight transactions, ensuring high-performance data processing. Led migration of 50+ SQL workloads to Azure Databricks, improving query execution speed by 60% and accelerating deployments by 3x through CI/CD automation. Streamlined Azure Data Lake storage, reducing raw data storage by 4+ GB per week and lowering cloud storage costs by 20%. Enhanced data analysis performance by 40% using SQL, Spark, and Python, transforming 10TB+ datasets for global healthcare clients. Published a research paper on Data Cleaning at an Conference, accumulating 62 citations and 2407 full-text views.Technical Skills: ‣ Programming & Data Processing: Python, SQL, SparkSQL, Apache Spark ‣ Azure Technologies: Azure Data Factory, Databricks, Azure Synapse, ADLS, Microsoft Fabric ‣ DevOps & Automation: Azure DevOps, CI/CD, SSIS ‣ Database & Storage: MySQL, MS SQLApproach & Mindset: Strong problem-solving ability, ensuring efficient and optimized data solutions for complex business challenges. A collaborative and results-driven approach, working closely with stakeholders to deliver data- driven insights and business value. Passionate about continuous learning, staying up to date with emerging technologies and industry best practices in Data Engineering and Cloud Computing.Key Clients: Philips : Reckitt Benckiser : PepsiCo : Ball Corp : Connect: Open to discussions on Data Modelling, cloud optimization and business intelligence solutions. Always eager to learn and collaborate on innovative projects that maximize data potential and drive business growth.

Experience

1. Senior Consultant - Azure Data Engineer

   Deloitte

   May 2023 — Present · Hyderabad, IN

   Data & Analytics Professional | Expert in Health, Hygiene, Nutrition, and FMCG Domains | Driving Efficiency Through Data OptimizationSpecialize in managing and optimizing complex data ecosystems for multinational corporations across health, hygiene, nutrition (Reckitt) food & beverages (PepsiCo), and packaging solutions (Ball Corporation) company information and chemical compositions, guaranteeing their alignment with REACH, an EU regulation designed to bolster the protection of human health and the environment from potential chemical risks.Roles and Responsibilities:• Built the CARA and Spot Freight module from scratch, translating business requirements into complex data transformations and delivering final datasets for integration.• Conducted in depth technical analysis and optimization processes, efficiently extracting and vacuuming more then 4 GB of RAW layer data while retaining only the necessary one-week data on production and save the azure storage.• Achieved a significant reduction in Formulation execution time, decreasing it from 5-6 Hours to at most 20-30 minutes through technical optimizations in, code refinement and adjustments in business logic on QA as well as PROD.• Showcased a prototype to business stakeholders for the new module integration in project.• Provided the KT session to BAU team regarding the updated notebook or logic changes within the project.• Offered prompt and insightful analysis or RCA to business analysts or product manager, with actionable solutions to resolve identified issues.

Education

• Lovely Professional University

  Bachelor's degree, Computer Science

  2013 — 2017

• Lovely Professional University

  Master of Technology - MTech, Computer Science and Engineering

  2017 — 2018

• Minerva Sr. Sec. School Ghumarwin

  High School Diploma, Non-Medical

Skills

• Teamwork
• Team Management
• Html
• Event Management
• Oracle Database
• Microsoft Office
• Research
• Sql
• Management
• Leadership