Prateek Sadhwani

Data Engineer @Accenture

Noida, IN

Enhancing and improving a Python utility for triggering, monitoring, and retrieving the status of Databricks jobs via REST API- Engineered and streamlined ETL pipelines using Python and PySpark to transform, cleanse, and standardize large-scale datasets (Parquet, CSV, XLSX) based on complex business rules and logic, ensuring optimal performance- Developed dynamic and reusable Python scripts with argparse, parameterized configurations through YAML files, and validated code integrity using Pytest, resulting in a 40% improvement in testing efficiency- Architected and deployed robust data models by designing tables and schemas in SingleStore, integrating data from diverse sources, including DDL, PostgreSQL, MySQL, and NAS, into Amazon ECS (S3), achieving a 50% boost in query efficiency- Orchestrated and optimized end-to-end workflows using Control-M to automate pipelines, ensuring 100% SLA compliance and reducing manual interventions by 35%- Transformed and processed over 1.5 billion records, cutting data processing times by 30% and enhancing data quality metrics by 25%, leading to improved decision-making capabilities- Collaborated cross-functionally with stakeholders to design and implement scalable solutions, enabling the efficient handling of multi-terabyte datasets monthly and meeting key business objectives.

Hemnani Public School

Middle School Diploma, Xth

Guru Gobind Singh Indraprastha University

BTech - Bachelor of Technology, Electrical, Electronics and Communications Engineering

Summer Fields School - India

High School Diploma, Science