Kishan Rekhadia
Data Engineer @Deloitte
Signup · Get unlimited contacts
WORK HISTORY
Data Engineer @Deloitte
Pune, IN
Leading a team of 3 in designing and developing robust, scalable data ingestion and data masking pipelines for a major Indian banking client. • Spearheaded the design and implementation of scalable full-load and incremental data ingestion pipelines, transferring over 10 TB of data from on-prem Oracle and 30 TB from SAS Data Warehouse to AWS S3 in optimized Parquet format using AWS Glue and DMS. The solution enabled faster downstream analytics and reduced storage footprint by 65%. • Engineered a deterministic data masking pipeline using AWS Glue and PySpark to encrypt PII fields while preserving referential integrity for downstream joins. Integrated a role-based access control (RBAC) system using Lake Formation to enforce granular data access policies based on user roles. • Designed a metadata-driven reconciliation framework that supports flexible validation strategies across Oracle, S3, RDS, and Redshift. The framework is parameterized using a centralized metadata table (Aurora PostgreSQL) and supports rule-based execution of various data quality checks with consolidated CSV outputs. • Implemented an end-to-end orchestration workflow using Step Function, AWS Lambda & Glue to schedule ingestion, masking, and reconciliation jobs with dependency resolution and automated alerting via Amazon SNS. • Contributed to a leading UK financial bank\'s Risk and Finance data transformation program by modernizing data architecture, identifying pain points across a multi-cloud landscape, and supporting strategic decision-making. • Provided data modeling support to scale and optimize new data marts used for evaluating financial disclosure reports. • Evaluated and recommended third-party ETL and data integration tools by aligning business requirements with industry best practices and technical standards.
EDUCATION
BITS Edu Campus: BABARIA INSTITUTE
Bachelor of Engineering - BE
ABOUT KISHAN REKHADIA
Kishan is a seasoned Data Engineer with strong expertise in building scalable, cloud-native data solutions on AWS. He brings over 4.5 years of hands-on experience delivering enterprise-grade data ingestion, transformation, masking, and reconciliation frameworks for top global clients in the banking and financial services sector.Currently working at Deloitte as a Consultant, he leads a high-impact team in designing metadata-driven data pipelines, automating end-to-end workflows using AWS Glue, Lambda, Step Functions, and enforcing granular RBAC policies via Lake Formation. His work has contributed to optimised data lake architectures, enabling 10–30 TB scale migrations from legacy systems to AWS S3, while ensuring compliance, security, and performance.Previously at Infosys, Kishan played a core engineering role in modernising data infrastructure for a leading US bank, delivering reusable ETL frameworks, QuickSight automation, and high-performance Python microservices. With deep knowledge of PySpark, Python, SQL, and tools like Airflow, Redshift, Aurora, and DBT, he has led the design of automated monitoring, alerting, and reconciliation systems with significant reductions in manual effort and latency.Certified across AWS and Microsoft Azure platforms, Kishan combines strong programming skills with architectural thinking, enabling seamless collaboration across business and technical teams. With a focus on scalability, automation, and data integrity, he thrives in fast-paced environments that demand innovation and execution.
This profile is compiled from publicly available professional sources. Unifers is not affiliated with or endorsed by LinkedIn. Request removal of this profile.