Zoheb Merchant

About Zoheb Merchant

Experienced Big Data Solutions Architect and Lead Hadoop SME with 12+ years of expertise in designing, implementing, and optimizing Cloudera-based data platforms across global banking and financial domains. Proven track record in cluster migrations, platform modernization, and DevOps automation using tools like Ansible, Terraform, Jenkins, and Python. Skilled in managing enterprise-scale Hadoop environments (CDH/CDP, HDP, ODP) on both on-premises and hybrid AWS/Azure setups. Passionate about data platform reliability, governance, and security (Kerberos, Ranger, TLS, LDAP). Adept at leading cross-functional teams, mentoring engineers, and driving scalable, cost-efficient, and compliant data solutions aligned with digital transformation goals.

Experience

1. Technical Lead

   Wipro

   Mar 2021 — Present · Pune, IN

   Architected and led large scale Hadoop and Big Data modernization programs using Cloudera CDP, ODP, and hybrid cloud (Azure/AWS).• Defined enterprise-scale reference architectures ingestion, processing, and analytics aligned to BFSI compliance standards.• Spearheaded CDP-to-ODP migration leveraging Acceldata observability and VAST S3, ensuring reliability and SLA adherence.• Delivered major cost optimization by automating 9PB data transfer using DistCp and Bash scripting, avoiding Cloudera’s licensed replication service.• Automated data lake operations and cluster provisioning using Ansible, Terraform, and Jenkins, reducing manual effort.• Integrated Kerberos, Ranger, Vault, and LDAP/AD for enterprise-grade security, governance, and compliance enforcement.• Established DevOps frameworks enabling CI/CD, automated patching, and configuration management across multiple Hadoop clusters.• Designed and implemented multi-tenant architectures for hybrid cloud deployments with fine-grained access control and ADLS integration.• Implemented DR and backup automation via CDP Replication Manager, ensuring platform continuity and high availability.• Built observability stacks with Prometheus, Grafana, and ELK for real-time monitoring, RCA, and capacity optimization.• Partnered with CDO and platform engineering teams to align modernization initiatives with business data strategy and cost optimization goals.• Mentored cross-functional teams on Hadoop engineering, Spark optimization, and DevOps best practices, ensuring operational excellence.

Education

• Savitribai Phule Pune University

  Bachelor of Computer Applications, Information Technology

  2008 — 2012

• CHANDIGARH UNIVERSITY

  Master of Computer Applications - MCA, DataScience,ML&AI,Cybersecurity,Cloud,Software&WebDev,MobileApps,Networking&Communication