Himanshu Durbude

About Himanshu Durbude

Passionate and performance-driven Senior Data Engineer with 5+ years of experience building scalable, cloud-native, and high-performance data platforms across US Healthcare and Banking domains. Skilled in architecting secure, end-to-end batch and real-time data pipelines, with expertise across Big Data frameworks, AWS cloud, and DevOps/Infra-as-Code.At Accenture, I lead enrollment data pipeline development for a US Healthcare client — integrating Kafka, S3, Glue, MSSQL, PostgreSQL, and APIs with full cross-account networking, VPC configuration, and Terraform-based provisioning. Previously at TCS, I developed mission-critical data pipelines for real-time banking fraud detection, data lake ingestion, and large-scale cloud migrations to AWS.Key Highlights• Designed real-time Kafka–S3–Glue pipeline to process healthcare enrollments, integrated with APIs and multi-source DBs.• Implemented secure cross-account S3 and DB connectivity using IAM, KMS, VPC peering, and Secrets Manager.• Migrated and enhanced 3+ critical platforms across 6 AWS environments, improving scalability and reducing manual effort.• Built fraud detection feature pipelines (TCS) from EDW, Teradata, Oracle, scoring live transactions for fraud risk (1–100 scale).• Integrated Apache Kafka to automate fraud alerts; reduced processing time by 30% via Spark optimizations.• Migrated pipelines from on-prem Hadoop to AWS (S3, Glue, Redshift); improved query speeds by 50%, cut cost by 20%.• Engineered Hadoop/Sqoop-based ingestion frameworks for hourly banking data ingestion with performance tuning.• Experienced with Airflow, CA7, and Oozie for robust orchestration and monitoring.Technical Proficiencies• Big Data: Apache Spark, PySpark, Hadoop, Hive, Kafka, Flink• Cloud Platforms: AWS (Glue, S3, Redshift, Lambda, VPC, EventBridge, DynamoDB, RDS), GCP (BigQuery, Dataflow)• ETL & Scheduling: AWS Glue, Kafka Connect, Airflow, Oozie, Sqoop, CA7• Databases: PostgreSQL, MSSQL, Oracle, Teradata, MySQL, Redshift, Hive• Infra & DevOps: Terraform, Git, Bitbucket• Monitoring & Tools: Dynatrace, Grafana, Kibana, QuickSight, Postman• Languages: Python, SQL, Shell Scripting• Methodologies: Agile (Scrum), CI/CDOpen to global opportunities with 30 days notice period. Excited to solve high-scale data challenges with modern data and cloud solutions.

Experience

1. Senior Data Engineer

   Accenture

   Jan 2025 — Present · Pune, IN

   Enrollment Data Pipeline Development: • Designed a near real-time pipeline to process Kafka-sourced files into Amazon S3. • Developed AWS Glue jobs to validate records by connecting to MSSQL/PostgreSQL, identifying new vs. existing enrollments. • Integrated with external APIs (Location, Product Services), PostgreSQL (insurer, treatment plans), and MSSQL (medical history); executed stored procedures for business validations. • Configured VPC networking (subnets, route tables, endpoints) to enable private Glue job execution and API connectivity. • Automated IAM roles, KMS, Secrets Manager, and network setup using Terraform; updated databases and triggered downstream dashboards.Stretch Network & Cross-Account Setup: • Implemented secure cross-account access for MSSQL/PostgreSQL using VPC peering, IAM, and firewall configurations. • Enabled cross-account S3 integration via bucket policies, KMS, and resource-based access control. • Parameterized infrastructure code and ETL scripts for reusable, multi-account deployments.Assets Migration & Cloud Enhancements: • Led the migration of 3 business-critical platforms across 6 AWS environments. • Re-architected VPCs, IAM policies, and service setups to meet new security and performance standards. • Migrated and validated AWS Glue, Lambda, Step Functions, RDS, S3, and DynamoDB services. • Delivered HLD/LLD documentation, runbooks, and KT sessions; worked closely with DevOps and Data Governance for compliant delivery.Tech Stack: AWS (S3, Glue, Lambda, RDS, Step Functions, DynamoDB, Secrets Manager, KMS, VPC, EventBridge), Kafka Connect, PostgreSQL, MSSQL, PySpark, SQL, Python, Terraform, Git, Databricks, Dynatrace, Postman

Education

• Government College of Engineering Nagpur

  Bachelor of Engineering - BE

  2016 — 2020