Deepak Kumar
Senior Data Engineer | GCP Migration + Hadoop Modernization | 11+ yrs Banking | PySpark • BigQuery • Airflow
- Role
- Senior Data Engineer at Wells Fargo
- Location
- Hyderabad, TG, IN
- LinkedIn followers
- 500 followers
About Deepak Kumar
Senior Data Engineer | GCP Migration | Cloud Data Platforms | BigQuery | PySpark | Airflow | SQL | Banking AnalyticsI am a Senior Data Engineer with 11+ years of experience designing and delivering enterprise-scale data pipelines across banking, credit risk, fraud analytics, and large-scale ETL platforms. My core expertise includes GCP (Google Cloud Platform), PySpark, BigQuery, Airflow, Hive, SQL, and Hadoop Ecosystems.I specialize in cloud migration (on-prem to GCP) and building secure, scalable data platforms for analytical and operational workloads. Core Expertise & Keywords for RecruitersGCP (BigQuery, GCS, Dataplex, Pub/Sub, Composer/Airflow)PySpark, Spark SQL, Distributed ProcessingETL / ELT Pipelines & Data EngineeringSQL Server Migration → BigQueryCDP / Hadoop / Hive / HDFS → GCP ModernizationData Quality, Data Governance, PII handling, Dataplex taxonomyCloud Architecture, Data Modeling, CI/CD (Jenkins, Git, Liquibase) Cloud Migration & Modernization WorkMigrating legacy SQL Server & Hive workflows to BigQueryBuilding end-to-end ingestion pipelines using Airflow DAGsImplementing secure data movement using Composer, Dataflow, Dataplex, masking & encryptionDesigning raw → curated → conformed data layers using PySpark & IcebergOptimizing pipelines for performance, cost, data quality, and audit compliance Banking & Enterprise Experience11+ years in banking and financial services (BFSI)Built ETL pipelines for Credit Cards, Auto Loans, Fraud, Risk & P&L reportingStrong production experience: incident resolution, root cause analysis, performance tuningLeading and mentoring teams through high-pressure, business-critical deliveries What I’m Looking ForRoles in:Senior Data Engineer | Lead Data Engineer | Cloud Data Engineer | GCP Migration | ETL Modernization | BigQuery EngineerI’m interested in building and modernizing cloud data platforms with real business impact.
Experience
Senior Data Engineer
Nov 2022 — Present · Hyderabad, IN
I design and modernize large-scale data pipelines for enterprise banking systems, driving cloud migration and end-to-end platform engineering across credit, fraud, risk, and operational analytics.Core Responsibilities• Build ETL/ELT pipelines using PySpark, BigQuery, Airflow, Pub/Sub, GCS, SQL• Lead migration of Hadoop/CDP & SQL Server workloads to GCP• Engineer raw → curated → conformed layers using PySpark and modern table formats• Implement CI/CD deployments (Jenkins, Git) and schema automation• Design scalable incremental ingestion for structured & semi-structured data• Optimize pipeline performance through partitioning, caching & tuning• Collaborate with architects, platform teams, and SMEs on cloud design• Drive production support, RCA, and stability improvementsHigh-Visibility Projects• Delivered a GCP migration POC to Technology Leadership, demonstrating ingestion → processing → BigQuery integration• Built a working NoSQL (MongoDB) → GCP ingestion model used as a blueprint for future migrations• Helped define the cloud onboarding standard for multiple business lines• Rewrote legacy SQL workflows into PySpark pipelines to improve performance & maintainability• Enhanced data governance using metadata-driven design & validation rulesImpact & Achievements• Accelerated cloud roadmap by developing reusable migration patterns• Reduced onboarding time for new data sources from weeks to days• Improved reliability and audit compliance for critical financial pipelines• Reduced manual effort through automation of ingestion and validation steps• Recognized for simplifying complex architecture and enabling faster execution across teams
Education
Jean Pauls High School, Ara
HS
2006 — 2008
West Bengal University of Technology, Kolkata
Bachelor's degree, Electronics and Communications Engineering
2009 — 2013
Find verified contacts for anyone on LinkedIn
Unifers gives sales teams verified emails and direct dials, enriched profiles, and outreach that lands in the inbox.
Free plan included · No credit card required
This profile is compiled from publicly available professional sources. Unifers is not affiliated with or endorsed by LinkedIn. Request removal of this profile.