Vikesh Malik

Associate Data Engineer - Ii @JPMorganChase

Glasgow, GB

Migrated legacy Hive-based data processing workflows to Databricks cloud platform, modernizing datainfrastructure and improving scalability.• Developed high-performance data pipelines using PySpark, reducing batch processing time by 8hrsand achieving 50% efficiency improvement in system operations.• Performed end-to-end code testing and validation across multiple environments (dev, UAT,production), ensuring robust application performance and user experience• Performed comprehensive data validation across multiple business logic scenarios to ensure dataaccuracy, integrity, and compliance with business requirements.• Investigated and mapped business logic workflows to identify optimization opportunities and ensureaccurate system behaviour.• Successfully delivered two high-priority projects on time and within scope, meeting all stakeholderrequirements and business objectives.Tech Stack: Spark, MySQL, Cloudera, Hive, Python, Bitbucket, Jira, IntelliJ, Data Pulse, Databricks, Jules, Airflow