Bikash Shrestha

Experience

1. Sr Data Engineer

   UBS

   Nov 2022 — Present · Sterling, VA, US

   Led the successful migration of on-premises ETL pipelines to AWS and GCP, automating data migration processes and optimizing data processing workflows using HDFS, MapReduce, Hive, Spark, and Sqoop.• Played a pivotal role in building and maintaining data lakes on top of HDFS, ensuring seamless integration with CI/CD tools for application deployment and testing across multiple cloud platforms.• Demonstrated extensive experience implementing big data projects on Cloudera, AWS, and GCP distributions, with a strong focus on performance optimization and scalability.• Proficient in designing and implementing partitioned tables in Hive, optimizing data warehousing operations and improving query performance.• Utilized Spark\'s in-memory computing capabilities for advanced data analytics and processing tasks, achieving significant performance improvements over traditional MapReduce jobs.• Demonstrated expertise in data sharing and management with Snowflake, AWS, and GCP, leveraging their capabilities for efficient data storage and retrieval.