Bibhuti Mohapatra

About Bibhuti Mohapatra

Overall, 11 years of IT industry experience encompassing a wide range of skill set, roles and industry verticals. Senior Data Engineer with 5+ years of experience in developing cloud based solutions, utilizing Azure Databricks, Azure DataFactory, Azure SQLDB, Azure DataLake, Hive and Spark. Key achievements include migrating exisiting system to azure cloud, handling large datasets with different file formats by extracting from multiple sources, building complex data pipelines, spatial data analysis and automated CI/CD process with DevOPS pipelines. • Migrated legacy on-premises solution to azure cloud. • Created ETL pipelines involving different sources using Azure Data Lake, Azure Databricks, Azure Data Factory and Azure SQL DB in tandem. • Developed optimized data pipelines to process 10TB/day data which involves data extraction, transformation, and aggregation. • Built data pipelines involving complex Geo-spatial data processing to gain insights. • Developed Spark application using Scala, Python and Spark SQL. • Worked on different data sources like Shape files, CSV, JSON, Parquet, Excel and YAML files. • Created azure DevOps pipelines using Ansible playbooks for code build, deployment and ADF publishing in multiple environments. • Improved performance of complex and long running pipelines which resulted in cutting costs by 10%.

Experience

1. Senior Big Data Engineer

   IBM

   Aug 2019 — Present · Bengaluru, IN

   Bengaluru, Karnataka, India

Education

• Regional College of Management (RCM), Bhubaneswar

  Master of Computer Applications - MCA