Amar Shivangol

About Amar Shivangol

I have worked in multiple areas such as Big Data, data warehousing, ETL, application development, analytics, and machine learning, with a particular interest in Big Data. I have experience working with technologies like Spark, Python, Scala, Hadoop, Hive, Impala, Kafka, Docker, and Airflow. Responsible for end-to-end deployment of multiple modules/datasets Involved in several data migration projects (RDBMS -> Hadoop -> Redshift -> Snowflake) Responsible for data processing, data analysis, data validation, and impact analysis Real-time data processing using Spark Streaming Participated in code reviews and test case reviews At IBM, I architect and engineer advanced data solutions, leveraging my expertise in technologies like Scala Spark, databricks, Snowflake, and Amazon Web Services. My focus is on developing robust data architectures that drive strategic insights and operational efficiencies. Our team\'s work in migrating datasets to Hadoop, redshift, and snowflake platforms and optimizing real-time data processing using Spark Streaming has significantly enhanced data handling capabilities.With an educational foundation in Electrical and Electronics Engineering from Visvesvaraya Technological University, I apply a systematic and analytical approach to data challenges. I take pride in contributing to the deployment of complex data modules and continuously improving data processing and analysis methodologies. My goal is to keep evolving in the dynamic field of Big Data, ensuring my skills remain at the forefront of industry standards. A passionate and evolving tech enthusiast with 6+ years of experience in the IT industry A Software Engineer, eager to build strong, growth-oriented relationships in the professional world Strong foundation in computer science theories, programming fundamentals, and Big Data technologies Dedicated experience in developing ETL-based platforms Passionate about learning new and advanced computer technologies Additional Areas of Expertise: Service Delivery, Program Management, People Management.

Experience

1. Senior Technical Services Specialist (Data Architect Senior Data Engineer)

   IBM

   Nov 2021 — Present

   Skills: · Scala Spark · Snowflake · SQL SERVER · SQL · Apache Kafka · Apache NiFi · Amazon Web Services (AWS) · AWS EMR · Apache Spark · Hive · Python (Programming Language) · Data Warehousing · Data Lakes · Scala · Hadoop · hdfs · Apache Sqoop. Airflow · Bitbucket · git · Teamcity· Octopus Deployment

Education

• Visvesvaraya Technological University

  Bachelor of Engineering, Electrical and Electronics Engineering

  2014 — 2018

• KLE Society's Lingaraj College, Belgaum

  12th, Science

  2012 — 2014

• V G Model English Medium School Belagavi

  10th

  2011 — 2012