Bhawana Barfa

About Bhawana Barfa

Having 2.7 years of experience in the IT industry as Spark Developer using Big Data technologies. • Hands on experience in various big data application like data ingestion, data analytics and data visualization. • Worked on design development of Spark SQL queries based on Functional Specifications and developing Spark applications using multiple programming languages Java and Scala. • Worked on development of Spark job workflow to load data from object storage, perform transformations and storing data into Object-Storage. • Experienced with Spark SQL, Spark Streaming, Data frames, RDD, Spark Context and writing UDF/UDAF when needed. • Experience in handling large datasets using partitions, Broadcasts, Joins, transformations, and other Memory Capabilities during ingestion process. • Worked with various file formats like CSV, Avro, Parquets to extract meaningful data and exported to Object Storage using compressions formats like Snappy. Load and transform large sets of structured, semi-structured and unstructured data. • Carrying out real-time in-depth data analytics using Spark Streaming and consumed Data from Kafka queue. • Experience in Daily Production Support to monitor and troubleshoot Spark Jobs and responsible for Support/troubleshoot for performance issues and issues arises during testing duration. • Worked with different components HBase, HDFS, Kubernetes, Kafka, Elasticsearch, MySQL, Cassandra, AWS, Minio/Zadara for data storage and processing. • Researched and explored spark 2 and spark 3

Experience

1. Senior Data Engineer

   LTIMindtree

   May 2023 — Present · Pune, IN

   Pune, Maharashtra, India

Education

• Chamelidevi Group of Institutions, Gram Umrikheda, Near Toll Naka, Khandwa Road, Indore 452020

  Bachelor of Engineering - BE

  2016 — 2020