Vinod Bhul
Senior Data Engineer | Spark, Hive, Hdfs, Yarn, Kafka ,Apache Sqoop | ADLS Gen2, ADF, Azure Synapse Analytics |Java, Scala, Python | Sql
- Role
- Senior Data Engineer at LTIMindtree
- Location
- Thane, MH, IN
- LinkedIn followers
- 500 followers
About Vinod Bhul
As a Data Engineer with over 4.5+ years of experience, I have developed a deep expertise in designing and optimizing data pipelines to manage and process large-scale datasets. Currently, I leverage a robust skill set in Java, Spark, Hadoop, SQL, and Hive to architect scalable data solutions that enhance operational efficiency and support data-driven decision-making.In my current role, I focus on implementing Spark batch processing for efficient data ingestion from cloud sources and executing comprehensive ETL workflows. This involves transforming, cleansing, and preparing data for downstream analytics, and loading it into HDFS and Hive for scalable storage and querying. I also manage Spark job orchestration using shell scripts to streamline data processing and enhance overall system performance. My work involves advanced SQL analysis to generate actionable insights that drive business decisions.Previously, I excelled in developing end-to-end PySpark ETL workflows, integrating Kafka data into HDFS, and processing it in Vertica. I orchestrated shell scripts to optimize data transfers between HDFS and Hive, and implemented Sqoop for seamless ETL between Hadoop and relational databases. My experience also includes architecting real-time data solutions with Vk Scheduler Microbatch, creating a Storm application for real-time click/revenue capping, and developing robust data ingestion pipelines for external API data collection. Additionally, I crafted Java APIs, XML reports, and Superset dashboards, and migrated Spark Scala jobs to PySpark.With a strategic approach and technical proficiency, I am dedicated to solving complex data challenges and delivering impactful insights. I am always eager to connect with like-minded professionals and explore new opportunities in data engineering.
Experience
Senior Data Engineer
Jul 2024 — Present · Navi Mumbai, IN
Leveraging Java, Spark, Hadoop, SQL, and Hive to architect and optimize data pipelines for large-scale data processing- Implementing Spark batch processing for efficient data ingestion from cloud sources, ensuring timely data availability- Executing comprehensive ETL workflows to transform, cleanse, and prepare data for downstream analytics, loading it into HDFS and Hive for scalable storage and querying- Developing and managing Spark job orchestration through shell scripts to streamline data processing and enhance operational efficiency- Utilizing SQL for advanced data analysis, generating actionable insights and supporting data-driven decision-making across the organization.
Education
National Education Society's Arts, Commerce & Science College
HSC
2014 — 2016
Ramrao Adik Institute of Technology
Bachelor of Engineering - BE
2016 — 2020
Find verified contacts for anyone on LinkedIn
Unifers gives sales teams verified emails and direct dials, enriched profiles, and outreach that lands in the inbox.
Free plan included · No credit card required
This profile is compiled from publicly available professional sources. Unifers is not affiliated with or endorsed by LinkedIn. Request removal of this profile.