Vivek Rajakumar Jadhav
Data Engineer II at Amazon | AWS Azure Certified | Apache Spark Expert
- Role
- Data Engineer at Amazon
- Location
- Bengaluru, KA, IN
- LinkedIn followers
- 500 followers
About Vivek Rajakumar Jadhav
Skilled Data Engineer with over 5 years of experience in the IT industry. I specialize in designing and managing data pipelines, optimizing data processing, and building robust data warehousing solutions. Proficient in transforming raw data into actionable insights. I have a proven track record of reducing deployment efforts and enhancing data quality through automation and efficient pipeline design.I have got good exposure to the following technologies:Good command over programming languages (Python, Shell Scripting)Databases (MySQL, SQL Server, Mongo DB), Azure Services (Azure Data Factory, Azure Functions, Azure DevOps, ADLS, Synapse, Databricks)Data Visualization (Power BI)AWS Services (S3, EC2, Lambda, Glue, Redshift, Athena, Dynamo DB), Orchestration Tools (Airflow), Big Data Technologies (Apache Spark, Hive, Sqoop, Hadoop)Strong Data Structures & Algorithm fundamentals.I have also trained many colleagues in my organization on Azure by conducting online sessions.
Experience
Data Engineer
Dec 2024 — Present · Bengaluru, IN
Developed and maintained over 10 ETL pipelines on EMR using PySpark and Lambda, designed to detect vendor-induced defects from incorrect product detail updates, efficiently processing 15 TB of data daily to ensure data accuracy and consistency across systems- Engineered a Lakehouse architecture leveraging AWS EMR, Glue, and S3, with data stored in Apache Iceberg format, to enable seamless tracking and analysis of customer product returns, processing 5 TB of data each day with high reliability and scalability- Enhanced the performance of existing PySpark jobs by 60% through the application of advanced Spark optimization techniques, resulting in significantly faster identification and resolution of incorrect widgets displayed to customers.
Education
Bangalore Institute of Technology
Bachelor's degree, Mechanical Engineering
2013 — 2017
Find verified contacts for anyone on LinkedIn
Unifers gives sales teams verified emails and direct dials, enriched profiles, and outreach that lands in the inbox.
Free plan included · No credit card required
This profile is compiled from publicly available professional sources. Unifers is not affiliated with or endorsed by LinkedIn. Request removal of this profile.