Vipul P.
Big Data Engineer at Marudhar Quartz Surfaces Pvt. Ltd
- Role
- Big Data Engineer at Marudhar Quartz Surfaces Pvt. Ltd
- Location
- Jaipur, RJ, IN
- LinkedIn followers
- 500 followers
About Vipul P.
Results-driven Big Data Engineer with 3.5 years of experience in designing, developing, and optimizing scalable data pipelines and ETL workflows. Proficient in Big Data technologies including Hadoop, Spark, Hive, and HDFS, with strong expertise in structured and unstructured data processing. Skilled in distributed computing, batch processing, and real-time data streaming using tools like Kafka and Spark Streaming. Adept at implementing data integration, data warehousing, and data lake architectures in cloud environments. Demonstrated ability to ensure data quality, performance tuning, and automation of complex workflows. Passionate about data analytics, data optimization, and leveraging advanced technologies for actionable business insights. Strong collaboration, communication, and problem-solving skills, with a commitment to continuous learning and innovation in data engineering.
Experience
Big Data Engineer
Marudhar Quartz Surfaces Pvt. Ltd
Dec 2021 — Present · Jaipur, IN
Took part in designing, coding, testing, and documenting data solutions in the cloud.Built PySpark pipelines on AWS EMR to process large data from S3 using Parquet and CSV formats.Wrote custom Spark functions to handle complex transformations.Used Spark RDDs to work with both structured and unstructured data.Handled schema evolution and data validation while working with evolving datasets.Transferred large datasets between Hadoop and databases using Sqoop, including incremental loads.Created step-by-step data workflows using AWS Step Functions.Used AWS S3 for storing and accessing input/output data in a secure and scalable way.Followed best practices for writing clean, reusable PySpark code in a version-controlled environment (Git).Made sure the data pipelines ran smoothly, were reliable, and could handle failures.Collaborated with team members to troubleshoot pipeline issues and improve performance.Focused on building scalable, cloud-ready data pipelines aligned with requirements.
Education
Samrat Ashok Technological Institute
Bachelor of Engineering - BE, Electronics and Instrumentation Engineer
Find verified contacts for anyone on LinkedIn
Unifers gives sales teams verified emails and direct dials, enriched profiles, and outreach that lands in the inbox.
Free plan included · No credit card required
This profile is compiled from publicly available professional sources. Unifers is not affiliated with or endorsed by LinkedIn. Request removal of this profile.