Shubham Rawat
Data Engineer @epam | Python | Spark, Kafka, Airflow | SQL | Snowflake | Machine Learning | big query |
- Role
- Big Data Engineer at EPAM Systems
- Location
- Faridabad, HR, IN
- LinkedIn followers
- 500 followers
About Shubham Rawat
Data Engineer with more than 7 years of experience in the IT industry, focused on creating and improving data processing systems using Big Data tools- Skilled in working with cloud services like AWS and data storage solutions, with a strong emphasis on making performance better- learning genAI and gcp
Experience
Big Data Engineer
May 2022 — Present · Gurugram, IN
Developed RAG (Retrieval-Augmented Generation)-based chat assistant for answering questions based on context includes a function that marks the part of the document that helped shape the answer.• Interacting with Business owners for requirement gatherings and analysis to define business & functional.• Implement data quality checks framework on top of production pipelines to ensure the accuracy and integrity of data stored in the data warehouse.• Developed and implemented an SCD Type 2 multi-layered data architecture for EHR systems, including stages for raw data ingestion, deduplication and normalization (prestage), staging (merging current and historical data), and unifying data from multiple sources.• led a proof of concept (PoC) project to integrate Iceberg tables into Snowflake, increasing analytical speed and data storage efficiency.• Improved Snowflake Query execution time by 30% by reworking Stored Procedures.• Fixed production Issues, worked on RCA (Root Cause Analysis) to make data accurate.
Education
Maharishi dayanand university ,Rohtak
Bachelor of computer education
2015 — 2018
Shanmugha Arts, Science, Technology & Reserch Academy (SASTRA), Thanjavur
Master of Computer Applications - MCA, Python, Data analysis, Machine Learning , DBMS
2018 — 2021
Find verified contacts for anyone on LinkedIn
Unifers gives sales teams verified emails and direct dials, enriched profiles, and outreach that lands in the inbox.
Free plan included · No credit card required
This profile is compiled from publicly available professional sources. Unifers is not affiliated with or endorsed by LinkedIn. Request removal of this profile.