Bhawan Singh Solanki
AWS Data Engineer | Python | Pyspark | ETL | AWS EMR | GLUE |
- Role
- Data Engineer at Tata Consultancy Services
- Location
- Indore, MP, IN
- LinkedIn followers
- 500 followers
About Bhawan Singh Solanki
Currently serving the notice period as a Data Engineer at Tata Consultancy Services…
Experience
Data Engineer
Mar 2023 — Present · Indore, IN
Ingested and processed high-volume IoT(CT, UL, X-ray.)data from AutoSC team into AWS Data Lake (mdp-asc)using automated polling and segregation scripts. Developed Spark jobs to transform and batch-process files (.tar.txt.gz.parquet) into structured datasets forRedshift, RDS (PostgreSQL), and S3. Implemented robust data validation and troubleshooting mechanisms for failures like file format errors, duplicates,null pointers, and unexpected schema issues. Diagnosed and resolved database load failures in PostgreSQL RDS using AWS CloudWatch logs, addressing issueslike deadlocks, type mismatches, and unicode errors. Handled Redshift load failures queries, resolving column length and data type issues by adjusting schema orcleansing source files. Managed data aggregation pipelines and performed incident-based troubleshooting to ensure accurate and timelydata availability for dependent analytics layers. Collaborated with 23+ teams (e.g, MLOps, Predictive Analytics, BAT) by delivering high-quality, reliable datapipelines supporting operational and strategic use cases. Ensured high availability and performance of data workflows using AWS services (S3, Redshift, RDS), ApacheSpark, and custom monitoring scripts. Supported the successful transition of project ownership from Genpact to TCS by contributing to documentation,facilitating process walkthroughs, and focusing on knowledge transfer and system stabilization.
Education
Indore Institute of Science and Technology
Bachelor of Engineering - BE
2016 — 2020
Rajiv Gandhi Prodyogiki Vishwavidyalaya
Bachelor of Engineering - BE
2016 — 2020
Find verified contacts for anyone on LinkedIn
Unifers gives sales teams verified emails and direct dials, enriched profiles, and outreach that lands in the inbox.
Free plan included · No credit card required
This profile is compiled from publicly available professional sources. Unifers is not affiliated with or endorsed by LinkedIn. Request removal of this profile.