Shubham Tiwari

Experience

1. Senior Software Engineer

   Velotio Technologies

   Nov 2024 — Present

   Roles and Responsibilities- Owned core backend systems for the DataPlor platform, responsible for large-scale global location data ingestion, processing, and reliability- Designed and evolved distributed background job architectures in Ruby on Rails to support high-volume, multi-region data collection- Led the development of advanced web scraping frameworks using Nokogiri and Ferrum to reliably handle JavaScript-heavy and dynamically rendered websites- Architected fault-tolerant scraping pipelines with intelligent retry strategies, cookie rotation, throttling, and observability to minimize data loss- Introduced and standardized H3 geospatial indexing for accurate spatial clustering, querying, and downstream analytics consumption- Drove performance and scalability improvements by optimizing job execution, memory usage, and data normalization workflows- Collaborated directly with product, data science, and analytics teams to define data contracts and ensure high data accuracy and consistency- Led technical discovery and feasibility analysis for onboarding new global brands and complex data sources- Influenced platform-level architectural decisions and contributed to long-term technical roadmaps- Reviewed designs and code across the team, setting engineering standards and ensuring production-grade quality.• Key Achievements- Scaled the data ingestion pipeline to support thousands of brand locations across multiple countries with high reliability- Significantly reduced scraping failure rates by implementing structured retries, smarter error classification, and enhanced logging- Accelerated onboarding of new brands by creating reusable scraping patterns and integration playbooks.• Skills and Tools- Distributed background processing and job orchestration- Nokogiri, Ferrum (Headless browser automation)- Geospatial data systems (H3 indexing)- Agile delivery, technical discovery, and cross-team collaboration

Education

• Lakshmi Narain College of Technology, Kalchuri Nagar, Raisen Road, Post Klua, Bhopal-462021

  Bachelor of Engineering, Information Technology

  2016 — 2020