Rohin Sandhu

About Rohin Sandhu

Backend Engineer building real-time AI systems at scale. 3+ years delivering production systems on AWS serverless architecture.What I\'ve built recently- Real-time AI voice streaming system on WebSocket + Lambda + SQS, replacing EC2 architecture that caused P0 incidents. Reduced infrastructure costs by 80-90%- Audio fragmentation protocol to overcome AWS 32 KB frame limits, delivering instant text (<50ms) with smooth TTS audio- NLP sentence boundary detection for Text-to-Speech, handling decimals, abbreviations, URLs across ElevenLabs, Deepgram, and Polly- LLM-powered conversation systems with OpenAI GPT-4 and Anthropic Claude integration.Impact- Extended Bank of America contract through independent delivery (recognized by CPO)- Rated 5/5 Significant Contributor across all performance reviews- Led PHP/Flask to FastAPI migration, reducing API latency by 70%- Executed high-risk Optum-Chase enterprise migration with zero disruption.Tech: Python, FastAPI, AWS (Lambda, API Gateway, SQS, S3, ElastiCache, Polly), WebSocket, Redis, MySQL, Kafka, OpenAI GPT-4, Anthropic Claude, ElevenLabs, Deepgram, Docker, PytestOpen to conversations about backend engineering, real-time systems, AI/LLM integration, and serverless architecture.

Experience

1. Software Engineer-ii

   Zenarate

   Jan 2025 — Present

   Real-Time AI Voice Streaming System (WebSocket + Serverless)- Architected serverless real-time WebSocket system (Lambda + SQS + API Gateway + Redis) for AI voice conversations, replacing EC2 architecture that caused multiple P0 incidents- Designed async processing pattern bypassing 29s API Gateway timeout, reducing infrastructure costs by 80-90% vs EC2/ECS- Built text-first audio fragmentation protocol overcoming 32 KB WebSocket frame limit with instant text display (<50ms)- Developed 7-layer NLP sentence boundary detection for TTS and LLM markdown-to-speech preprocessing- Owned end-to-end delivery of GEN-AI Workbench, Scorecard, and Fast Authoring across 3 codebases. Reduced training cycle by 70%.Rating: 5/5 Significant Contributor

Education

• Lovely Professional University (LPU)

  Master of Business Administration - MBA, Data Science and Business Analytics

• RBGI - Rayat Bahra Group of Institutes

  Bachelor of Technology - BTech, Computer Science