Rohan Singh

About Rohan Singh

Currently working as Backend Engineer and AI Lead @Chat360. Helping automate…

Experience

1. Backend Engineer

   Chat360

   Aug 2023 — Present · Pune, IN

   Backend Development & Scalable Infrastructure• Built scalable APIs, background workers, and application features using Django for the conversational AI and marketing platform integrating with Whatsapp business API, CRMs and other third party tools.• Implemented NGINX routing rules to host a monolithic Django application in a microservices-style deployment, combining the agility of monolith projects with the scalability of microservices. Distributed the application into 18 different services.• Implemented a Master-Slave SQL database architecture, shifting read queries to replicas, scaling system capacity from 10K to 100K concurrent chats.• Architected an end-to-end AI chatbot system, including Retrieval-Augmented Generation (RAG) chatbots (Hybrid and Graph Search), zero-shot intent classification, and entity recognition with < 1s latency.• Developed an in-house LLM Orchestrator and NLP engine to enable agentic capabilities, such as Function Calling, SQL/API integrations, and context-aware follow-up queries.• Scaled the new AI platform to serve 15+ enterprise customers and 50+ SMBs.• Implemented guardrails for AI safety and reliability through prompt engineering and classification models on 10+ indicators.Production Support & CI/CD• Handled on-call responsibilities for all production issues and release management.• Designed and maintained a CI/CD pipeline for seamless server updates, introducing a single-command deployment system that reduced deployment time from 1 hour to 5 minutes.• Managed Linux servers, including updates, troubleshooting, and system optimization with expertise in performance tuning and issue resolution.Cloud Security & Optimization• Secured AWS resources, including S3, by enforcing restricted bucket access and ACLs, and implemented pre-signed S3 URLs across the codebase.• Enhanced application and infrastructure security to achieve SOC2 and ISO 27001 compliance, including updating security configurations, tools, and defining process