Shivakumar Appadurai

About Shivakumar Appadurai

18+ years of progressive experience in software engineering and technology leadership, currently serving as Sr. Vice President at JPMorgan Chase & Co. — one of the world\'s largest financial institutions. AI Engineering & AI Platform: Hands-on architect of enterprise-grade Generative AI (GenAI) and LLM platforms on Azure OpenAI Service and Azure Cognitive Services, enabling data scientists across all Lines of Business to build, fine-tune, and deploy large language models at scale. Azure Cloud Architecture: Deep expertise in cloud-native infrastructure on Microsoft Azure — Azure Logic Apps, Key Vault, Storage Accounts, API Management, Event Hub, and Terraform-based Infrastructure as Code (IaC). Microservices & Backend Engineering: Strong foundation in building distributed, high-throughput microservices using Java and Spring Boot — extensive experience in resilient, event-driven service architectures processing millions of transactions daily across Investment Banking and Asset Management domains. Investment Banking Domain: Designed and delivered Newton — a Spring Boot and Kafka-based distributed task orchestration platform — adopted across Fund Accounting, Hedge Fund, Financial Reporting, and Transfer Agency Lines of Business at JPMorgan Chase. AI Automation & Engineering Practices: Led adoption of LLMOps and MLOps practices including AI workflow automation, RAG pipelines, vector database integration, model versioning, and A/B testing of LLM variants in production environments. Engineering Leadership: Seasoned people leader with a track record of building, mentoring, and scaling high-performing engineering teams of 15–20+ engineers; drives Agile delivery, OKR-based goal setting, and a culture of excellence through design reviews and blameless retrospectives. Strategic & Cross-functional Influence: Partners with global stakeholders across US, UK, and APAC to define AI platform roadmaps, align technical strategy with business priorities, and accelerate enterprise-wide AI adoption across multiple Lines of Business.

Experience

1. Senior Vice President

   JPMorganChase

   Feb 2025 — Present · IN

   Hands-on engineering leader responsible for architecting, building, and operating the Azure-based LLM Platform and Java Spring Boot microservices powering JPMorgan Chase\'s enterprise AI/ML initiatives across global Lines of Business. Platform Architecture: Architected and delivered a scalable, enterprise-grade LLM Platform on Azure, enabling data scientists across all JPMorgan Chase Lines of Business (LOBs) to access, fine-tune, and deploy large language models securely.LLM Infrastructure: Designed and built multi-tenant LLM infrastructure leveraging Azure OpenAI Service, Azure Cognitive Services, Logic Apps, Key Vault, and Storage Accounts — achieving 99.9% platform availability and sub-300ms P95 latency at scale.AI Evaluation: Developed Python-based LLM evaluation scripts and model observability pipelines to track response quality, token usage, latency, and model drift — enabling data-driven decisions on model upgrades and fine-tuning cycles. Microservices Engineering: Hands-on engineered Java Spring Boot microservices to expose LLM capabilities as secure, versioned REST APIs, enabling seamless integration by 20+ downstream product teams across Investment Banking, Asset Management, and Retail Banking.Security & Compliance: Implemented a secure, policy-compliant LLM gateway with token-level access controls, PII redaction pipelines, and audit logging, meeting stringent financial-grade security and regulatory requirements. Team Leadership: Built and led a high-performing team of 15+ engineers; drove Agile practices, OKR-based planning, and engineering excellence programs including design reviews, blameless post-mortems, and structured on-call rotations. DevOps & Automation: Reduced LLM model deployment cycle time by 60% by introducing automated CI/CD pipelines using Azure DevOps, Terraform-based IaC, and containerized model serving with blue-green deployment strategies.

Education

• SIES

  Bachelor of Science (B.Sc.), Mathematics

  2003 — 2006

• Mumbai University Mumbai

  Bachelor of Science, Mathematics

Skills

• Hibernate
• Jpa
• Javascript
• J2ee Application Development
• Richfaces
• Servlets
• Core Java
• Infragistics
• Java
• Struts
• Web Services
• Ajax
• Jboss Seam
• Requirements Analysis
• Jsp
• Oracle 9i
• Jsf
• Eclipse
• Tomcat
• Netbeans
• Jta
• Jfreechart