Tirth Hihoriya

About Tirth Hihoriya

Ambitious and result-driven engineer with a love for data and the wealth of information…

Experience

1. Software Engineer (Ml Ai)

   Aikitech, Inc

   Jul 2024 — Present · Scottsdale, AZ, US

   Innovated a cost-efficient LLM router system that dynamically routes 100K+ prompts to appropriate models.• Designed custom caching layers (Redis + vector store) for prompt deduplication and prefetching, reducing redundant LLM calls by 35% and cutting inference cost by 40%.• Implemented a lightweight monitoring agent in Rust with Prometheus endpoints, enabling real-time telemetry for 10+ system metrics (memory, CPU, threads, I/O), which improved uptime monitoring accuracy to 99.9%.• Optimized AWS API Gateway and Lambda network configuration, reducing cold-start latency by 700ms via smarter VPC integration, connection timeout tuning, and pre-initialized containers.• Fine-tuned LLaMA models using LoRA and QLoRA, reducing inference costs by 40% and latency by 30% on EC2.• Developed backend for web portal using FastAPI and AWS services, enhancing scalable integration of AI solutions.• Integrated Machine Learning Infrastructure for model deployment and monitoring; boosting efficiency by 30%.• Secured and optimized portal using AWS services like SageMaker, Bedrock, Lambda, EC2; achieving auto-scalability.

Education

• Nirma University, Ahmedabad, Gujarat, India

  Bachelor of Technology - BTech

• Arizona State University

  Master of Science - MS

  2022 — 2024