Evan Carlson

About Evan Carlson

Senior AI Engineer building production AI systems at scale. Specializing in inference optimization, MLOps pipelines, and deploying LLMs in regulated environments.Key expertise:• Production AI optimizations (latency, model compression, observability).• End-to-end MLOps (monitoring, deployment, scaling).• Multilingual LLM systems and RAG architectures.

Experience

1. Senior Ai Engineer

   Hume Ai

   Jun 2024 — Present

   Led AI inference team for platform-wide model serving in multi-tenant, real-time Generative AI applications, improving E2E latency, observability, and reliability- Led the design and operation of CI/CD pipelines using GitHub Actions, Terraform IaC, Docker containerization, and Kubernetes/Helm for reliable LLM/TTS deployments, reducing model rollout time while maintaining 99.99% uptime- Leveraged AI-assisted tools for design, prototyping, implementation, code reviews, and testing. Integrated into CI/CD pipelines to catch issues early and accelerate deployments- Implemented PII redaction pipelines for sensitive datasets using NER models and regex masking before model training to ensure compliance for regulated data workflows- Led optimization of real-time voice AI systems to deliver a smooth, responsive user experience: reduced median TTFA 66.7%(1.2s to 400ms), E2E 25%(4s to 3s), worst-case TTFA 80%(30s to 6s) latencies- Architected benchmarking and observability stack (Prometheus dashboards, trend alerts) surfacing model drift/latency regressions for faster iterations- Improved text normalization and multilingual support for speech, expanding from 1 to 8 languages and cutting average WER from 54% to 6%, directly improving how agents and applications communicate with users- Expanded and optimized multilingual speech support from 1 to 8 languages while cutting WER from 54% to 6%- Used PyTorch profiling and NVIDIA Nsight to identify model bottlenecks and implement targeted optimizations while maintaining audio quality, reducing LLM latency by 35%.Technologies: AWS, Docker, GCP, Github Actions, Helm, Hugging Face, Kubernetes, NVIDIA Nsight, Prometheus, Python, PyTorch, TensorRT, Terraform, Triton Inference.

Education

• Western Governors University

  Bachelor’s of Science, Computer Science

  2018

• Georgia Institute of Technology

  Master of Science - MS, Computer Science

  2020 — 2022

Skills

• Networking
• Customer Service
• Microsoft Powerpoint
• Microsoft Word
• Transact-Sql (T-Sql)
• Software Installation
• Computer Hardware
• Windows
• Microsoft Excel
• Programming
• Information Technology
• Time Management
• Microsoft Office
• Sales