Akash Medi

About Akash Medi

10+ years of Insightful experience in Azure/AWS Cloud, DevOps Engineering…

Experience

1. Senior Azure Devops Engineer

   T-Mobile

   Apr 2024 — Present · Bellevue, WA, US

   T-Mobile is one of the leading mobile carriers in the U.S. As a Senior DevOps Engineer at T-Mobile, I drive the integration of software development and IT operations, leading efforts to streamline processes, foster collaboration between teams, and implement best practices to ensure robust, and high-performance solutions.• Design, deploy, manage & maintain Kubernetes clusters on AWS Cloud for high availability, scalability, and performance of the Kubernetes infrastructure for multiple environments.• Created AWS Infrastructure using VPC, EC2, S3, Route 53, EBS, Security Group, Auto Scaling, and RDS in Cloud Formation and Terraform. • Experience with building or using benchmarking tools for evaluating LLM inference for various models, engine, and GPU combinations.• Led the integration of GitLab CI/CD with R-based statistical projects, ensuring efficient testing, packaging, and deployment of validated analytics code in a GxP environment.• Used Kubernetes to create Pods, Config Maps and deployments into the cluster. • Worked on integrating GIT into the continuous Integration (CI) environment along with Jenkins. • Troubleshot and resolved production incidents involving GPU cluster failures / resource starvation / memory leaks; conducted post‑mortems, applied root‑cause fixes, and created preventive monitoring or autoscaling rules to avoid recurrence.• Set up and optimized GPU-based Kubernetes clusters for AI/ML workloads using NVIDIA device plugins and node selectors, enabling efficient LLM training and inference pipelines.• Implemented autoscaling GPU workloads on Kubernetes using custom metrics and KEDA (Kubernetes Event-Driven Autoscaler), reducing idle GPU time by 40%+.• Integrated ML pipelines into CI/CD workflows, automating model versioning, containerization, and deployment using MLflow and KServe (or similar tools) on Kubernetes.• Experience with AMD and NVIDIA GPUs, using software like CUDA, ROCm, AITER, NCCL, RCCL, etc.

Education

• Trine University

  Master's degree, Information Science/Studies