Chirag Agrawal
Software Engineer @ LinkedIn
- Role
- Software Engineer at Linkedin
- Location
- Bengaluru, KA, IN
- LinkedIn followers
- 500 followers
About Chirag Agrawal
As a Software Engineer at LinkedIn, I work on Big Data Platform, also worked on enhancing Content Abuse Infrastructure.Previously, I have worked as a Backend Engineer at an e-commerce startup Limeroad.com and as a full-stack developer at the gaming company Zynga.I graduated from IIT (BHU), Varanasi with a B.Tech in Computer Science and Engineering in 2013.
Experience
Software Engineer
Jan 2020 — Present
Big Data Platform - ComputeScaled YARN infrastructure to 40K+ nodes across 4 federated clusters (10+ PB aggregate memory, 6K+allocations at peak, 1M+ concurrently running containers)Designed and implemented a stateless routing service to distribute job submissions across federated YARNclusters; transitioned from splitting queues across all clusters to mapping subsets of queues to specific clustersto reduce fragmentation and better adhere to guaranteed capacity constraintsDesigned a queue-to-cluster mapping algorithm to improve resource utilization by 15%, and operationalized thealgorithm to reduce manual toilDesigned and built Universal Quota Manager (UQM) to transparently migrate workloads from YARN to Kubernetes while enforcing quota guarantees across both platformsProvides unified quota enforcement across heterogeneous backends (jobs submitted to YARN or Kubernetes)Implements scheduling features similar to YARN, including guaranteed capacity, priority scheduling, gangscheduling, elasticity, and preemptionCurrently manages traffic across 4 YARN clusters and 10 Kubernetes clusters in a single data centre, with ˜75% of production trafficrunning on KubernetesLeveraged UQM to support ML training workloads for frameworks such as MPIJob, PyTorchJob, RayCluster,and TensorFlowEnabled efficient GPU allocation via quota elasticity, improving peak GPU utilization by 50%Trust Engineering - Content Abuse InfrastructureBuilt offline reclassification framework to improve abuse/misinformation detection accuracyReduced false positives in moderation pipelines by 95%
Education
Indian Institute of Technology (Banaras Hindu University), Varanasi
B.Tech, Computer Science and Engineering
2009 — 2013
Skills
- Eclipse
- Software Development
- Mysql
- Ajax
- Unity3d
- Php
- Cakephp
- C++
- C
- Programming
- Java
- Linux
- Algorithms
- Javase
- C#
- Shell Scripting
- Ruby on Rails
- Javascript
- J2se
- Data Structures
- Git
- Core Java
Find verified contacts for anyone on LinkedIn
Unifers gives sales teams verified emails and direct dials, enriched profiles, and outreach that lands in the inbox.
Free plan included · No credit card required
This profile is compiled from publicly available professional sources. Unifers is not affiliated with or endorsed by LinkedIn. Request removal of this profile.