Abhishek S.

Ai Generalist Evaluator Expert @Mercor

San Francisco, CA, US

Design detailed prompts and multi-constraint tasks to exercise model reasoning and instruction-following for frontier AI labs.Create, document and maintain evaluation standards and rubrics (major/minor criteria, grading guidelines).Run experiments, grade model outputs, and synthesize failure analyses into concrete remediation steps.Support QA and benchmarking by validating prompt/ rubric effectiveness before integration into production tests.Collaborate with product managers, data scientists, and annotators to refine tasks and scale evaluations.Produce concise reports and recommendations to improve prompt design, dataset quality, and evaluator training.

Humber Polytechnic

Postgraduate Degree, Cloud Computing

Indus University Ahmedabad

Bachelor's degree, Computer Science

Southern Alberta Institute of Technology (SAIT)

Professional certificate , Data science