Rosalind Mcquay

About Rosalind Mcquay

Licensed property claims adjuster and quality auditor with 10+ years of TPA experience - now applying deep insurance domain expertise to AI evaluation, model quality assurance, and data annotation roles.WHAT I BRING TO AI EVALUATOR ROLES:My career has been built on the same core skills AI evaluation requires: reading complex outputs critically, identifying errors and inconsistencies, applying structured rubrics, and providing calibrated written feedback at high volume. Across 10+ years, I have reviewed 60-75 claim files per week - every one assessed for factual accuracy, regulatory compliance, logical consistency, and documentation completeness. That is AI evaluation work, applied to insurance.INSURANCE AI & CLAIMS AUTOMATION SME:I bring specialized insurance domain expertise that allows me to evaluate nuanced claims and policy outputs beyond generalist annotation workflows.RLHF & PREFERENCE RANKING:Ranking and comparing response quality is second nature to me. As a QA auditor, I routinely evaluate whether a claim decision was the best available option given the facts, flag where reasoning broke down, and document my rationale clearly - the exact workflow used to generate preference data for reinforcement learning from human feedback (RLHF).DATA ANNOTATION & LABELING:• High-volume QA review across complexinsurance files• Structured reasoning and ambiguityresolution• Consistent documentation accuracy under production deadlines• Comparative response evaluation and rankingCORE KEYWORDS: AI Output Evaluation | RLHF | Prompt Evaluation | Response Ranking | Human Feedback Review | Hallucination Detection | Ground Truth Verification | Claims Automation QA | Quality Assurance | Regulatory Compliance | SLA Monitoring | KPI Tracking | Remote Operations | Xactimate | XactAnlyasis | Guidewire ClaimCenter | HO-3 | DP-3 | UCSPA | First-Party Claims | Reserve Adequacy | Multi-State LicensingLICENSE: Georgia P&C Adjuster | Active & CE Compliant | Licensed in 16 StatesOpen to remote roles: AI Evaluator | AI QA Reviewer | Insurance AI SME | RLHF Annotator | Claims Automation Analyst

Experience

1. Quality Auditor / Property Desk Claims Reviewer

   Davis Claims Service

   Aug 2021 — Present · United States

   • Conduct structured QA reviews of high-volume claim files, evaluating accuracy, regulatory compliance, and documentation completeness - a workflow directly analogous to AI output evaluation • Managed end-to-end property claims operations for a remote TPA team, combining hands-on adjudication with team oversight and compliance monitoring. • Managed 60-75 homeowners and mobile home claims simultaneously from FNOL through resolution, applying HO-3/DP-3 policy interpretation and coverage analysis • Set and reviewed reserve adequacy, ensuring financial accuracy and carrier compliance across a multi-state caseload (16 states) • Monitored adjuster performance against SLA benchmarks and turnaround KPIs - analogous to monitoring AI model performance metrics and quality thresholds • Ensured Florida statutory compliance and UCSPA adherence across all claim decisions - the same regulatory reasoning skills needed to evaluate AI outputs in insurance contexts • Used Xactimate/XactAnalysis to evaluate estimates and verify claim data - including detecting AI-assisted estimate errors and scope discrepancies

2. Property Desk Claims Adjuster / Team Lead

   J&D Claims

   Apr 2022 — Dec 2024 · United States

   • Managed end-to-end property claims operations for a remote TPA team, combining hands-on adjudication with team oversight and compliance monitoring. • Managed 60-75 homeowners and mobile home claims simultaneously from FNOL through resolution, applying HO-3/DP-3 policy interpretation and coverage analysis • Set and reviewed reserve adequacy, ensuring financial accuracy and carrier compliance across a multi-state caseload (16 states) • Monitored adjuster performance against SLA benchmarks and turnaround KPIs - analogous to monitoring AI model performance metrics and quality thresholds • Ensured Florida statutory compliance and UCSPA adherence across all claim decisions - the same regulatory reasoning skills needed to evaluate AI outputs in insurance contexts • Used Xactimate/XactAnalysis to evaluate estimates and verify claim data - including detecting AI-assisted estimate errors and scope discrepancies

3. Property Desk Claims Adjuster

   Best Claims Solutions

   Aug 2016 — Apr 2022 · United States

   • Managed high-volume claim caseloads while maintaining documentation accuracy and SLA compliance in fully remote environments • Investigated documentation discrepancies and coordinated resolutions - building the systematic error analysis skills central to AI evaluation work • Escalated complex or ambiguous claims using structured reasoning and policy expertise

4. Insurance Verification Processor

   Assurant

   Aug 2007 — Jun 2015 · United States

   • Verified insurance documentation and policy data for accuracy and compliance, maintaining high-volume throughput with consistent quality standards

Education

• University of Central Arkansas

  Bachelor of Science · Mass Communication/Media Studies

  1998 — 2004

Skills

• First-Party Property Claims
• Reserve Setting
• Quality Assurance
• Claims Auditing
• Guidewire ClaimCenter
• AI Output Evaluation
• Regulatory Compliance
• Reinforcement Learning Human Feedback (RLHF)
• Xactimate
• Data Maintenance
• Remote Operations
• AI Model Review
• Coverage Analysis
• Data Annotation
• UCSPA Compliance
• XactAnalysis
• Vendor Management
• Adjuster Training
• Artifical Intelligence Evaluation
• TPA Operations
• SLA & KPI Management
• Rubic-Based Evaluation
• Quality Control
• Multi-State Licensing
• Quality Assurance Analysis