Skip to content
evaluation

Generalist Expert

Remote — Austria$50 - $70/hour1 openings

About this role

Generalist Expert – AI Model Evaluation

Contract · Remote · United Kingdom or Europe

Annual Compensation Equivalent: $104,000–$145,600/year
Hourly Rate: $50–$70/hour

About the Role

This remote contract opportunity is for generalist professionals who can evaluate the quality, accuracy, clarity and completeness of everyday professional work.

You will review documents, presentations, spreadsheets and other written materials, assess AI-generated outputs against defined criteria, and provide clear written feedback. Your evaluations will help improve how AI systems understand, reason about and produce real-world professional content.

This role is well suited to detail-oriented professionals who are comfortable working across different subject areas and formats. Deep specialization in a single field is not required; strong judgment, careful reading and clear written reasoning are the primary skills.

What You'll Do

  • Review documents, presentations, spreadsheets and similar professional materials for quality, accuracy and completeness

  • Evaluate whether content is clear, consistent and logically sound

  • Provide concise, well-reasoned written feedback and ratings

  • Compare AI-generated outputs against defined evaluation criteria

  • Identify factual errors, inconsistencies, omissions and gaps in reasoning

  • Assess formatting and presentation quality where relevant

  • Apply evaluation guidelines consistently across different types of content

Requirements

  • Bachelor's degree or higher

  • Currently based in the United Kingdom or Europe

  • Excellent English reading comprehension

  • Strong written communication skills in English

  • Strong attention to detail and sound professional judgment

  • Ability to evaluate varied subject matter without relying on deep specialization in one discipline

  • Comfortable working independently with common productivity tools, including documents, presentations and spreadsheets

AI Experience

Prior artificial intelligence or machine-learning experience is not required.

Guidelines and relevant context will be provided to help you perform the evaluation work consistently.

Compensation & Engagement

  • Hourly rate: $50–$70/hour

  • Annual compensation equivalent: $104,000–$145,600 based on 40 hours per week, 52 weeks per year

  • Actual earnings depend on hours worked and available project assignments

  • Independent contractor engagement

  • Fully remote

  • Flexible schedule

  • Projects may be extended, shortened or concluded early depending on project requirements and performance

Payment & Other Terms

  • Payments are made weekly through Stripe or Wise based on services rendered

  • The work does not require access to confidential or proprietary information belonging to an employer, client or institution

  • H-1B and STEM OPT candidates are not currently supported

  • Fully remote contract role open to candidates in Austria.
  • Compensation: $50 - $70/hour, paid in USD.
  • Vetted and managed by Recruitment Room — no placement fees for candidates.
  • Flexible hours; part-time and full-time engagements available.

More evaluation roles

Start free — no card needed

50+ tailored applications a day

Start Free