Search Quality Evaluator

Search Quality Evaluator (AI Training)

About The Role

What if your everyday internet savvy could directly influence how AI finds, ranks, and presents information to millions of people? We're looking for Search Quality Evaluators to assess search engine results, AI-generated answers, and content recommendations — helping ensure that AI systems surface accurate, relevant, and genuinely useful information.

This is a fully remote, flexible contract role open to anyone with sharp critical thinking and a good instinct for what makes a search result actually helpful. No technical or AI background required — just a reliable internet connection and a commitment to thoughtful, consistent evaluation.

• Organization: Alignerr
• Type: Hourly Contract
• Location: Remote
• Commitment: 10–40 hours/week
  
  

What You'll Do

• Evaluate search engine results for relevance, accuracy, and overall usefulness to real users
• Rate AI-generated answers and content recommendations using structured evaluation rubrics
• Compare multiple results side by side and rank them by quality
• Provide clear, concise written explanations for your ratings and judgments
• Work through task-based assignments independently at your own pace
• Cover a wide range of topics — from everyday queries to specialized subjects across science, culture, news, and more
  
  

Who You Are

• Comfortable using search engines and navigating the web with confidence
• Able to assess content relevance and quality objectively and consistently
• Detail-oriented with a systematic, methodical approach to evaluation tasks
• Strong written communication skills in English
• Self-motivated and reliable when working independently
• No prior AI, tech, or search industry experience required
  
  

Nice to Have

• Background in research, journalism, library science, or content evaluation
• Experience with quality assurance, fact-checking, or critical analysis
• Familiarity with AI tools or search platforms as a regular user
• Broad general knowledge across a variety of subject areas
  
  

Why Join Us

• Work on cutting-edge AI projects alongside leading research labs
• Fully remote and flexible — work when and where it suits you
• Freelance autonomy with the structure of meaningful, task-based work
• Contribute directly to AI development that shapes how the world finds information
• Potential for ongoing work and contract extension as new projects launch