Content Evaluator
Generalist Evaluator Expert
Hourly Contract | Remote | $35–$40/hr
Posted by Hire & Fly
About the Role
Hire & Fly is looking for detail-oriented, curious, and creative thinkers to join a cutting-edge AI research project. As a Generalist Evaluator Expert, you’ll help train and test advanced AI language models by creating and evaluating prompts and responses. This is a short-term, flexible, remote opportunity—perfect for new grads who enjoy writing, problem-solving, and turning complex ideas into clear, structured text.
You’ll gain hands-on experience with AI, contribute to meaningful research, and work on a project that impacts how AI understands and communicates.
What You’ll Do
Create Prompts: Design clear, detailed prompts with instructions for AI models.
Evaluate Responses: Develop evaluation criteria and grade AI outputs to ensure accuracy and quality.
Support Testing & QA: Help review prompts and responses, ensuring tasks are consistent and reliable.
Document Your Work: Keep clear notes and rubrics for benchmarks and future project use.
What We’re Looking For
Minimum Qualifications:
BS or BA completed or in progress from a recognized college/university.
Strong writing, critical thinking, and attention to detail.
Ability to work independently and meet deadlines.
Familiarity with ChatGPT or similar AI tools for personal projects or hobbies.
Based in the US or Canada.
Preferred Qualifications:
Experience with teaching, tutoring, or research.
Comfortable creating structured guidelines or rubrics.
Why This Role Is Great for New Grads
Fully remote and flexible—work on your own schedule.
Gain hands-on experience with AI and language model evaluation.
Structured project with clear goals—ideal for learning while contributing.
Commit around 20 hours per week for about 1 month.
How to Apply
Complete a short AI-led interview (~15 minutes).
Complete a 45-minute written assessment to guide you through creating rubrics.
If selected, start contributing to an exciting AI research project.