Key Responsibilities

• Review and assess model-generated code for correctness, efficiency, and compliance with requirements.
• Perform quality control on debugging and code-fixing tasks, identifying and documenting errors or inconsistencies.
• Stress-test AI models with a variety of prompts and test cases, benchmarking against competitors.
• Deliver structured, written feedback and insightful reports on model performance to drive continuous improvement.
• Collaborate remotely with cross-functional teams, sharing findings and participating in knowledge exchange.
• Apply strong analytical skills to annotate and evaluate code outputs, maintaining a high standard of quality.
• Contribute to the technical evaluation process by critiquing code and model decisions, rather than developing new systems.

Required Skills and Qualifications

• 2–5 years of hands-on coding experience (junior to mid-level), especially in Python, SQL, React, and Node.js.
• Deep understanding of software development principles and best practices.
• Proven ability to review, debug, and critique code critically with a keen eye for detail.
• Experience with AI model training, machine learning concepts, and prompt engineering.
• Strong analytical, written, and verbal communication skills, essential for remote collaboration and technical reporting.
• Motivated by annotation, evaluation, and quality control work rather than system building.
• Adaptable and proactive in a fast-changing, innovative environment.

Preferred Qualifications

• Experience with large language models or similar AI technologies.
• Background in technical writing or report generation.
• Familiarity with model benchmarking and performance evaluation methodologies.