AI QA Trainer - Freelance Project

As an AI QA Trainer, you will play a pivotal role in enhancing the reliability and reasoning capabilities of advanced language models. This freelance position offers the opportunity to work remotely, collaborating with a team dedicated to refining AI systems that are transforming education, research, and professional workflows.

Your primary responsibilities will include evaluating model outputs for factual accuracy and logical coherence, designing and executing comprehensive test plans, and developing clear evaluation rubrics. Additionally, you will document failure modes, propose improvements to prompt engineering and guardrails, and participate in adversarial testing and automation to monitor quality metrics over time.

The ideal candidate will possess a bachelor's, master's, or PhD in computer science, data science, computational linguistics, statistics, or a related field. Experience in quality assurance for machine learning or AI systems, familiarity with test automation frameworks, and proficiency in tools such as OpenAI Evals or RAG evaluators are highly desirable. Strong skills in evaluation rubric design, adversarial testing, regression testing, bias auditing, and prompt engineering are essential. Clear and reflective communication is crucial for success in this role.

Compensation for this position ranges from $6 to $65 per hour, depending on experience, expertise, and geographic location. As a contractor, you will need to provide a secure computer and high-speed internet connection. Please note that company-sponsored benefits such as health insurance and paid time off do not apply to this role.

This role offers the chance to contribute significantly to the development of AI systems that have a global impact. By joining our team, you will be at the forefront of AI quality assurance, working in a dynamic environment that values innovation and continuous improvement.