Domain Advisor Consultant (Subject Matter Expert)

The Domain Advisor Consultant (Subject Matter Expert) role is a remote, independent contractor position with Invisible Agency, focusing on high-impact AI evaluation and training projects. This opportunity is designed for established authorities in their respective fields who are eager to apply their deep domain knowledge to shape the reasoning, accuracy, and safety of next-generation Large Language Models (LLMs).

Key responsibilities include reviewing and advising on quality criteria used to evaluate AI outputs, creating and certifying benchmark examples for model training, analyzing model failures to provide technical breakdowns, and consulting on the complexity and nuance of specific prompts to ensure rigorous testing scenarios.

Candidates should possess advanced degrees or equivalent industry-recognized status, operate as independent consultants or freelancers with their own workflows and equipment, and have the ability to articulate reasoning processes clearly in writing. While prior experience in AI evaluation is a bonus, it is not required.

This is a project-based, non-exclusive engagement allowing flexibility in completing deliverables. Consultants provide their own workspace and equipment and must be properly registered to operate as independent contractors in their country of residence.

Partnering with Invisible Agency offers intellectual challenges that involve deconstructing one's own expertise to train AI models, the opportunity to directly influence the safety and capability of models used by millions, and a flexible revenue stream to supplement primary consulting businesses.