Evaluate

Evaluators do two things. Publish a scoring adapter for a family of intents: it replaces the live scorer only when it beats the incumbent on a hidden sample by the replacement margin. Or contribute the evaluation material those adapters are tested on. Both earn evaluator rewards.