Glossary
LLM as a judge
Also: LLM-as-judge · model-based grader
Grading an agent's output with another model against a rubric. More flexible than code, cheaper than a human, but it needs checking itself.
Example
A judge model scores an answer on accuracy, citations and completeness.
Where it shows up
- What you need to have an AI agent of your own — Post 6 of 8