LLM-as-a-Judge
Technique using a large language model as an evaluator
LLM-as-a-Judge
LLM-as-a-Judge (also LLM-based evaluation or language model-based evaluation) is a technique in natural language processing in which a large language model (LLM) is used to assess the quality, relevance, or correctness of a text output, typically one generated by another model, against predefined criteria. It is used as a scalable, lower-cost alternative to human annotation and to reference-based metrics such as BLEU and ROUGE, which measure word overlap rather than meaning.
Read on Wikipedia · Image AMA2210, CC0
Open boosters, collect cards and trade them. Free to play.
Play for free