Consensus threshold

The required level of agreement before a review result is treated as sufficiently supported.

A rule may require m of n reviewers to agree, or use a defined tolerance on rubric scores. Panel size, participation requirements and agreement rules should be explicit. A stricter threshold can change how much work needs further review. Consensus supports a decision but does not prove that the agreed answer is correct.

In practice

One dataset may use two of three agreeing judgments; another may need a different panel and threshold.