Maadarani, A. (2026). Culinary Adjudication Measurement Science: Comprehensive Academic and Applied Textbook. IUOAMC Global Platform.
Within-Judge Consistency
Learning outcomes
After completing Within-Judge Consistency, the learner will be able to:
- define Within-Judge Consistency operationally and link it to a CJE;
- distinguish the effect of Repeat from the effect of Gap in a decision;
- build a record combining Stability and Validity without erasing first data;
- perform a controlled comparison specific to Within-Judge Consistency and explain its limits; and
- defend a traceable Within-Judge Consistency decision before a review panel.
Scientific definition
Within-judge consistency is the proximity of one person’s decisions when an equivalent event is repeated without disclosure of the relationship. It measures operational stability but does not alone establish correctness.
Within CAMS, Within-Judge Consistency is studied through judge performance as a human measurement source. The process fixes Repeat before the outcome appears, measures Gap inside a declared window, and documents Stability as a repeatable procedure. Validity determines how the result moves from observation to authorized decision. Description, score, and confidence remain separate, while raw values and every later transformation remain visible in the event record.
Operational structure
| Element | Function within CAMS | Verification question |
|---|---|---|
| Repeat | Establish the starting point or source | Was it defined before the outcome appeared? |
| Gap | Describe a factor capable of changing the decision | Was it measured independently? |
| Stability | Convert the concept into a repeatable procedure | Were essential conditions controlled? |
| Validity | Connect the outcome with authority and authorization | Can its evidence be retrieved? |
A Within-Judge Consistency result does not gain authority merely by being recorded. It becomes usable when Repeat is defined, Gap is measured independently, Stability is performed under reviewable conditions, and Validity is linked to retrievable evidence. If Repeat and Gap move together, the event is classified as composite and causal attribution waits for a test separating them.
Mind map
Applied case
A judge repeated a low score consistently for equivalent samples, but the criterion definition was wrong. The test showed stability without validity relative to the measured construct.
This case is read through three connected paths. The first establishes from the raw record what happened to Repeat; the second tests whether Gap changed independently; and the third examines the relationship between Stability and Validity through an appropriate comparison. The judgment is compared with baseline, hidden repetition, and confidence records before any movement is interpreted as strength or weakness. The explanation is authorized only if it remains valid after this separation; when two explanations survive, the discriminating test is specified instead of choosing by intuition.
Applied laboratory
Objective
Build a small Within-Judge Consistency protocol that another learner can repeat, showing how measurement moves from Repeat and Gap through Stability to a decision connected with Validity.
Laboratory design
Run three hidden repeats across a session, calculate gaps, and interpret them with time and order records.
Procedure
- Convert the definition of Within-Judge Consistency into an acceptance criterion fixing the location and limits of Repeat before results are viewed.
- Prepare the Within-Judge Consistency sample, code, and time window required to measure Gap without unintended disclosure.
- Run an independent Within-Judge Consistency baseline and close Stability, description, score, and confidence before discussion.
- Perform the comparison stated in the Within-Judge Consistency laboratory, changing one known factor connecting Repeat with Validity.
- Test within Within-Judge Consistency whether movement arose through judge performance as a human measurement source, and record at least one alternative explanation.
- Issue a reasoned decision to use, repeat, or exclude the Within-Judge Consistency result and identify the authorizing role.
Results card
| Event | Repeat | Gap | Stability | Validity | Confidence | Use decision |
|---|---|---|---|---|---|---|
| A | ||||||
| B | ||||||
| Repeat |
Practical assessment
The learner receives a subject file on Within-Judge Consistency containing conflicting measurements of Repeat and Gap, a partial record of Stability, and an initial decision whose connection with Validity is unclear. The learner reconstructs the event, separates usable from missing data, performs the test that distinguishes the strongest explanation, and reports the raw result, treatment, and authorization limits. An answer that erases an earlier value or attributes change to an uncontrolled factor is not accepted.
Assessment rubric
| Criterion | Weight |
|---|---|
| Accuracy and use limits of the Within-Judge Consistency definition | 15 |
| Integrity of controls for Repeat and Gap | 20 |
| Quality of Stability and raw-data registration | 15 |
| Validity of the test involving Validity | 15 |
| Interpretation within judge performance as a human measurement source | 15 |
| Completeness of this subject’s evidence chain | 10 |
| Professional and ethical defense of the decision | 10 |
| Total | 100 |
Core terms
- Repeat: the starting point that must be fixed when measuring Within-Judge Consistency.
- Gap: the factor tested as an explanation for movement in Within-Judge Consistency within judge performance as a human measurement source.
- Stability: the recorded procedure allowing the Within-Judge Consistency test to be repeated.
- Validity: the link between analysis of Within-Judge Consistency and the authorized decision.
Conclusion
Within-Judge Consistency adds a defined CAMS capability: it establishes Repeat, separates the effect of Gap, makes measurement of Stability repeatable, and prevents the Validity component from influencing authorization without evidence. Its value appears within judge performance as a human measurement source when raw observation is preserved and an independent reviewer can reconstruct the path from event to decision. Expertise in this subject thereby becomes teachable and auditable practice.
