Debate Judges' Manual(2008)
The National High School English Debate Tournament
1. What Judges Should Always Keep in Mind
Debate judges should always keep in mind that you are not only judging but you are also teaching the students through that process. To accomplish this, always keep the following three basic
principles in mind.
FAIRNESS: Always try to be fair. Needless to say, never take other personal attributes such as nationality, sex, appearance, school-name, school-location, etc. into account. Winners should be
decided by the debaters' performances within the round you're judging. Don't be bothered by any other previous information.
OBJECTIVITY: Don't make decisions by hunches or feeling. Try to be rational and objective. Namely, never cast a ballot unless you clearly know the reason why you've decided team A is better than
B.
ACCOUNTABILITY: Make the students understand your reason for decision. At the same time always try to cheer them up! Find good points in both teams and make them feel good.
2. How to Decide the Winner
Winner of the round should be decided by comparing
the outcome of the ISSUES of both teams. In short, if you are convinced that supporting the proposition gives more Advantages(ADs) than Disadvantages (DAs), you vote for the Affirmative side
(AFF). If you are convinced otherwise that the DAs outweigh the ADs, then you vote for the Negative side (NEG). NO TIES; pick a winner even if you think it's not possible! (In extreme rare cases,
neither AFF/NEG issues were convincing enough to vote for. In such case, it is presumed that the proposition is not true, so vote for the NEG.) Each judge should decide the winner independently
without consulting the other judges.
Always take notes ("flows") during the round. Pay attention to the proof and disproof of each issue (AD and DA). After the round, follow the next procedure and fill in the "DECISION MAKING CHART"
to make your decision.
1.List the issues that were extended: How many ADs and DAs were presented, and how many of them were defended and mentioned in the final stage? Write down the titles (tag-lines). The
issues should be properly presented following the tournament rules: Maximum number of ADs and DAs should not exceed two. (Ignore the "AD3"s and "DA4"s!) Don't count new arguments after the
constructive speech.
2.Judge the probability (evidential support) of each issue: First consider how convincing the alleged "ADs" or "DAs" were in terms of factual probability. Especially, you should look
back at the strength of the proof (evidence) provided within the round. Weigh them lightly if the causal relation between the plan (proposition) and the ADs or the DAs are not supported by
evidence. Also diminish the probability, if the opponent's attacks were successful, or the defenses were poor.
3.Judge the value (significance) of each issue: Next consider the importance of each alleged "AD" and "DA". What is the value at stake? How much impact will the "DA" bring in terms of
quantity and quality? Unless the value mentioned in an issue is explained well by the debaters themselves, don't weigh such issue as significant (Even if you yourself think it's important). Note
here that values can be sometimes "flipped" by the opponent's good arguments. (For instance, AFF might argue that "gaps are bad". However NEG might "flip" the issue by arguing that "gaps are
rather welcome". Compare the reasons supporting both claims. If you think the NEG value assessments were convincing, then the alleged "AD" should rather be treated as a "DA". )
4.Judge the strength (=multiply probability and value) of each issue: Multiply the above probability (2.) and value (3.) for each remaining ADs and DAs. Note here that "ADs" and "DAs"
should not be regarded as "strong" unless both their probability and their value are effectively proven and defended.
5.Compare the net sum of the issues: Sum up the strength of the ADs and consider if it outweighs the strength of the summed-up DAs. If the ADs outweigh the DAs then AFF wins, else the
NEG wins.
Try to avoid your own point of view coming in. Recollect the latter stage speeches (summary) of the debaters. If a team has explained the "value criteria" for deciding whether the ADs outweigh
the DAs, such debater's "criteria" should be used to determine the winner. (For example, AFF insisted that "each child should have enough math ability" but NEG argued that "children's
individuality should have priority". Which is more important? Such comparison should be done by the debaters themselves. A good AFF summary may present a "value criterion" insisting that their
plan can meet the necessary "
civil minimum" concerning "math ability", and the value of such necessary ability outweighs the vague "individuality" value. If the NEG can not present a counter-criterion, a judge should decide
in favor of the AFF). In some debates, neither team is able to present such value criterion effectively. In that case, a judge should compare the ADs and the DAs rationally, using one's own value
judgments.
EXAMPLE: DECISION MAKING CHART
1. List of issues
|
2. Probability × 3. Value (Impact) = 4. Strength
|
Advantage 1 Math & Science
|
Hi / Lo No proof: why
math
scores will improve
|
Large / Small well defended:
necessary for economy
|
Strong / Weak / None
Very little AD
|
Advantage 2 Gap Private/Public
|
Hi / Lo Well defended.
Gap will be narrowed
|
Large / Small Need more
explanation
why gaps are bad
|
Strong / Weak / None A Little AD
|
Disadvantage 1
Teacher's Burden
|
Hi / Lo
Only little increase:
AFF attacks were
good
|
Large / Small No explanation of the
significance
|
Strong / Weak / None Close to none
|
Disadvantage 2
Free Time
|
Hi / Lo
Not defended
|
Large / Small
Not explained
|
Strong / Weak / None Forgotten by the NEG
|
5. Compare the net sum of the issues:
○
|
AFF won: If AD 1 + AD 2> DA 1 + DA 2
|
|
NEG won: If DA 1 + DA 2≧ AD 1 + AD 2
|
Your VOTING ISSUE was:
|
AD2: I am convinced that the Gap will be solved a little. Since other DAs are not well defended, I will vote AFF for this AD2
|
3. Instructions / Interruptions during the Debate Round
Basically, judges should leave the debate to the debaters and not intervene in it. However, for educational purposes, do
interrupt the speeches in the following exceptional cases: A) SPEECHES are unintelligible (not loud enough, etc.) B) QUESTIONS and ANSWERS are extremely anomalous. C) Speeches are interrupted by
NOISE (Chatting, pen-clicking, etc.)
4. Communication Points
Each judge should rate the "communication points" of each team using the following scale. The points should reflect the team's communicating ability with the judges, opponents, and the audience.
5 & 1 should be rare. (Only Integers. No 0.5s)
5
|
Excellent
|
Every speech was easy to follow (adequate speed, elocutions etc.). And every team member was successfully communicating with the audience (good eye-contacts, gestures, good
manners, etc.)
|
4
|
Good
|
Most of the speeches had no problem in following. And most of the team members were effectively communicating with the audience.
|
3
|
Average
|
Though with some exceptions, the speeches were basically easy to follow. Majority of the members had no problem in communication.
|
2
|
Below Average
|
Speeches were quite often hard to follow. Lack of audience communication can be found often.
|
1
|
Poor
|
Most of the Speeches were hard to follow. None of the team members were communicative.
|
NB: The winner may have lower communication points (The points are mainly for tie-breaking purpose to select the winners of the preliminary rounds). If a team (or its member) does not
obey the judge/chairperson's instructions, being rude, or obstructing the opponent's speeches, you can subtract some points for PENALTY.
5. Best Debater
Each judge should choose the best debater of each round. Pick the single most valuable debater of the round (The debater that most contributed to the output of
the debate round should be picked. Not necessarily the most eloquent.)
6. To Avoid Common Misunderstandings
1.Don't add your own issues, attacks… Leave the job to the debaters. Don't add any ADs/DAs or attacks yourself!
2.Issues that are extended (not forgotten in the latter part of the round) should count: Constructive speeches are just written down speeches. You shouldn't weigh the issues too much, unless they
are defended and summarized effectively afterwards.
3. "New arguments" are prohibited: All the ADs and DAs should be presented in the Constructive Speech. Last minute "surprise attacks" especially in the summary speeches should never be
counted.
4.Don't judge the winner by comparing the "speeches": A bad reason for decision typically goes like this: "I'll vote NEG, as I think the NEG Q/As and Attacks were wonderful. I thought the other
speeches were even." (Judges should compare the finally defended ADs/DAs. Even if the Q/As were superb, the team can be terribly unconvincing at the end!)
5.This is not a Parliamentary Debate tournament: "point of information" is prohibited. Never decide winners using subjective "speech points". Usage of evidence is to be encouraged not
discouraged.
6.This is not a Recitation contest: Don't decide the winners by English fluency, accents, intonation, eye-contacts, etc. Rational contentions should count more than just superficial
eloquence.
7.Distinguish "decision making" and "advices": When deciding the winners, a judge shouldn't add/attack the issues themselves, nor should they weigh English fluency too much. However, advices on
these points are precious. Apart from the decision making, advices on the unmentioned "fallacies" or on English skills would be more than welcome.
Debate Judges’ Manual(2006)
The National High School English Debate Tournament
1. What Judges Should Always Keep in Mind
Debate judges should always keep in mind that you are not only judging but you are also teaching the students through that process. To accomplish this, always keep the following three basic
principles in mind.
FAIRNESS: Always try to be fair. Decide winners only by the debaters’ performances within the round you’re judging.
OBJECTIVITY: Don’t make decisions by hunches. Never cast a ballot unless you clearly know the objective reason for decision.
ACCOUNTABILITY: Make the students understand your reason for decision.(At the same time always try to cheer them up!)
2. Judging Standards
In this tournament, winner of the round should be decided by comparing the outcome of the arguments of both teams. No ties; always pick a winner! Specifically, since the debate is on governmental
policy proposition, if the proposition has more merits than the demerits, you vote AFF and vice versa. (If you have judged in other debate tournaments, see Section 6. below for the difference).
Three warnings for novice judges:
(1) Don’t add your own issues. Make decisions only by the debaters’ arguments that are properly presented within the debate format: Debate judges should judge the debaters’ arguments (and their
counter-arguments). Don’t add any advantages/disadvantages yourself! Presenting “new arguments” (new merits/demerits) in the attacks, defense, summary speech are forbidden by the rules. Ignore
them if they are presented.
(2) Only the issues that are extended (not forgotten in the summary speech) counts: Even if a team sounded better than the other in the early stage of debate, that shouldn’t be taken into your
decision if they screwed up in the latter stages. As you will soon see, in most of the debates, earlier stages are just recitation of some prepared scripts. If the students can’t properly defend
and summarize their own issues, those issues should be taken lightly in your decision.
(3) Distinguish “reason for decision” and “advices”: As mentioned above, don’t add your own issues in your decision. However, in your advices after the round, teaching the students about such
hidden “issues” would be very helpful.
3. Process of Judging
In sum, judging a policy debate is like policy making itself. Just imagine yourself as a rational voter for a national policy referendum, and you are going to vote according to, and only
according to the issues that are raised by each opposing party. The following 5 steps might help you to make fairer and more objective decisions.
①List the issues that were extended: How many merits (advantages) and demerits (disadvantages) were presented, and how many of them were defended and mentioned in the final stage. Write down the
titles (tag-lines)
②Judge the probability of each issue: How convincing were the alleged “merits” in terms of factual probability? Weigh them lightly if the opponents attack was successful, or the defense was poor,
or there wasn’t much explanation even in the Constructive speech on why the plan can really gain such “merits”. Do the same thing to each alleged “demerit” too.
③Judge the value (significance) of each issue: How important is the alleged “merit”? What is the value at stake? How much impact will the “demerit” bring in terms of quantity and quality? If the
value mentioned in an issue is not well explained by the debaters, don’t weigh such issue as significant. Values can be sometimes “flipped” by good opponents. (In debate jargons, “turnarounds”:
For example, AFF might argue that the plan brings in a lot of tourists from abroad and it’s good. However NEG might “flip” the issue by arguing that the increased tourists may increase the risk
or terrorism.
④Judge the strength(=multiply probability and value) of each issue: Multiply the above ②probability and ③value for each remaining merits and demerits.
⑤Weigh ④the strength of AFF and NEG issues on a scale: Sum up the strength of the AFF plan’s merits and consider if it outweighs the strength of the summed-up demerits. If merit outweighs the
demerits then AFF wins, else the NEG wins.
Being fair in weighing the issues might not be easy. Try to avoid being subjective in the first place. Recollect the latter stage speeches (summary) of the debaters. If a team has explained the
“criteria” for deciding whether the merit outweighs the demerits, such “criteria” should be used to determine the winner. (Of course, if the mentioned “criteria” are irrelevant or not supported
by any reason, you don’t have to follow them Honestly speaking, in most high school debates, neither side will present such criterion effectively. In those cases you should decide using your own
“usual” value judgments).
For example, AFF insists that their plan has some merit on “international trade”, but NEG pointed out that it might increase “domestic jobless rate”. Which issue is more important? There is no
absolute scale that can measure such value comparison. So, such comparison should be done by debaters themselves. A good AFF summary speech may present a “value criterion” insisting that a good
policy should ignore short term “jobless increase” and long term merits outweighs such demerits. If the NEG summary cannot present a counter-criterion, a judge should decide by the AFF in favor
of the AFF.
If and only if you are reasonably sure that you think there is no way to decide whether the merits outweigh the demerits, then vote for the NEG side (according to the tournament-debate
convention: “presumption”.)
Filling in the following “Decision making chart” will help you decide the vote:
(Proposition: Japan should make English its second official language.)
①List of issues
|
②Probability
|
× ③Value
|
= ④Strength
|
Merit 1
International exchange
|
Quite High (Good proof: more foreigners will come to Japan)
|
Big
(More international trade )
|
STRONG (persuasive)
|
Merit 2 English will bring together a new global culture
|
None
(Nearly no explanation, no proof)
|
Big
(Global culture)
|
NONE
(Big impact, but no reality)
|
Demerit 1
Japanese language ability will be harmed
|
High (NEG proved that the school Japanese language classes will be harmed)
|
Little (Poor explanation: on the impact of the decline in Japanese language ability)
|
WEAK (probable, but unclear impact)
|
Demerit 2
Tax will be wasted
|
Not defended
|
Not explained
|
NONE
(Not extended)
|
⑤Comparison: AFF pointed out that international issues are more important than pure domestic matters. NEG did not show any criterion effectively.
Conclusion: AFF team wins. The AFF successfully extended Merit 1 and so did the NEG Demerit 1. However, Merit 1 outweighs the Demerit, as the latter’s impact is not clear
and moreover, AFF criterion for decision was agreeable and I am convinced that more will be gained than lost.
4. Communication Points
Judges should also rate the “communication points” of each team. Scale how well were the debate team (not each debater) successfully communicating with the judges, opponents, and the audience in
the round you are judging. 5 is the maximum and 1 is the minimum (No fractions, only integers). 3 should be the average. 5 and 1 should be rare. Use the following scale:
5
Excellent
|
Every speech was easy to follow (adequate speed, elocutions etc.). And every team member was successfully communicating with the audience (good eye-contacts, gestures, good
manners, etc.)
|
4
Good
|
Most of the speeches had no problem in following. And most of the team members were effectively communicating with the audience.
|
3
Average
|
Though with some exceptions, the speeches were basically easy to follow. Majority of the members had no problem in communication.
|
2 Below
Average
|
Speeches were quite often hard to follow. Lack of audience communication can be found often.
|
1 Poor
|
Most of the Speeches were hard to follow. None of the team members were communicative.
|
PENALTIES: You should subtract some points for PENALTY in the following conditions: If a team or its member A) does not obey the judge’s/chairperson’s instructions, being rude or making noise; B)
was offensive or rude during the Q/As; C) not answering at all in the Q/As.; D) not cooperating to reveal the source of their evidence to the opponents. Subtract as many points as you think it
deserves. (The minimum point cannot be below 1 though.) NOTE: In extreme cases, the winning team may have lower communication points but that’s OK. (These points are mainly for tie-breaking
purpose to select the finalist after four preliminary rounds.)
5. Instructions / Interruptions during the round
Basically, judges should leave the debate to the debaters and not intervene in it. However, for educational purposes, do interrupt the speeches in the following exceptional cases: A) SPEECHES are
unintelligible (too fast, not loud enough, etc.) B) QUESTIONS and ANSWERS are anomalous. (Too few questions, too long silence, questioners making speeches and not asking any Qs., etc.) C)
Speeches are interrupted by NOISE (Chatting, pen-clicking, etc.)
6. Some Notes for the Experienced Judges:
(1) This is not a Parliamentary Debate (British impromptu style) tournament:
a) Interruption of speeches by the opponents, so called “POINT(s) OF INFORMATION” is not allowed
b) Decide the winners by the outcome of the argument contents (see Section 2), not by cumulative speech points.
c) The usage of evidence is to be encouraged, not to be discouraged as in some Parliamentary debate contests.
(2) This is not a Recitation contest (Even if some of the rounds may appear to be so!) Don’t decide the winners just by eye-contacts, accents, intonation, etc. Of course those are important for
English communication, but as long as the speeches are intelligible, please don’t overweigh such speech delivery aspects when deciding the winners. However, you should comment on them. Please
tell the students how to improve their English delivery.
(3) This is not exactly an American Policy Debate (NDT/CEDA style) tournament
a) NEVER encourage fast delivery. Interrupt the speeches, if you think the speeches are too fast.
b) Ignore cheap debate tactics (such as phony “Topicality”, “Counterplans” etc. just to make the opponents upset).