Judges' scores
Once you have assigned categories to your judges, and your judging has opened, you can monitor the progress of each of your judges.
When your judges have completed their assignments, you can check results, override if needed, and begin identifying your finalists and/or winners.
Each judging round is completely independent so scores from each round will be saved and can be referred back to.
In this article
Reviewing submitted judge scores
📺For a video tutorial on how to review submitted scores, click here.
Reviewing scores per judge
To find and track judge progress, go to Awards > Judging, and choose your judging round.
Click on the Judging tab. Here, you will see all judges that have been assigned categories for them to judge.
You will see how much assigned work has been completed per judge, and expanding each judge will let you see progress per category. You will see the judges score in comparison to the overall score as well as have the opportunity to view the feedback.
Judge opt-out
In the case of a conflict, judges can abstain or opt out of judging a specific entry.
When a judge chooses to opt out from judging an entry, their choice to do so and their reason why will be recorded against the entry in question.
The option to opt-out of judging an entry will always be visible for your judges.
Tip 💡
To review how the judges choose to opt out, click here.
If your judges have opted out of scoring an entry, this can be reviewed within the judging tab alongside the provided scores.
You can also see the opt-out by clicking on the entry name, and navigating to the Judging tab.
The opt out options are
- Professional conflict of interest
- Personal relationship with the nomination or nominee
- Other
- If other is selected, the judge will be required to provide a comment to explain their choice.
Note 🗒️
When a judge opts in or out, scores are re-calculated to ensure that average scores remain accurate.
In addition to being visible via your judging round, you can also review opt-out status in Excel exports and API.
Reviewing Overall Scores
In the Nominations tab, each category will show the percentage completed, and each entry will have an overall score. This score an average of all judges' scores, rounded to the nearest whole number.
The system will also rank and order the entries based on scores, so the entry with the highest score at the top of the category.
Any feedback that judges have submitted can be reviewed by clicking on the 💬 speech bubble beside each entry.
How scoring works when criteria scores are optional
This explains how the system calculates an entry's total score when scoring criteria are marked as not required, so judges can choose to skip criteria they don't feel they can score.
It uses a small worked example to show what happens, the implication for entry totals.
The example
Imagine a category with 4 scoring criteria, each scored out of 10:
| Criterion | Max |
|---|---|
| 1 | 10 |
| 2 | 10 |
| 3 | 10 |
| 4 | 10 |
| Total possible | 40 |
Two judges, A and B, are assigned. Scoring is not required, so each judge picks the criteria they feel they can rate.
| Criterion | Judge A | Judge B |
|---|---|---|
| 1 | 6 | — |
| 2 | 8 | — |
| 3 | — | 7 |
| 4 | — | 4 |
How the system calculates each judge's total
The system takes the criteria the judge actually scored, sums them, and shows the result over the full category total, i.e. out of 40, always, regardless of how many criteria were scored.
Skipped criteria are treated as if they contributed 0 to the score, but their max value still counts toward the denominator.
|
|
Sum of entered scores | Max for category | Score shown |
|---|---|---|---|
| Judge A | 6 + 8 = 14 | 40 | 14 / 40 (35%) |
| Judge B | 7 + 4 = 11 | 40 | 11 / 40 (27.5%) |
Note 🗒️
Judge A's score is 14 out of 40, not 14 out of 20. The two unscored criteria don't get removed from the denominator.
How the entry's overall total is calculated
Once each judge's total is known, the entry's overall score is the average across the judges, rounded to a whole number.
(14 + 11) / 2 = 12.5 → rounded to 13
So the entry's recorded total is 13 / 40 (32.5%).
What this means in practice
When a judge skips a criterion, the system treats that gap as a zero in their total. Because the maximum stays at 40, the judge's overall score is dragged down by the criteria they didn't score.
To make this concrete, here are two scenarios that produce the same total of 14:
| Scenario | Criterion 1 | 2 | 3 | 4 | Total shown |
|---|---|---|---|---|---|
| Judge skips 2 of 4, scores high | 6 | 8 | (skipped) | (skipped) | 14 / 40 |
| Judge scores all 4, all mediocre | 4 | 4 | 3 | 3 | 14 / 40 |
The first judge essentially had a strong opinion on half the criteria and abstained on the rest. The second judge thought the entry was middling across the board. The system records them as identical.
In your example, the entry's total of 13 / 40 (32.5%) therefore reads as a fairly weak entry, even though the judges who scored it actually averaged 6.25 / 10 per criterion they chose to score.
Tip 💡
We strongly advise making the scoring criteria required to ensure consistent and fair scoring results.
Exporting reports with scoring
All scores and feedback can be exported in an excel document.
Inside your Judging Round, select Excel export.
The export will include multiple sheets:
| Sheet Name | Content |
|---|---|
| Transactions | No judging details; this sheet contains information about the submission |
| Nominations | Form fields, judging, rank and feedback are found here. This sheet also contains results from public voting, and if the submission has been shortlisted or classified as a winner. |
| Score by Judge | This sheet contains a line item outlining results from each judge for each submission |
| Criteria | This sheet gives an average score achieved overall per scoring criteria. It does not give scores for each nomination |
| Subsequential sheet for each category | Each category in the judging round has a sheet on the report containing the information in the Nominations sheet, but for individual categories. |
Overriding judge scores
📺For a video tutorial on how to override judge scores, click here.
If necessary, you can override judges scores. The overridden score will always be used in all calculations and rankings. You can override the overall score that a nomination has received, or a score provided by an individual judge.
Overall Score
If more than one judge has judged a nomination, the overall score will be the average of all judges' scores, to the nearest whole number.
To change the overall score, go to the Nominations tab, find the entry you wish to change the score of, and click Edit Result.
In the column labelled Override, type in a new score. Click Save.
Individual Judges Scores
Alternatively you may need to override an individual judge score. In the Judging tab, click on the relevant judge and locate the nomination. Click on the nomination.
The Nomination details window will open. Click on Judging, then Edit.
Then, the judge scores for this nomination will become editable, and you can change the necessary score(s).
When you are finished, click Save.
