Skip to content

Fix ScoreCardGrade.OK description typo in scoring prompt#230

Merged
CodexVeritas merged 1 commit intoMetaculus:mainfrom
fabimax:fix/scorecard-grade-typo
Mar 25, 2026
Merged

Fix ScoreCardGrade.OK description typo in scoring prompt#230
CodexVeritas merged 1 commit intoMetaculus:mainfrom
fabimax:fix/scorecard-grade-typo

Conversation

@fabimax
Copy link
Copy Markdown
Contributor

@fabimax fabimax commented Mar 25, 2026

Summary

Fixed typo in the KeyFactorsResearcher scoring prompt where ScoreCardGrade.OK was described as "Below average quality" (identical to BAD) instead of "Average quality"

Details

The grading scale in the prompt should be:

  • very_bad: Generally poor quality
  • bad: Below average quality
  • ok: Average quality ← was "Below average quality"
  • good: Above average quality
  • very_good: Exceptional quality

One-line change in key_factors_researcher.py:225

…g prompt

The grading scale prompt described "ok" as "Below average quality" (copy-paste
from the "bad" grade). Changed to "Average quality" to match the intended
scale progression:
- very_bad: Generally poor quality
- bad: Below average quality
- ok: Average quality
- good: Above average quality
- very_good: Exceptional quality
@CodexVeritas CodexVeritas merged commit 7f7dd2f into Metaculus:main Mar 25, 2026
2 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants