Creating Great Response Options for Grader Questions

Each Grader Question should provide a clear signal of record quality. To maximize accuracy and usability, follow these best practices:

  1. Ensure a “Right” Response – Every question should have a response that is 100% accurate and applicable to any record being graded.
  2. Cover the Full Quality Spectrum – Include both high-quality ("good") and low-quality ("bad") response options.
  3. Avoid Ambiguity – Responses should be clear and specific to prevent subjective grading.
  4. Limit Response Options – Two to five responses are ideal. Too many choices slow down grading.
  5. Keep Responses Concise – Use the fewest words necessary while maintaining clarity.
  6. Consider Including a Non-Applicable (“N/A”) Option – This ensures every question can be answered without forcing inaccurate responses.

Well-structured response options improve grading consistency and help you get the most valuable insights from your Grader.