Blog



The Case for Fully Labeled Scales

Your client says that questionnaire you’re writing should ask your customers “What is your overall satisfaction with our product?” and should use a five-point scale. Sounds simple, you think to yourself, then go to write the question. Which format do you use?


Like many other tactical issues regarding questionnaire design, scale formats have been carefully studied. According to the summary of available research by Jon Krosnick and Leandre Fabrigar in “Designing rating scales for effective measurement in surveys”:

  • Respondents prefer rating scales with more verbal labels.
  • Respondents believe such scales provide more valid measurement.
  • Choosing a labeled choice is a more natural mental activity (not to mention more conversational) than selecting a number within a range.
  • Longitudinal reliability is greater when using fully labeled scales instead of partially-labeled scales.
  • Validity, especially inter-rater validity, is greater using fully labeled scales.
  • Using fully labeled scales provides greater reliability and greater validity from respondents with low to moderate education.
  • Because numeric values can confuse respondents and affect the choices they make, it is better to omit numeric labels altogether.

Given the importance of fully labeling a rating scale, choose an existing common scale where possible, rather than writing your own scale.

 

Recent Headlines

  1. Postgraduate Degree Survey Jeffrey Henning 10-Jul-2019
  2. Voice Assistant Survey: Let the Young Speak Jeffrey Henning 09-Jul-2019
  3. PDI Releases New C-Store Shopper Report Jeffrey Henning 26-Jun-2019
  4. Issues with Grid Questions Jeffrey Henning 24-Jun-2019


White Papers


Consumer Research

  1. Postgraduate Degree Survey Jeffrey Henning 10-Jul-2019
  2. Voice Assistant Survey: Let the Young Speak Jeffrey Henning 09-Jul-2019
  3. Grocery Shopping Survey Jeffrey Henning 22-Jun-2019
  4. 2019 Summer Vacation Survey Jeffrey Henning 11-Jun-2019


From Jeffrey Henning's Blog

  1. Issues with Grid Questions Jeffrey Henning 24-Jun-2019
  2. Asking Too Much Jeffrey Henning 07-Jun-2019
  3. Helping You Through the Entire Survey Research Process Jeffrey Henning 02-Mar-2019
  4. Market Research Conference Calendar - 2019 Jeffrey Henning 12-Dec-2018