Blog



The Case for Fully Labeled Scales

Your client says that questionnaire you’re writing should ask your customers “What is your overall satisfaction with our product?” and should use a five-point scale. Sounds simple, you think to yourself, then go to write the question. Which format do you use?


Like many other tactical issues regarding questionnaire design, scale formats have been carefully studied. According to the summary of available research by Jon Krosnick and Leandre Fabrigar in “Designing rating scales for effective measurement in surveys”:

  • Respondents prefer rating scales with more verbal labels.
  • Respondents believe such scales provide more valid measurement.
  • Choosing a labeled choice is a more natural mental activity (not to mention more conversational) than selecting a number within a range.
  • Longitudinal reliability is greater when using fully labeled scales instead of partially-labeled scales.
  • Validity, especially inter-rater validity, is greater using fully labeled scales.
  • Using fully labeled scales provides greater reliability and greater validity from respondents with low to moderate education.
  • Because numeric values can confuse respondents and affect the choices they make, it is better to omit numeric labels altogether.

Given the importance of fully labeling a rating scale, choose an existing common scale where possible, rather than writing your own scale.

 

Recent Headlines

  1. Social Media Satisfaction Survey Jeffrey Henning 11-Feb-2019
  2. NFL Satisfaction Driven by Handling of Off-Field Issues Jeffrey Henning 02-Feb-2019
  3. Impressions of Tom Brady Jeffrey Henning 01-Feb-2019
  4. Consumer Research Omnibus Methodology Jeffrey Henning 02-Jan-2019


White Papers


Consumer Research

  1. Social Media Satisfaction Survey Jeffrey Henning 11-Feb-2019
  2. NFL Satisfaction Driven by Handling of Off-Field Issues Jeffrey Henning 02-Feb-2019
  3. Impressions of Tom Brady Jeffrey Henning 01-Feb-2019
  4. Consumer Research Omnibus Methodology Jeffrey Henning 02-Jan-2019


From Jeffrey Henning's Blog

  1. Market Research Conference Calendar - 2019 Jeffrey Henning 12-Dec-2018
  2. Asking Too Much Jeffrey Henning 26-Oct-2018
  3. The Diseconomies of Scale of Survey Research Jeffrey Henning 28-Sep-2018
  4. Four Horseman of the Retail Apocalypse Jeffrey Henning 18-Jun-2018