Response Bias

Response bias is any systematic pattern in survey responses that distorts the true picture of customer sentiment. It can stem from the way questions are worded, the order in which they appear, social desirability pressure, or the characteristics of who chooses to respond.

Common types of response bias include acquiescence bias (tendency to agree with statements regardless of content), social desirability bias (answering in a way that presents the respondent favorably), extreme response bias (tendency to select extreme options on rating scales), and central tendency bias (avoiding extreme responses and clustering around the middle).

Non-response bias is equally important. If only the happiest and angriest customers respond to surveys, the "silent majority" with moderate opinions is underrepresented. This can make metrics like NPS appear more polarized than reality.

Mitigating response bias requires careful survey design: use neutral question wording, randomize question order where appropriate, mix positively and negatively worded statements, and analyze response patterns for signs of bias. Comparing survey data against behavioral data (usage patterns, support interactions) provides a reality check.