Week 3 - 7 Common Survey Mistakes - SJCG's Research & Evaluation Month

Page 1


A question with overlapping response options occurs when choices, often timeframes, overlap.

A respondent could have been in chronic pain for the last 2 years, but which category should they choose? This creates confusion and the respondent would not know whether to select B or C.

A question with unbalanced response options occurs when choices lean more toward one direction (positive or negative). A respondent would subtly be pushed toward a more positive response for this question, leading to biased results.

A leading question subtly suggests a specific answer, influencing the person's response. It often contains wording that bias the person toward a particular choice rather than allowing for an unbiased answer. This is leading because it assumes the care they received was excellent, which may not be accurate for everyone.

Acronyms not defined at least once in survey questions can confuse people. When acronyms are used without clarification, some people may not be familiar with the term or its meaning, potentially leading to inaccurate or incomplete answers.

The number of questions in a survey depends on the goal of the survey, the audience, and the survey format (for example, online, in-person, telephone). However, after a certain point, the more questions there are in a survey, the decreased completion rate. So, on average, what’s the sweet spot before people start leaving your survey prematurely?

While both terms relate to privacy, they have different meanings, and misusing them can cause misinterpretations. If your survey is anonymous, this means that people’s identies are NOT collected in the survey. Confidential means that people’s identities ARE collected in the survey, but they will be kept secured and protected.

Turn static files into dynamic content formats.

Create a flipbook
Issuu converts static files into: digital portfolios, online yearbooks, online catalogs, digital photo albums and more. Sign up and create your flipbook.