close
  • Why Us
    • Our Experience
    • Our Approach
    • Our Team
  • Our Playbook
    • Qualitative Research
    • Focus Groups
    • Synchronous Online Focus Groups
    • Asynchronous Online Discussion Boards
    • In Depth Interviews
    • Usability Testing
    • Ethnography
    • Quantitative Research
    • Telephone Surveys
    • Online Surveys
    • Mail Surveys
    • Intercept Interviews
  • Our Clients
    • Education
    • Technology
    • Healthcare
    • Financial
    • Consumer Goods and Services
    • Non Profit
    • Social Marketing
  • Case Studies
    • Behavior Change
    • Concept Testing
    • Market Assessment
    • Customer Research
    • Product Assessment
    • Process Evaluation
    • Conjoint Analysis
    • Tracking Program
    • Customer Satisfaction
    • Usability Testing
    • Product Packaging
  • Resources
    • FAQs
    • Determining Sample Size
    • Moderation Techniques
    • Social Marketing Research
    • Industry Articles
    • Market Research Books
    • Market Research Associations
  • Insights Blog
  • Contact Us
Hardwick Research

206-232-9400

  • Menu
  • Why Us
    • Why Us Overview
    • Our Approach
    • Our Team
    • Our Experience
  • Our Playbook
    • Our Playbook Overview
    • Qualitative
      • What is Qualitative Research?
      • Focus Groups
      • Synchronous Online Focus Groups
      • Asynchronous Online Discussion Boards
      • In Depth Interviews
      • Usability Testing
      • Ethnography
    • Quantitative
      • What is Quantitative Research?
      • Telephone Surveys
      • Mail Surveys
      • Intercept Interviews
      • Online Surveys
  • Our Clients
    • Our Clients Overview
    • Education
    • Technology
    • Healthcare
    • Financial
    • Consumer Goods
    • Non Profit
    • Social Marketing
  • Case Studies
    • Case Studies Overview
    • Behavior Change
    • Concept Testing
    • Market Assessment
    • Customer Research
    • Product Assessment
    • Advertising Effectiveness
    • Process Evaluation
    • Conjoint Analysis
    • Tracking Program
    • Customer Satisfaction
    • Usability Testing
    • Product Packaging
  • Resources
    • Resources Overview
    • FAQs
    • Determining Sample Size
    • Moderation Techniques
    • Social Marketing Research
    • Industry Articles
    • Market Research Associations
  • Insights Blog
  • Contact Us

Avoid Bias in Survey Design

By Nancy Hardwick,

HARDWICK RESEARCH “TALKS TRASH”

After conducting surveys for 20+ years, Hardwick Research knows what it takes to develop a questionnaire that removes the possibility of bias and is organized to maximize the quality of responses. To help you avoid bias in survey design and not have your research be “trash,” we compiled a list of the 8 most commonly seen mistakes.

  1. Limited multiple choice answers:  It’s always good to have an “Other (specify)” option to allow respondents to answer the question with the response that makes the most sense to them.  If the list provided does not contain their desired response, the respondent will choose something (even if it’s the wrong answer) just to move on.
  2. Asking leading questions: Leading questions are often asked by a researcher who isn’t thinking through their survey. They know they want the respondent to answer a particular way, so they write the question that way. Asking a leading question will provide a false response. To avoid this, think critically about your question and make sure it is not biased in any way. It’s always a good idea to have someone else review your questionnaire before launching the survey.
  3. Too many open-ended questions: Open-ends are time consuming for respondents to complete and typically do not include the level of detail you are hoping for. If you overload the survey with open-ended questions respondent fatigue will set in.
  4. Including unimportant questions: Be sure that each question being asked is necessary in order to reach your objectives. For each question ask yourself what you will learn from that question, how you will use the results, and if it is critical to know this information. If it’s not critical, then remove the question. Keep in mind that the longer the questionnaire, the more expensive the research. Plus longer questionnaires lead to respondent fatigue and poor quality results.
  5. Asking two questions at once: Asking a respondent to rate the “overall quality and reliability” of a product asks them to consider two aspects in one rating. These are actually two different issues. For example if this is rating an electrical utility, the quality of the electricity might be great (when it’s on it works fine), but the service is not reliable (too many power outages).
  6. Beginning with demographic questions: Obviously if you have to screen for a particular type of person, you will need to include some demographic questions up front, but the remaining demographic questions should always be at the end. You want to engage the respondent. If you are asking them to participate in a research survey on pet food, don’t start by asking them their education or income.
  7. Ambiguous questions: Be very clear in what specific information you are looking for. If you want someone’s zip code, don’t ask them where they live.
  8. Assuming knowledge: You know your company inside and out, but your customers and prospects do not. Don’t assume the participant knows a lot about your company or the industry. Stay away from industry specific words or abbreviations.

To avoid bias in survey design and “trash” for results, have an experienced researcher review your questionnaire before launching it. Pretest your questionnaire with a small group of your target audience first to make sure the survey is clearly written. At a minimum, have someone in your office who didn’t write the survey complete it and provide feedback.

Feel free to contact Hardwick Research. We are experts at removing bias from your research surveys. We are always happy to write or review a questionnaire for you, even if you don’t need assistance with the rest of your project.

  • Facebook
  • Twitter
  • Google+
  • Pinterest
  • LinkedIn

Tagged:Market Researchmarket research best practicesonline surveyquestionnaire designsurvey

Post navigation

← PreviousChoosing Labels for Stimulus Testing
NextProjective Techniques in Qualitative Research →

2 thoughts on “Avoid Bias in Survey Design”

  1. Heather Crunchie says:
    at 9:18 am

    Thanks Nancy, you always steer us straight. Great insights!

    Reply
  2. Nancy Hardwick says:
    at 10:51 am

    Thanks Heather. I love the creativity of questionnaire design and am always happy to share my thoughts.

    Reply

Leave a Reply Cancel reply

Your email address will not be published.

Subscribe to our Blog

 

About our blog

I’m so glad you have found your way here. I’m Nancy Hardwick, owner of Hardwick Research. I have been conducting market research studies for more years than I should count. In 1994, after the birth of my son, I started Hardwick Research. I love my job, especially the part where I am able to creatively help clients learn more about the way people think and why they do the things they do. This blog provides me an opportunity to share my insights and experience in the market research industry, but it’s also a chance to have some fun.
 

Browse by category

  • Behavioral Economics
  • Best Practices
  • Culture
  • Miscellaneous
  • Qualitative Research
  • Quantitative Research
  • Resources
  • Social Marketing
  • Uncategorized
 

Browse by tags

Behavioral Economics best practices Blogging concept testing conclusions COVID-19 Dan Ariely do-it-yourself do it yourself market research facts focus group moderator Focus Groups Fudge Fun Human Behavior image ideas images image sources incentives Market Research market research best practices market research key success factors market research process online survey open-ended comments Pacific Northwest Social Marketing Association photos PNSMA presentations product testing projective techniques qualitative research Qualitative Research Consultants Association quantitative research questionnaire design reports Research Consultant research methodologies resources secondary research Social Marketing SPARKS story survey teamwork Thank You tool box visual upgrade Writing
© Hardwick Research · · All rights reserved | Privacy Policy · info@hardwickresearch.com