Online Surveys = Ongoing Insights

The N/A Answer Choice: When It’s Good To Use & When It’s Not

 → 
 → 
The N/A Answer Choice: When It’s Good To Use & When It’s Not

Survey ScienceImagine this. You’re a product engineer for an automobile company; you’ve just finished designing the latest lineup of cars (congrats!) and now you need to figure out how to market your new brand to the world. Hm, how to do that? Well, with SurveyMonkey of course.

The first question you want to ask is, “How pleasant is your drive to work?” But asking this doesn’t apply to everyone however.

Asking this question to people who don’t drive to work will:

  1. Make the survey longer for no reason. Not good. Taking longer surveys ups your chances of people zoning out or even dropping out of your survey.
  2. Mess up your data. People who don’t drive to work have no idea how to answer this question and so will pick a random answer.

How do you solve these problems?

You can:

  1. Add a “No Opinion” answer choice.
  2. Add a “Not Applicable” answer choice.
  3. Add a customized not applicable answer choice, such as “I do not drive to work”.
  4. Use Skip Logic. To do that, first ask respondents if they drive first. If they say “yes”, they’ll see the “how pleasant is your drive to work” question. If they say “no”, they’ll skip over it.

What’s good about these choices? All these options give respondents who don’t drive a way to tell you that.

What’s not so good about these choices? The first three options have one major problem: they increase satisficing. When people are taking our survey, we want them to pay attention to each question carefully. When they instead zone out and pick any answer, that’s called satisficing.

Why? The first three options increase satisficing because they give respondents an easy way out–or an easy way to satisfice. By offering “No Opinion”, “Not Applicable”, or “I don’t drive” as answer choices, your respondents can pick it and not have to actually think about how to answer the question.

Which answer choice should I go with?

Going with Skip Logic is probably your best choice because it’s the only option that keeps the survey short, allows non-drivers to answer the question, and doesn’t give people an easy way out to satisfice. Picture driving on a highway with no exits. You keep driving–because you have to and you have no way of getting off the highway. A skip logic question keeps respondents going and concentrating without giving them an out.

The No Opinion, Not Applicable and customized response options may be more of a survey-taking challenge for your respondents, because they make the survey longer AND give people a pretty obvious way to satisfice. It’s not the most obvious, because for some questions you might have to think a bit about whether you actually have an opinion about it or if really is applicable to you. That’s especially the case because “applicable” could mean whether you actually drive to work or whether you have an opinion about your drive. Picture driving on the highway again, but this time, there’s a sign to exit. It’s not the most obvious sign and you might have to think for a split second about whether it’s the right exit, but it still is a simple, easy way to get off the highway.

So, the moral of the survey story? Although each answer choice has their own benefits, using Skip Logic will lead to a smoother survey experience for your respondents. Picture a drive with gentle curves in the road instead of sharp turns that might lead to a bumpier ride for your passengers.

Keep in mind too that your answer choices will vary depending on your survey’s goals so you shouldn’t feel limited in whatever response option you choose!

Have more survey science questions on the brain? Share them with us in the Comments section below!

Tags: ,

  • I am using a matrix question requiring an answer on a 10 point scale. I added the N/A (No Contact) option so that it wouldn’t count in the analysis. If someone answers 1-10 they move on to the next questions asking why they gave the rating they did. Both of these questions are required. However, if someone uses the N/A (No Contact) I want them to skip the second question about why they gave the answer they gave but it doesn’t show up on the Skip Logic screen. How do I add skip logic with the automatically added N/A question?

    • KTsurveymonkey

      Hi there, Wendy-

      Great question. You will want to put each of these questions on two different pages in order for this to work. The logic is activated when a respondent clicks on the “Next” button. This means, the respondent will not “skip” until they click next, so if both of the questions are on the same page, the logic won’t work properly. When you put these questions on their own pages, you’ll be able to skip the N/A respondents over the next page! Here’s more: http://help.surveymonkey.com/articles/en_US/kb/Question-Skip-Logic

      Hope that helps clear things up, Wendy!

  • Billy

    When you use the N/A column, it looks like it exports the value of the response as a 0. Is that correct? I used a 0-10 scale, exported to SPSS, and I can’t decipher between a 0 response and an N/A. Any help would be much appreciated, as I search for a solution.

  • research

    URGENT PROBLEM I don’t know how to get the original data out of the survey. I thought it would be good to have the “not applicable” option, and it appeared under “use weights” – so I turned that on. But I didn’t realise that the data would export “not applicable” as code 0 – this is a real problem. How can I export the original data that was selected by respondents using the original codes underneath the data (and not using the new “weights” data that seems to be overwriting everything.

    • MFsurveymonkey

      Hi! We’re sorry to learn that the N/A option didn’t quite meet your needs in this case.
      Editing this option is limited in case you have already collected responses (which seems you did) so you won’t be able to remove N/A option without affecting the responses, I’m afraid.
      I would recommend checking out this help article about editing a live survey: http://help.surveymonkey.com/articles/en_US/kb/Am-I-able-to-edit-a-live-survey-and-does-this-change-the-link
      I also see that you’ve already been in contact with our support team! You’re in good hands :) and hopefully they’ll be able to help you further with this.

  • JOL

    Thank you to the other users who have entered comments on this page. I clicked the link to this article looking for answers about how the N/A response would be displayed in the data, and now I have it.

Inspired? Create your own survey.

Inspired? Create your own survey.

PRO Sign Up Sign Up FREE or Sign in
Write Surveys Like a Pro

Ever wonder what SurveyMonkey’s really made of?

Ever wonder what SurveyMonkey's really made of?

Read our engineering blog »