Products

SurveyMonkey is built to handle every use case and need. Explore our product to learn how SurveyMonkey can work for you.

Get data-driven insights from a global leader in online surveys.

Explore core features and advanced tools in one powerful platform.

Build and customize online forms to collect info and payments.

Integrate with 100+ apps and plug-ins to get more done.

Purpose-built solutions for all of your market research needs.

Create better surveys and spot insights quickly with built-in AI.

Templates

Measure customer satisfaction and loyalty for your business.

Learn what makes customers happy and turn them into advocates.

Get actionable insights to improve the user experience.

Collect contact information from prospects, invitees, and more.

Easily collect and track RSVPs for your next event.

Find out what attendees want so that you can improve your next event.

Uncover insights to boost engagement and drive better results.

Get feedback from your attendees so you can run better meetings.

Use peer feedback to help improve employee performance.

Create better courses and improve teaching methods.

Learn how students rate the course material and its presentation.

Find out what your customers think about your new product ideas.

Resources

Best practices for using surveys and survey data

Our blog about surveys, tips for business, and more.

Tutorials and how to guides for using SurveyMonkey.

How top brands drive growth with SurveyMonkey.

Contact SalesLog in
Contact SalesLog in
Business

Get better data and simplify analysis: qualitative vs. quantitative questions

Get better data and simplify analysis: qualitative vs. quantitative questions

Lisa works in Human Resources at Widgets, Inc. Lately, she’s heard rumblings that employees are unhappy with their supervisors, but she’s not sure why. Determined to find out what’s going wrong, she sets up one-on-one meetings with every single employee. Unfortunately, none of the meetings are helpful, because no one is willing to say anything negative about their supervisor out loud.

Frustrated, Lisa decides to send a survey instead—hoping that the anonymity of a survey will make employees feel more comfortable about sharing what they really think. She sits down to create her survey, however, and feels a little stuck and overwhelmed.

Build a survey that asks open and closed-ended questions so you can collect a diverse set of data.

Okay, thinks Lisa, let’s start with the basics…

This type of question is known as an “open-ended” or “qualitative” question. It is called “open-ended” because the person responding to it is free to answer in any manner he or she chooses.

There are no response options specified. It is known as “qualitative” because responses are judged and measured by feel rather than by mathematics.

Lisa, anxious for her survey to be a success, thinks about how she’d answer this question about her own supervisor…

The great thing about this data is that if Lisa has no idea why people are upset with their supervisors, it gives them free reign to answer. For example, Lisa might not have thought to ask specifically about whether a supervisor fosters work-life balance—but this might emerge as a theme among responses.

There are, however, some problems with open-ended, qualitative questions…

1. Whaddya mean by that? Qualitative questions can be vague. What do I think about my supervisor? Are you referring to his management style? His fashion sense? His punctuality? His credentials? Re-writing open-ended questions to be more specific can help with that. For example: Please describe your supervisor’s management style.

However, questions may still linger when specific responses are not provided. It’d be much easier to answer the following question about supervisor management style:

This type of question is known as a “closed-ended” or “quantitative” question. It is called “closed-ended” because the person responding to it is constricted in the range of options he or she has to choose from as answers. It is known as “quantitative” because the response options can be converted to numbers. Why does that matter?

2. What on earth should I do with all this data? Figuring out what questions to ask is tough but figuring out what to do with the answers you get can be even tougher. With qualitative questions, you need to read all of the responses carefully in order to extract common themes. However, this process can be riddled with bias, as you often see only what you want to see in open-ended response answers. That’s why quantitative questions can be so great!

All you have to do is compute an average of the responses you get, a simple calculation in a spreadsheet with no hours of reading required. This also makes more complex analyses–like group comparisons–lightning fast. Simply compute an average for each group, compare, and you’re done!

3. What else is in it for me? The other thing to know about qualitative questions is that they take a really long time to answer. As a survey respondent, it’s much faster to choose one of five pre-formulated options than to have to take the time to write your own response. And, as we’ve mentioned before, keeping surveys short keeps respondents focused and interested. So not only will you get to ask more questions when you use quantitative questions, but it will also get you better data! Getting the most accurate data possible means that you’ll make the right decision every time.

So what’s the bottom line? Qualitative questions are a fantastic first step at exploring the minds of the people you want to survey, but they shouldn’t be your last. Using quantitative questions makes questions clearer, analysis simpler, and data quality better.

Take the time to think of specific quantitative questions to ask now—trust us, you’ll be glad that you did. As for Lisa, here’s hoping she figured out the right quantitative questions to ask to get the answers she needed.