Ask more, know more, do more

Will the new Star Rating question type affect your survey completion rates?

 → 
 → 
Will the new Star Rating question type affect your survey completion rates?

control3Ever tire of asking your customers how satisfied they are using a regular old numerical satisfaction scale? No worries. You can now use stars, smiley faces, hearts and thumbs up or down with our brand new Star Rating question type!

And because we’re your resident survey scientists here at SurveyMonkey, we always test our features out before we recommend them to all of you.

So let’s jump right in to testing Star Rating, shall we?

Words vs. Non-words

We asked 12 questions using a satisfaction scale with five response options (Very satisfied, Somewhat satisfied, Neither satisfied nor dissatisfied, Somewhat dissatisfied, Very dissatisfied). In addition to these, we asked the same questions using stars, smiley faces, hearts and thumbs.

screen-shot-1

We also tested adding the verbal labels to the scales as seen in the screenshot below. Then we randomly assigned the respondents to one of the nine question types from earlier and tested to see whether their answers changed, based on the type of questions presented.

screen-shot-2

What we discovered

In the chart seen below, we’re showing the mean score for each of the 12 questions we asked by the question type. There are nine mean scores, one for each question type.

The blue line is for the regular satisfaction scale. The other eight lines are for the star, smiley face, heart, and thumb scales. For each question, the mean scores for the nine question types are very similar to each other, suggesting that the answers we received didn’t change based on the type of questions we used.

We did the same analysis for people who took our survey on mobile and on PCs separately. The same conclusion was reached on both occasions. Also, answers among the different questions were very similar regardless of the question type.

Want to give it a try?

Use the star rating question in your next survey for an easy, mobile-friendly survey experience.
Get Started

screen-shot-3

For the most part, survey completion rates were above 90% and they also didn’t change by question type. Meaning? Respondents are definitely not less likely to answer new question types than they are older, more traditional radio button rating scales.

Based off of our experiments, it’s safe to say using the Star Rating question type won’t hurt your survey completion rates and they won’t change your results either. We also think your survey takers will love the new design of the Star Rating icons. Expect tons of smiley faces in your next survey!

Want to see how you can make the star rating question work for you? Try it out yourself.

Leave a Reply

Your email address will not be published. Required fields are marked *

Inspired? Create your own survey.

Make your own survey

Sign In

Sign up to get started

PRO Sign Up 
Sign Up FREE

Latest Features

Curious about what we’ve been working on?

View New Features

Get expert survey help

Get expert survey help

 

Best practices for planning expert surveys

Planning makes writing your survey easy.

Download eGuide

How many responses do you need?

Use our sample size calculator to find out!

Calculate now

Analyze survey data like a pro

Learn to slice and dice data using the Analyze tool.

Download eGuide