Online Surveys = Ongoing Insights

How to Perform a Longitudinal Study: Tracking Your Performance Over Time

How to Perform a Longitudinal Study: Tracking Your Performance Over Time

trendsA survey is like a snapshot: From one survey, you can only draw conclusions about a single time, place, and group of people. And often, that’s all you need to know.

But sometimes, you also want to understand how the people you surveyed are changing. In that case, one single survey, or snapshot, is not enough—so we need to repeat surveys in order to track and understand trends over time.

If you want to see how people are changing, there are two ways you can do so. First is benchmarking, which means that you are asking different groups of people the same question over time to see how views change. The second way, and the focus of this post, is a longitudinal survey.

When you run a longitudinal study or survey, you’re essentially following the same group of respondents over a long period of time, for weeks, months, or even years.

This differs from a cross-sectional survey, which is a fancy way of saying that each of your survey respondents only completes the survey once, but you might conduct the survey multiple times to collect some benchmarking data. (That’s your snapshot survey.)

But why would you want to run a longitudinal study? Well, just like this study that began in 1968 and still runs today, you might want to monitor changes over the course of your respondents’ lifetimes to be able to draw conclusions from a (very consistent!) group of respondents.

How repeating surveys will help you make smarter choices

While you may not be in the market for running a decades-long study anytime soon, you can benefit from repeating surveys and tracking changes in your respondents’ attitudes and behaviors over time. (By the way—when you survey the same people time and time again, you’re running what’s also called a panel survey.)

For example, say you’re an online marketer who wants to know how your readers will react to a new email newsletter design.

Instead of just sending your readers a survey after you’ve changed your design, send them a survey asking them what they like (and don’t like) about the current design (i.e., create a concept test). You can even use their feedback to inform your newest design!

Then, send them a follow-up survey after you’ve sent them the newly designed newsletter. Because you’re surveying the same people, you can compare their attitudes and opinions of the first design against how they react to the second design and smaller changes will be statistically significant. If you decided to do two cross-sectional surveys with different groups of people, you would need to see a larger change in order to see a significant difference.

If you make more changes to the design based on your readers’ feedback, you can continue to refine your design over time and make sure that satisfaction ratings don’t dip below the initial satisfaction ratings with the first design.

Track Your Progress Against Other Organizations

Get context for your data by comparing the results of your surveys against the results of similar organizations.

Learn more →

An alternative to the longitudinal panel survey

Repeating surveys with the same panel works well when you’re tracking changes in your respondents’ attitudes and behaviors, but sometimes, you’re unable to survey the exact same people time and time again.

In this case, even if you are sending your newsletter out to the same people, you may not be able to capture the same opinions. People may unsubscribe from your newsletter, and newer readers may come along.

That’s when you conduct something called a rotating panel survey. All you need to do is gradually rotate a portion of your initial sample out of the panel survey and supplement them with new readers. (In this case, you could easily track who from your email list is filling out your surveys.)

This way, your survey will provide a good estimate of the opinions of your entire readership, old or new, while at the same time capturing the changing opinions of the same group of people.

3 tips for creating surveys for a longitudinal study

Here are three things you need to keep in mind when creating your longitudinal study:

1. It’s better to keep the questions identical for all the surveys. Research has shown that changing the way a question is asked can result in substantially different answers, even from the same people. So to examine trends with the most accuracy, you should try your best to ask the same questions in every survey you repeat.

2. When planning a panel survey, remember that not everyone who responded to the first survey will respond to the second survey. So if you want to do a panel survey where you survey the same group of people 3 times and want at least 1000 respondents for your third survey, you’ll need to survey more than 1000 respondents in your first survey to account for people who probably won’t respond to your second or third survey.

3. You need to decide how frequently you want to run your survey. If you conduct surveys too frequently, you could waste your resources and time, since not enough time may have passed for any change to occur. However, if you conduct surveys too infrequently, more people may drop out of your panel survey because they are sick of taking too many surveys, which means that you’ll have fewer respondents in your later surveys.

When you think about it, the applications for a longitudinal study are endless. You can see whether your new ad actually influenced people purchasing your product or follow up with product purchasers to see if they’ve enjoyed using your product.

Even though one dataset can shed light on a single occurrence, the context that comes from repeating surveys over time will help you make informed decisions and improvements.

Questions, comments for Mingnan? Let him know below!

Get the Survey Writing eGuide


Tags: , , ,

  • souleymane kaba

    big experience!!!

  • J.Marshall Adams

    Thanks – I’m getting started on a project with longitudinal tracking of the same individuals. Is it possible / are there any recommendations or examples of how to design/construct a SurveyMonkey instrument so that the longitudinal data over three different administrations is tracked inside the survey?

    • KTsurveymonkey

      Hi there J.-

      You can definitely use our Data Trends feature to track respondents long term. In terms of doing this for your 3 administrators over time, you’ll want to be sure that you use the same survey design (so you can use the data trends), and have a tracking method. For this I’d suggest using our Email Invitation collector. This will allow you to create a new collector on your survey for each follow-up, and it will automatically track the admins by their email address! Do not use a copy or new survey, or else the data will be in different sets and the trends feature will not work.

      • Dubonnet

        Do you have built-in graphic display tools for visualizing the long term data within Data Trends?

  • GG

    I’m doing a longitudinal study. Is there any way of sending reminders to participants who have already done the study once, to do it again ? Like the email reminders, but rather than contacting those who did not respond you are reminding those who did respond to repeat the survey. ?? Thanks!

    • MFsurveymonkey

      Hi there! I see what you’d like to do here, but I’m afraid it’s not possible to automatically send reminders to people who have completed the survey. Thanks for your suggestion though :) maybe in the near future.
      In the meantime what I recommend is that you create a new collector for each time you want to re-send the survey to your respondents (different collectors, in the same survey). This way you can keep track of the results, by filtering your data by Collector (each time you sent out the survey).
      More info here:

Inspired? Create your own survey.

Inspired? Create your own survey.

PRO Sign Up Sign Up FREE or Sign in
Write Surveys Like a Pro

Ever wonder what SurveyMonkey’s really made of?

Ever wonder what SurveyMonkey's really made of?

Read our engineering blog »