1. Participant Disclaimer

 

This short survey is intended to gather feedback of your IR experiences related to the impact that survey data has on informed decision-making. Your response is important, confidential and will be processed anonymously. Please donate 10-to-15 minutes of your time to help with this study. Thank you: Ken Scott, EdD, Novadeam Watson-Stone, DBA , and Mimi Johnson, EdD. (IRB APPROVAL: 31JANUARY2014)

Question Title

1. As a matter of IR practice, what is your perception of survey response rates (quantity) in the past three-to-five years? (e.g., # of surveys submitted)

Question Title

2. As a matter of IR practice, what is your perception of survey response quality in the past three-to-five years?
(e.g., quality refers to all items answered, open and honest feedback, answers appear to be thoughtful and insightful, etc.)

Question Title

3. How important are these factors in negatively impacting the quality and quantity of survey participation?

  Not Important Somewhat Important Important Very Important
Lack of motivation to complete 'another' survey
Busy schedules limiting time for survey completion
Survey participant identification
Responses being used 'against' participants
Skepticism surveys actually result in change
A lack of trust between employees & administration
The lack of incentives to promote participation

Question Title

4. Gender:

Question Title

5. Institutional Research Experience:

Question Title

6. Please provide the following student demographic information:

  Less than 1,000 Between 1,000-5,000 More than 5,000
Number of students:

Question Title

7. Please provide the following employee demographic information:

  Less than 100 Between 100 - 250 More than 250
Number of employees:

Question Title

8. Group I: Please rate each question based on your perception and/or experience of the relationship between survey data integrity and informed decision-making. (Quality and Quantity)
(IR = Institutional Research function of the college)

  Strongly Disagree Disagree Neutral Agree Strongly Agree
1. I seldom use validated surveys from other sources
2. I expect collected data to be used for decision-making
3. My perception is that employees trust the IR department
4. The quality of a dataset is seldom discussed in IR
5. I can easily recall decisions based on survey data
6. Only positive survey comments should influence decision-making
7. Only negative survey comments should influence decision-making
8. I personally use data to make informed decisions
9. Low return rates negatively impact data-driven decisions
10. The culture of the institution impacts response rates
11. My administrators rely on survey data to make informed decisions
12. The culture of the institution impacts data quality
13. A mixed-methods survey improves data quality
14. The overuse of surveys has a highly negative impact on return rates
15. Qualitative responses are consistently used in institutional decisions
16. I often help administrators interpret data for decision-making
17. Employee survey data is used for continuous improvement
18. Respondents are more likely to thoughtfully respond to shorter surveys
19. My perception is that 'survey fatigue' impacts survey quality and response rates
20. Shorter surveys tend to improve quality and response rates

Question Title

9. Group II: Please rate each question based on your perception and/or experience of the relationship between survey data integrity and informed decision-making. (Quality and Quantity)
(IR = Institutional Research function of the college)

  Strongly Disagree Disagree Neutral Agree Strongly Agree
1. Employees are skeptical about being identified in surveys
2. Lower response rates reduce dataset reliability
3. It is more important to have quality responses than all survey questions answered
4. Employees are encouraged to complete surveys from any location of their choosing, even access from home
5. I believe that employees trust reports generated from surveys
6. The more surveys I administer, the more the data will help the institution solve its respective problems
7. There is no relationship between survey quality and informed decision-making
8. Survey data is one of the most important elements in informed decision-making
9. An executive summary of all data collected is provided to employees
10. With current fiscal constraints, surveys should be discontinued
11. Trust between administration and faculty/staff is the most important element in survey quality and quantity
12. Decision-making bias is more likely without survey data
13. Employee perceptions of institutional practices strongly influence survey quality
14. Survey data provides a critical input function into accreditation standards and core requirements
15. The IR department is satisfied with its survey methodologies
16. The IR department has plans to create innovative survey methodologies to improve survey response quality/quantity
17. External datasets collected are made available to employees
18. Innovative survey methodologies will not improve survey return rates
19. Student survey data quality is as important as faculty survey data quality
20. Focus groups should replace survey collection practices

Question Title

10. What would you do to improve participation quality and return rates?

Question Title

11. What additional comments you would like to contribute?

T