There is a joint interest of APPAM academic and non-academic institutional members for policy and public affairs programs to produce graduates with marketable skills. However, there is little information available about the skills desired of new Masters-level and new Doctorate-level researchers employed by APPAM’s non-academic institutional members. APPAM is launching this data collection as a benefit to both our academic and non-academic members to help graduate programs improve the match between the skills of graduates and those desired by research firms.

Our goal is to share the survey results in aggregate at the Spring Conference/Institutional Reps Meeting in May, and we would greatly appreciate and value your participation and contributions.  We will not identify responding institutions.

The survey should only take about 15 minutes of your time.  We really appreciate your participation by April 15.

Question Title

* 1. How important are the following research skills in your assessment of candidates for new Masters-level research positions?

  Very Important Somewhat Important Not Important Not applicable (researchers at this level do not typically conduct work that requires these skills)
Basic quantitative data analysis (e.g., descriptive, bivariate, multiple or logistic regression)
Advanced quantitative data analysis (e.g., structural equation modeling, hierarchical linear modeling, propensity score matching)
Data analytics (e.g., machine learning, predictive analytics)
Qualitative data analysis
Mixed-methods analysis
Cost-Benefit Analysis
Program evaluation study design: Evaluability assessment
Program evaluation study design: Formative assessment
Program evaluation study design: Summative assessment
Program evaluation study design: Impact Evaluation
Program evaluation study design: Quasi-experimental designs
Program evaluation study design: Implementation studies
Program evaluation study design: Other descriptive studies
Systematic reviews
Survey design
Performance measurement
Policy analysis

Question Title

* 2. How important are the following research skills in your assessment of candidates for new PhD-level research positions?

  Very Important Somewhat Important Not Important Not applicable (researchers at this level do not typically conduct work that requires these skills)
Basic quantitative data analysis (e.g., descriptive, bivariate, multiple or logistic regression)
Advanced quantitative data analysis (e.g., structural equation modeling, hierarchical linear modeling, propensity score matching)
Data analytics (e.g., machine learning, predictive analytics)
Qualitative data analysis
Mixed-methods analysis
Cost-Benefit Analysis
Program evaluation study design: Evaluability assessment
Program evaluation study design: Formative assessment
Program evaluation study design: Summative assessment
Program evaluation study design: Impact Evaluation
Program evaluation study design: Quasi-experimental designs
Program evaluation study design: Implementation studies
Program evaluation study design: Other descriptive studies
Systematic reviews
Survey design
Performance measurement
Policy analysis

Question Title

* 3. How important are the following writing and communication skills in your assessment of candidates for new Masters-level research positions?

  Very Important Somewhat Important Not Important Not applicable (researchers at this level do not typically conduct work that requires these skills)
Literature reviews
Report writing (e.g., for technical reports, study designs, issue briefs, white papers)
Non-technical writing (e.g., for op-eds, blogs, tweets, online data stories)
Writing for professional journals
Proposal writing (e.g., for grants or contracts)
Ability to translate technical material into non-technical material for a lay audience
Data visualization skills
Oral communication/presentation skills for: Conference Presentation
Oral communication/presentation skills for: Client Interactions
Oral communication/presentation skills for: Business Development Networking Opportunities

Question Title

* 4. How important are the following writing and communication skills in your assessment of candidates for new PhD-level research positions?

  Very Important Somewhat Important Not Important Not applicable (researchers at this level do not typically conduct work that requires these skills)
Literature reviews
Report writing (e.g., for technical reports, study designs, issue briefs, white papers)
Non-technical writing (e.g., for op-eds, blogs, tweets, online data stories)
Writing for professional journals
Proposal writing (e.g., for grants or contracts)
Ability to translate technical material into non-technical material for a lay audience
Data visualization skills
Oral communication/presentation skills for: Conference presentation
Oral communication/presentation skills for: Client interaction
Oral communication/presentation skills for: Business development networking opportunities

Question Title

* 5. How important are the following areas of experience in your assessment of candidates for new Masters-level research positions?

  Very Important Somewhat Important Not Important N/A (researchers at this level do not typically conduct work that requires this experience)
Contract or grant budgeting
Project management
Teaching experience
Professional experience in nonacademic organizations (e.g., internships or paid employment)
Expertise in a particular policy area

Question Title

* 6. How important are the following areas of experience in your assessment of candidates for new PhD-level research positions?

  Very Important Somewhat Important Not Important N/A (researchers at this level do not typically conduct work that requires this experience)
Contract or grant budgeting
Project management
Teaching experience
Professional experience in nonacademic organizations (e.g., internships or paid employment)
Expertise in a particular policy area

Question Title

* 7. How important are the following other skills or experiences in your assessment of candidates for new Masters-level research position?

  Very Important Somewhat Important Not Important N/A (researchers at this level do not typically conduct work that requires this skill or experience)
A record of publications
Interpersonal skills

Question Title

* 8. How important are the following other skills or experiences in your assessment of candidates for new PhD-level research position?

  Very Important Somewhat Important Not Important N/A (researchers at this level do not typically conduct work that requires this skill or experience)
A record of publications
Interpersonal skills

Question Title

* 9. How often are new Masters-level researchers at your organization expected to use the following software packages?

  Frequently
Occasionally
Rarely/Never
Study design software (e.g., PowerUp!, Optimal Design)
SAS
STATA
SPSS
R
Python
Machine Learning
MPlus
ARCGIS
Tableau
D3
Git/GitHub
NVivo
Excel
Other quantitative software, specify below
Other data analytics software, specify below
Other geographic information systems software, specify below
Other qualitative software, specify below

Question Title

* 10. How often are new PhD-level researchers at your organization expected to use the following software packages?

  Frequently
Occasionally
Rarely/Never
Study design software (e.g., PowerUp!, Optimal Design)
SAS
STATA
SPSS
R
Python
Machine Learning
MPlus
ARCGIS
Tableau
D3
Git/GitHub
NVivo
Excel
Other quantitative software, specify below
Other data analytics software, specify below
Other geographic information systems software, specify below
Other qualitative software, specify below

Question Title

* 11. Where do you recruit candidates for new Masters- or Doctorate-level research positions? (Check all that apply)

Question Title

* 12. Please leave your name and the name of your institution. It will be used for follow up purposes only, we will not reveal responding institutions.

T