Appendix A: A program logic model and applied research questions
- Page ID
You may hear social research referred to as “pure” or “applied.” Pure research aims to build knowledge for its own sake; applied research aims to be useful for doing things like solving problems, making the most of resources, identifying opportunities for improvement, and supporting planning how to reach a goal. These can be useful distinctions, though they’re certainly not mutually exclusive categories. Much pure research is eventually very useful, and much enlightening knowledge is generated in the course of conducting applied research.
When the goal is applied research about a program, organization, or policy, models often play the role of theory in the research process. I’ll focus here on how models can help generate empirical research questions. The following logic model, for example, depicts how a simple afterschool tutoring program is intended to work.
The inputs include all of the resources for the program (high school student-tutors, curriculum, and the cafeteria) and the demand for the program (middle schoolers who need help with math). The activities are the main actions undertaken by the program, and the outputs are the observable, countable units of service produced. The outcomes depict the chain of intended program results—the ways the program is intended to make the world a better place.
All components of the logic model can generate applied research questions to guide inquiry that could be helpful for the entire program planning and evaluation process. Here are some examples ...
Questions to understand and establish the need for the program:
How many middle schoolers need help?
What are the middle schoolers’ academic strengths?
What math concepts are especially challenging for the middle schoolers?
What are the middle schoolers’ study habits?
How do the middle schoolers feel about learning math?
Questions about program resources:
What tutoring skills do the high school students have?
What math knowledge do the high school students have?
How much time do the high school students have to commit to the program?
Is the cafeteria environment conducive to learning?
Questions about activities and outputs:
10. Are the high schoolers using good tutoring practices?
11. Are the high schoolers following the group tutoring curriculum?
12. Are the middle schoolers staying actively engaged in the tutoring?
13. Are there any barriers to middle schoolers’ participation?
14. What do the middle schoolers believe is the most helpful about the program?
15. What do high schoolers think is going well? What concerns do they have?
Questions about outcomes and possible unintended consequences:
16. Are the middle schoolers gaining a better understanding of the targeted math concepts?
17. Are the middle schoolers’ grades in math improving?
18. Are the middle schoolers developing better independent study skills?
19. How are the middle schoolers’ study habits changing?
20. How is the program affecting middle schoolers’ overall academic performance?
21. How is the program affecting middle schoolers’ attitudes toward school and learning?
22. How is the program affecting middle schoolers’ participation in co-curricular activities?
23. How is the program affecting the high schoolers’ educational aspirations?
24. How is the program affecting high schoolers’ academic performance?
25. What changes in the students have their parents observed?
26. What changes in the students have their teachers observed?
27. How will the program affect middle schoolers’ academic performance next year?
Questions linking activities, outputs, and outcomes:
How much time in one-on-one tutoring is sufficient for improving middle schoolers’ understanding of the targeted math concepts?
Do middle schoolers who participate more often achieve larger gains in academic performance?
Which middle schoolers benefit the most from the group tutoring sessions?
How does participating middle schoolers’ academic performance differ from non-participating students’ academic performance?
How do the students feel they’ve changed due to participating in the program?