"Program evaluation is a systematic method for collecting, analyzing, and using information to answer questions about projects, policies and programs, particularly about their effectiveness and efficiency."
The study of how programs are evaluated and how their effectiveness is measured.
Evaluation Theory: An understanding of the different models and techniques of program evaluation, such as logic models, goal-free evaluations, and utilization-focused evaluation.
Program Design: An understanding of how programs are developed and designed to achieve specific outcomes, as well as the importance of program goals and objectives.
Data Collection: An understanding of various data collection methods and instruments, such as surveys, interviews, focus groups, and observation, and the importance of data integrity.
Data Analysis: An understanding of statistical techniques and methods of data analysis, such as regression analysis, ANOVA, and hypothesis testing, to evaluate program effectiveness.
Evaluation Planning: An understanding of the importance of planning and designing evaluations that are aligned with program goals, objectives, and outcomes.
Performance Measures: An understanding of developing performance measures, such as output, outcome, and impact measures, to assess program effectiveness.
Cost-Benefit Analysis: An understanding of the principles, techniques, and methodologies of cost-benefit analysis, which is used to assess the value of a program, including monetary benefits and costs.
Program Implementation: An understanding of how programs are implemented, monitored, and managed, and how evaluation is integrated into the program cycle.
Stakeholder Engagement: An understanding of how to engage with stakeholders, such as clients, users, staff, and funders, to ensure they are involved and invested in the evaluation process.
Communication: An understanding of how to communicate evaluation findings effectively, using appropriate methods and strategies, to relevant stakeholders.
Formative Evaluation: This type of evaluation is usually conducted during the early stages of a program to assess and improve the program design, implementation, and operations. It helps identify potential problems and opportunities for improvement.
Summative Evaluation: This type of evaluation is conducted at the end of a program to assess the overall effectiveness and impact of the program. It measures program outcomes against predetermined goals and objectives.
Process Evaluation: This type of evaluation assesses the extent to which a program is being implemented as planned. It focuses on program activities, outputs, and outcomes to identify areas for improvement.
Impact Evaluation: This type of evaluation looks at the actual changes and effects that a program has on its target population. It measures changes in knowledge, attitudes, behavior, or health resulting from program participation.
Cost-Benefit Evaluation: This type of evaluation assesses the costs of implementing a program compared to its benefits. It helps determine if the program is cost-effective and if it should be continued or not.
Cost-Effectiveness Evaluation: This type of evaluation assesses the costs of achieving a specific outcome or goal. It measures the cost per unit of outcome achieved and helps identify where resources are best allocated.
Needs Assessment: This type of evaluation identifies the needs and issues of the target population that a program addresses. It helps ensure that the program is tailored to the needs of the population and is effective in addressing the identified problems.
Outcome Evaluation: This type of evaluation assesses the immediate and observable effects of a program on its target population. It measures changes in behavior or health outcomes resulting from program participation.
Implementation Evaluation: This type of evaluation assesses the extent to which a program is being implemented according to plan. It helps identify areas where implementation can be improved and ensures that the program is operating efficiently.
Quality Evaluation: This type of evaluation assesses the quality of a program's outputs and outcomes. It helps ensure that the program is achieving its intended results at the desired level of quality.
"To some degree, program evaluation falls under traditional cost–benefit analysis, concerning fair returns on the outlay of economic and other assets; however, social outcomes can be more complex to assess than market outcomes, and a different skillset is required."
"Considerations include how much the program costs per participant, program impact, how the program could be improved, whether there are better alternatives, if there are unforeseen consequences, and whether the program goals are appropriate and useful."
"Best practice is for the evaluation to be a joint project between evaluators and stakeholders."
"A wide range of different titles are applied to program evaluators... Program Analysts, Program Assistants, Program Clerks (United Kingdom), Program Support Specialists, or Program Associates, Program Coordinators."
"Evaluation became particularly relevant in the U.S. in the 1960s during the period of the Great Society social programs associated with the Kennedy and Johnson administrations."
"Extraordinary sums were invested in social programs, but the impacts of these investments were largely unknown."
"People who do program evaluation come from many different backgrounds, such as sociology, psychology, economics, social work, as well as political science subfields such as public policy and public administration."
"Some universities also have specific training programs, especially at the postgraduate level in program evaluation, for those who studied an undergraduate subject area lacking in program evaluation skills."
"Program evaluations can involve both quantitative and qualitative methods of social research."
"Stakeholders might be required to assess—under law or charter—or want to know whether the programs they are funding, implementing, voting for, receiving or opposing are producing the promised effect."
"Evaluators help to answer these questions."
"The process of evaluation is considered to be a relatively recent phenomenon. However, planned social evaluation has been documented as dating as far back as 2200 BC."
"...to answer questions about projects, policies and programs, particularly about their effectiveness and efficiency."
"Social outcomes can be more complex to assess than market outcomes, and a different skillset is required."
"...how the program could be improved, whether there are better alternatives..."
"Considerations include how much the program costs per participant... concerning fair returns on the outlay of economic and other assets."
"If there are unforeseen consequences..."
"Best practice is for the evaluation to be a joint project between evaluators and stakeholders."
"...whether the program goals are appropriate and useful."