"Program evaluation is a systematic method for collecting, analyzing, and using information to answer questions about projects, policies and programs, particularly about their effectiveness and efficiency."
Explains the different research designs used in program evaluation, such as experimental and non-experimental designs, and how they can be applied to program evaluation in public administration.
Research design and methodology: This topic focuses on the various research designs and methodologies used in program evaluation, including quantitative and qualitative research.
Sampling techniques: This includes the methods used in selecting a sample that is representative of the population being evaluated.
Measurement and data collection: This topic deals with the tools and techniques used in collecting data, including surveys, interviews, and observation.
Data analysis and interpretation: This covers the various statistical and analytical methods used to analyze and interpret data, including descriptive statistics and inferential statistics.
Logic models: A logic model is a framework that outlines the components of a program and the expected outcomes.
Impact evaluation: This type of evaluation focuses on determining the impact of a program on the target population.
Process evaluation: Process evaluation focuses on the implementation of a program, including the activities, resources, and delivery of services.
Cost-benefit analysis: This involves determining the monetary value of the benefits gained from a program compared to its costs.
Ethics in program evaluation: This topic covers the ethical considerations that should be taken into account when conducting program evaluation studies.
Reporting and dissemination: This topic deals with the presentation and dissemination of the research findings to stakeholders, policymakers, and the general public.
Experimental design: A design where the researcher manipulates one or more variables to determine the cause-and-effect relationship between variables. It involves a control group and an experimental group.
Quasi-experimental design: A design that mimics an experimental design but lacks one or more essential elements such as random assignment to treatment or control groups.
Pre-experimental design: A design that lacks a control group, random assignment, or both.
Survey research design: A design that involves administering questionnaires, interviews, or surveys to a sample of respondents in order to get their opinions or attitudes about a certain topic.
Case study design: A design that focuses on a specific case or event that represents a unique example of a phenomenon. It involves studying a single case in detail.
Longitudinal design: A design that tracks the same group of individuals over an extended period of time to examine the changes or stability of a phenomenon.
Cross-sectional design: A design that examines a sample of individuals at a single point in time to determine the prevalence of a phenomenon.
Action research design: A design that involves collaborative inquiry by participants to identify, address, and solve problems in a real-world setting.
Comparative design: A design that compares two or more groups, events or conditions to identify similarities and differences.
Meta-analysis: A design that combines the statistical results of multiple studies into a single analysis to gain more precise estimates of the size of the effects of a phenomenon.
"To some degree, program evaluation falls under traditional cost–benefit analysis, concerning fair returns on the outlay of economic and other assets; however, social outcomes can be more complex to assess than market outcomes, and a different skillset is required."
"Considerations include how much the program costs per participant, program impact, how the program could be improved, whether there are better alternatives, if there are unforeseen consequences, and whether the program goals are appropriate and useful."
"Best practice is for the evaluation to be a joint project between evaluators and stakeholders."
"A wide range of different titles are applied to program evaluators... Program Analysts, Program Assistants, Program Clerks (United Kingdom), Program Support Specialists, or Program Associates, Program Coordinators."
"Evaluation became particularly relevant in the U.S. in the 1960s during the period of the Great Society social programs associated with the Kennedy and Johnson administrations."
"Extraordinary sums were invested in social programs, but the impacts of these investments were largely unknown."
"People who do program evaluation come from many different backgrounds, such as sociology, psychology, economics, social work, as well as political science subfields such as public policy and public administration."
"Some universities also have specific training programs, especially at the postgraduate level in program evaluation, for those who studied an undergraduate subject area lacking in program evaluation skills."
"Program evaluations can involve both quantitative and qualitative methods of social research."
"Stakeholders might be required to assess—under law or charter—or want to know whether the programs they are funding, implementing, voting for, receiving or opposing are producing the promised effect."
"Evaluators help to answer these questions."
"The process of evaluation is considered to be a relatively recent phenomenon. However, planned social evaluation has been documented as dating as far back as 2200 BC."
"...to answer questions about projects, policies and programs, particularly about their effectiveness and efficiency."
"Social outcomes can be more complex to assess than market outcomes, and a different skillset is required."
"...how the program could be improved, whether there are better alternatives..."
"Considerations include how much the program costs per participant... concerning fair returns on the outlay of economic and other assets."
"If there are unforeseen consequences..."
"Best practice is for the evaluation to be a joint project between evaluators and stakeholders."
"...whether the program goals are appropriate and useful."