Overview of different data collection methods used in program evaluation, including surveys, interviews, focus groups, and secondary data. Covers the strengths and weaknesses of each method and how to choose the appropriate method for the evaluation.
Sampling methods: This involves selecting a representative group or subset of a larger population for data collection.
Qualitative data collection methods: These are methods that involve the collection of non-numeric data through methods such as interviews, focus groups, and observations.
Quantitative data collection methods: These are methods that involve the collection of numerical data through methods such as surveys, questionnaires, and experimental designs.
Survey research: This involves collecting data through surveys, which can be administered online, through mail, phone, or in-person.
Questionnaire design: This refers to designing survey instruments that effectively collect the desired information.
Interviewing: This involves collecting data through face-to-face or phone conversations.
Focus groups: This involves collecting data from a group of people who share common characteristics or experiences through discussions.
Observational research: This involves collecting data through observing individuals, organizations, or events.
Case study research: This involves collecting detailed information about a particular case to understand its features, dynamics, and outcomes.
Documentary and archival research: This involves collecting data from existing documents or archives, such as government reports, policy documents, meeting minutes, or organizational records.
Data collection tools and techniques: These are methods for collecting and recording data, such as data logs, photo and video recording, and digital recorders.
Data quality control and validation: This involves ensuring that the data collected is accurate, reliable, and valid.
Ethics in data collection: This involves ensuring that data collection methods are ethical, and data collection does not cause harm or infringe on the rights of participants.
Sampling bias: This involves error in data collection due to the non-random selection of participants.
Data analysis: This involves the process of interpreting, summarizing, and presenting data collected through various data collection methods.
Surveys: Surveys typically involve questionnaires distributed to a representative sample of people, asking them about their opinions, beliefs, or experiences in relation to a program.
Interviews: Interviews involve one-on-one discussions with program stakeholders, either in person, over the phone, or online. These can be structured, semi-structured, or unstructured.
Focus groups: Focus groups involve small groups of stakeholders who are asked to discuss their views and experiences of a program in a group setting, often facilitated by a moderator.
Case studies: Case studies involve in-depth analysis of a particular program, organization, or individual to understand their experiences, successes, and failures.
Content analysis: Content analysis involves analyzing texts such as program materials, social media posts, news articles, or other documents to understand underlying themes and patterns.
Observations: Observations involve watching program stakeholders and recording their behaviors and interactions to better understand program dynamics.
Experiments: Experiments involve manipulating a program variable and measuring the resulting impact on stakeholders to understand causal relationships.
Performance indicators: Performance indicators involve tracking program outcomes and assessing whether they meet pre-determined targets.
Self-reports: Self-reports involve asking program stakeholders to assess their own behavior and experiences, often through diaries, logs, or questionnaires.
Archival data: Archival data involves analyzing data that has already been collected and stored, such as program records or administrative databases.