Guidelines

What are impact evaluation techniques?

What are impact evaluation techniques?

An impact evaluation involves three different types of questions—descriptive (the way things are or were), causal (how the programme has caused these things to change) and evaluative (overall value judgement of the merit or worth of the changes brought about).

What is project impact evaluation?

Project impact evaluation studies the effect of an intervention on final welfare outcomes, rather than the project outputs or the project implementation process. In other words, impact evaluation looks at project results at a higher level.

How do you evaluate the impact of a project?

Let’s look at the five items you should be evaluating.

  1. Schedule. Project management success is often determined by whether or not you kept to the original timeline.
  2. Quality. The end of a project phase is a good time for a quality review.
  3. Cost.
  4. Stakeholder Satisfaction.
  5. Performance to Business Case.

What are the basic concepts of impact evaluation?

Design of Impact Evaluations Randomized Controlled Trial (RCT) Randomized Offering of Intervention. Randomized Promotion of Intervention. Multiple Treatment Design.

What are major principles you will use to evaluate the impact significance?

There are five key principles relating to internal validity (study design) and external validity (generalizability) which rigorous impact evaluations should address: confounding factors, selection bias, spillover effects, contamination, and impact heterogeneity.

How do you create an impact evaluation?

What you need to design an impact evaluation

  1. Define the evaluation questions most relevant for your program.
  2. Identify the appropriate evaluation methodology and sample.
  3. Draw up detailed plans for your impact evaluation’s implementation.

What is an example of impact?

The definition of impact is one thing crashing into or having an effect on another. An example of impact is the effect that humans are having on the environment.

What is the goal of impact evaluation?

An impact evaluation can be undertaken for formative purposes (to improve or reorient a programme or policy) or for summative purposes (to inform decisions about whether to continue, discontinue, replicate or scale up a programme or policy).

What are the 3 methods of evaluation?

The three main types of evaluation methods are goal-based, process-based and outcomes-based.

What are the two major types of evaluation?

Evaluations are normally divided into two categories: formative and summative.

How do you assess the impact of something?

There are three broad strategies for causal attribution in impact evaluations:

  1. estimating the counterfactual (i.e., what would have happened in the absence of the intervention, compared to the observed situation)
  2. checking the consistency of evidence for the causal relationships made explicit in the theory of change.

What do impact evaluators do for a project?

Evaluators usually work in conjunction with project planners and donors when proposing to conduct impact evaluation. See the following list of resources for a more detailed and in-depth discussion of impact evaluation and available designs.

Where can I find the impact evaluation series?

The complete series can be found on InterAction’s website at: http://www.interaction.org/impact-evaluation-notes . Impact Evaluation Notes No. 1.

What should be included in an introduction to impact evaluation?

This first guidance note, Introduction to Impact Evaluation, provides an overview of impact evaluation, explaining how impact evaluation differs from – and complements – other types of evaluation, why impact evaluation should be done, when and by whom.

Can a design option be used in an impact evaluation?

The design options (whether experimental, quasi-experimental, or non-experimental) all need significant investment in preparation and early data collection, and cannot be done if an impact evaluation is limited to a short exercise conducted towards the end of intervention implementation.