Example uses

1. A typology of uses

EvalC3 can be of use at all stages of a project cycle:

During project selection:
- To identify what attributes of project proposals are the best predictors of whether a project will be chosen for funding, or not
- To identify how well a project proposal appraisal and screening process is as a predictor of the subsequent success of projects in achieving their objectives
During project implementation
- When the effectiveness of specific activities are being measured using survey instruments which include both specific (facet) and general (global) measures of satisfaction with service or product delivered. EvalC3 can identify what combination(s) of facets best predict global satisfaction. For example:
  - Participants experiences with workshops and training events
  - Donors and grantees experiences of their working relationships with each other
During a project evaluation
- “Causes of effects” analysis: To identify what combination(s) of project activities (and their contexts) were associated with a significant improvement in beneficiaries lives.
- “Effects of causes” analysis: To identify what combinations of improvements in beneficiaries lives were associated with a specific project activity (or combination of)
- To identify “positive deviants” – cases where success is being achieved despite the fact that failure is the most common outcome. See Postscript note below for details.
During a review of existing evaluations
- Re-analysing data that was collected, to verify the results. This is often possible with QCA based evaluations because QCA data sets are usually published as annexes to evaluations
- Synthesising the results of multiple evaluations, into prediction rules concerning different types of outcomes

“Loose” Theories of Change

More generally, EvalC3 is suitable for use where a project, or part thereof, has a “loose” Theory of Change. Loose in the sense that while the outcomes have been identified, the activities needed to achieve these may not yet be clear and even less so the specific causal pathways that will be involved.

Loose Theories of Change are more likely to be found in participatory development projects, or projects involving a substantial degree of decentralization, as is often the case with projects covering large geographic area and/or many sectors.

For an extended discussion of loose ToC, see my 2016 paper “Evaluating the impact of flexible development interventions using a ‘loose’ theory of change Reflections on the Australia-Mekong NGO Engagement Platform. ODI Methods Lab Working Paper, March 2016