Question 3 - frameworks and shortcomings

These two questions ask which approach, framework or method was used to evaluate. There is limited data since only 7 of the 15 projects really did any kind of evaluation.

From these 7, 3 didn’t use any particular framework (could infer that they didn’t know any names of frameworks or didn't appreciate the benefit of using such).

The other 4 named frameworks – two created their own (but these were not rigorous or tested)

one cited CICTO which is used for software evaluation (not project eval)

and one cited PAR which is not an evaluation approach but a research approach – could say that this is developmental evaluation and could also infer that there is some confusion over what is difference between evaluation and research?


When asked about shortcomings of frameworks, the following themes were evident in answers:

1. External eyes would be helpful 
2. Formative and summative is imperative
3. Don’t be too ambitious – time is limited
4. Need a good project manager