Program evaluation is a specialised area requiring detailed knowledge of a particular activity or business process. Some understanding of program logic, particularly understanding intended outcomes as distinct from outputs or activities, is required. ASR has conducted a number of program or project evaluation studies in the following areas:
Successful program or project evaluation nearly always involves a range of methods and each method must be project specific. For example, if seeking feedback from visually impaired people, there is little point in using web or paper questionnaires. If seeking feedback from long haul transport drivers, mobile phone interviews are most suitable. The challenges of program evaluation are about getting the right people involved in the right way and at the right time.
When conducting evaluations, ASR focuses on lessons that can be learnt for future programs and how the current program can be further improved. This is similar to using action research methods: doing research throughout a program and learning iteratively and changing immediately to evolve a program.
Program evaluation requires creativity and flexibility in research design and reporting.