Making Information Meaningful

Program / project evaluation

Program evaluation is a specialised area requiring detailed knowledge of a particular activity or business process. Some understanding of program logic, particularly understanding intended outcomes as distinct from outputs or activities, is required. ASR has conducted a number of program or project evaluation studies in the following areas:

  • Migrant settlement
  • Government agency business reporting metrics
  • Success of small business IT training program
  • Outcomes of agency initiatives to build work health & safety capabilities and knowledge in a range of high risk industries
  • Success of a return-to-work initiative
  • Assessment of a plan to build community organisations’ capacity and capability
  • User feedback about a new feature for visually impaired television viewers.

Successful program or project evaluation nearly always involves a range of methods and each method must be project specific. For example, if seeking feedback from visually impaired people, there is little point in using web or paper questionnaires. If seeking feedback from long haul transport drivers, mobile phone interviews are most suitable. The challenges of program evaluation are about getting the right people involved in the right way and at the right time.

When conducting evaluations, ASR focuses on lessons that can be learnt for future programs and how the current program can be further improved. This is similar to using action research methods: doing research throughout a program and learning iteratively and changing immediately to evolve a program.

Program evaluation requires creativity and flexibility in research design and reporting.