Flying blind, or going with the flow?: Using constructivist evaluation to manage the unexpected in the GraniteNet project

Abstract

The GraniteNet Project is a research and development collaboration between the University of Southern Queensland, Australia, and the community of Stanthorpe – a rural community of just over 10,000 people located within the university’s regional catchment area. The vision of this Community Informatics project, which commenced in 2007 and is now in its third phase, is the development of a sustainable community designed, owned and managed web portal that will support Stanthorpe’s development as a ‘learning community’. With funding from the State Government, the GraniteNet Board commissioned an evaluation of the second phase of the project which focussed on the design, development and trial of an incubator community portal environment, a portal governance framework and community engagement strategy. Participatory Action Research (PAR) and constructivist (or “Fourth Generation”) evaluation methodologies were adopted to guide the evaluation with the aims of documenting the project, establishing an evidence base to inform future decision-making, identifying and exploring significant contextual factors impacting on the project, evaluating the effectiveness of the models and processes used to guide the project, and building a culture of evaluation that would help to ensure ongoing review and critical reflection on progress. The evaluation design encompassed formative, summative and research evaluation. This paper reports the evaluation processes and outcomes, with a focus on exploring the ways in which these methodologies can be used to help Community Informatics researchers and practitioners learn from and about the unexpected and unanticipated in a field where learning through experimentation is the name of the game, imagination, creativity and collaborative design the keys to innovation and transformation, and where more traditional evaluation methodologies are becoming increasingly irrelevant.