Shared Understanding using ElleVis – Study Overview
As shown in the literature reviewed in Chapters 2 and 3, there is a need to investigate the potential contribution of interactive visualisation to increasing shared understanding between stakeholders holding diverse interests with regard to natural resource issues. The specific natural resource management site used as a case study in this research was Te Waihora/Lake Ellesmere.
To answer the initial research question (See Chapter 1, Section 1.1), this study involved:
• developing an interactive visualisation tool
• applying this tool to a sample of stakeholders
• evaluating the influence of this interactive visualisation tool on the personal and shared
understanding amongst the stakeholders of Te Waihora/Lake Ellesmere.
In developing the interactive visualisation tool, the primary source of visualisation requirements – lake values – was obtained from the local Regional Council (Environment Canterbury). The components of the visualisation combined with the interactivity were to provide information required by the stakeholders to increase their personal and shared understanding about the impact of different opening regimes on lake values at Te Waihora/Lake Ellesmere. The term “lake values” refers to farming, nature conservation and other stakeholder interests that are affected by the different opening regimes at Te Waihora/Lake Ellesmere. When discussing stakeholder interests in the lake, henceforth the term “lake values” will be used to encapsulate these.
The evaluation of the influence of the visualisation tool on the personal and shared understanding amongst the stakeholders was undertaken via a pre-test and post-test methodology. A variety of data was collected from the stakeholder participants to measure their personal and shared understanding. In this study, personal understanding was assessed by participants showing evidence that their levels of understanding had increased in the post-tests following use of ElleVis. Assessing shared understanding involved participants showing an achievement of at least partially correct answers to all pre-test and all post-test questions – including those covering interests outside their own particular areas – following use of the visualisation tool (ElleVis). Without such a basic level of understanding, it may be difficult for stakeholders to appreciate the different views on lake values that are of significance to other stakeholders.
4.1
Research overview
In this section, the design of the interactive visualisation tool, the case study area, categories of Te Waihora/Lake Ellesmere stakeholders and the method used in this study to answer the main research question of the initial study, are briefly described.
4.1.1
Design of the visualisation tool
The interactive visualisation tool was designed to allow the stakeholders to visualise the impact of different opening regimes on lake values at Te Waihora/Lake Ellesmere. The primary source of visualisation requirements was the lake opening consent (CRC 042860) from the local Regional Council (Environment Canterbury) (see Chapter 5, Section 5.1). The tool consists of a line-graph, a map showing lake extent and a summary table with “traffic light” status for lake values –birds, fish, farming and other stakeholder interests. The design of the tool allows users to configure lake opening scenarios and select conditions under which they are viewed.
The interactive visualisation tool was implemented in 2D using VB.Net (2008 release). The line graph was implemented using Zedgraphs and the lake map, using ArcGIS. The summary table was implemented in Microsoft Excel 2007 and connected as a Database to .NET. (See Chapter 5, Section 5.4, for more details about the implementation of ElleVis).
4.1.2
Evaluation
This initial study utilises a pre-experimental one-group pre-test and post-test design (Gay, 1987). Using this design, participants undergo a pre-test, are exposed to the intervention, and then undergo post- test. This type of design is used in circumstances where there are only a few participants and the use of control or comparison groups is not feasible. This study had ethics approval from Lincoln University (see Appendices B.1, C.1 and D.1). Several types of data were collected to determine participants’
personal and shared understanding involving the impact of opening regimes on lake values relating to Te Waihora/Lake Ellesmere and for estimating the ability of ElleVis to assess these shared understandings. Data collection included:
• Pre-test and post-test questions that were structured into four sections to assess the impact of opening regimes on lake values at Te Waihora/Lake Ellesmere
• A post-study questionnaire that allowed participants’ impressions of the tool to be recorded
• Background information on participants’ involvement with Te Waihora/Lake Ellesmere and their stakeholder affiliations
Participants’ responses in the pre-test and post-test were scored against a grading schedule. The results were analysed using descriptive statistics to examine the variability of the pre-test and post- test scores, as measured by the mean, median and standard deviation. However, examining these scores by descriptive statistics alone is not sufficient, as the significance of any changes cannot be deduced. Paired sample t-test and Wilcoxon signed-rank test were used to determine the significance of changes between pre-test and post-test scores.
Participants’ shared understanding was assessed using the pre-test and post-test scores in three knowledge areas – birds, fish and farming. This was done in two ways. First, the number of answers at least partially correct in each knowledge area was recorded and tabulated. Second, these numbers were coded into binary outcomes, with “0” representing participants who do not have a basic level of understanding for shared understanding to occur and “1” representing those that have a basic level of understanding sufficient to begin appreciating other stakeholders’ points of view (shared understanding). To test whether the differences in participants’ shared understanding in the pre-test and post-test were statistically significant, a McNemar test was conducted. The test involved using a null hypothesis that there is no difference in frequency of shared understanding between the pre-test and post-test.
4.1.3
Study setting
Te Waihora/Lake Ellesmere is the natural resource management site used as a case study for the initial research (see Chapter 1, Section 1.2). There is a lack of agreement between the various stakeholders as to the level at which the lake has to be maintained and how that level has to be manipulated. Different lake levels are perceived to advantage some stakeholders’ interests and to disadvantage others. For example, a high lake level will inundate surrounding farmlands but is good for fishing and recreational users interested in duck shooting.
4.1.4
Stakeholders of Te Waihora/Lake Ellesmere
For the purposes of this study, the target population are members of stakeholder organisations of Te Waihora/Lake Ellesmere which are consulted as directed by the Environment Canterbury (ECAN) Resource consent (CRC 042860) with regard to the opening and closing of the lake. Since these stakeholder participants are consulted about the opening and closing of the lake, they have a rich history of understanding impact of such changes on their specialised, i.e., personal, areas of interest. The interactive visualisation tool is designed and applied to samples drawn from these stakeholders to evaluate their personal and shared understanding about the impacts of the different opening regimes on lake values.
4.1.5
Study design
As already discussed previously (Section 4.1.2), this study utilises a pre-experimental one-group pre- test and post-test design (Gay, 1987). The pre-experimental one-group pre-test and post-test design is often utilised in situations where control or comparison groups are unavailable. This design was utilised because of the very small composition of some stakeholder groups, particularly lake settlers, farmers and recreational users. Due to the small numbers in these groups, dividing these groups into treatment and control groups may not produce statistically significant results. In a pre-experimental, one-group design, participants are tested twice, once pre- and once post- intervention. This type of study design is suited to an investigation which seeks to test the effectiveness of an intervention to ascertain whether the understanding of participants has improved over time (Bamberger, Rugh, Church, & Fort, 2004). Statistical analysis is normally used to ascertain whether the intervention has had a significant effect.
4.2
Summary
This chapter has briefly outlined the processes involved to investigate the initial research question for this study. An interactive visualisation tool was designed to assess the personal and shared
understanding of the stakeholders of Te Waihora/Lake Ellesmere who have a rich history of the impact of the lake opening regime on their specialised areas of interests. A pre-experimental one-group pre- test and post-test design was utilised for data collection. Several statistical procedures were performed on the pre-test and post-test results to examine whether the effect of using the visualisation tool has been demonstrated, and also to test the statistical significance of participants’ change in personal and
shared understanding following their use of the tool.
In the next chapter, Chapter 5, the requirements and design of the visualisation are described. It will become apparent that while some complexities are hidden for ease of use, every attempt is made in the development of the tool to ensure it reflects actual lake behaviour.