Analytical methodology: Interpreting a catchment-management system
4.2. Exploring the system through Agent-Based Modelling (ABM)
4.2.6. Ethical considerations in modelling
Agent-based modelling, as with any other form of methodology, may have harmful consequences if performed unethically. Therefore the consideration of reducing harm throughout the process is important. This is particularly true in modelling, where the researcher has responsibility for the creation of a world and of direct representations of actors, supposedly representative of some reality that may be relevant for others. The problems may arise from the socially embedded nature of the processes of creation, interpretation and communication models or model results.
Therefore model results may get a life of their own beyond the intended consequences due to social systems and practices, particularly if the processes of verification and validation are misunderstood or miscommunicated (Oreskes et al., 1994). In this research, several issues were considered:
The transformation of data into the model was considered due to the direct relation of the words of stakeholders in the interviews to the rule for agents’ behaviours in the model. There may be potential for a misunderstanding about how the model might be created based on what they say. The first consideration was to make the stakeholders aware of the possibility of the use of their words to inform a model and modelling process. The information sheet distributed to interviewees (Appendix A) detailed the possible inclusion of their ideas in a model, but reassured that their contributions would be generalised. Such information meant that all interviewees were
120 aware that the information they gave might be used and interpreted in several ways. Ören (2005) advocates, in a description of a code of ethics for modelling and simulation, that professional competence should play a large role in reducing harm to participants and audiences. For example in order to ensure ethical transformation of data into a model, clear and justified methods should be used. Equally, the process should be documented comprehensively so that the decisions of the modeller can be traced back. In this research the processes of thoroughly reporting and documenting methodology at each point in the modelling process means that the decisions can be justified and the process validated should problems arise with representation.
The representation of agents in the model was the second consideration as the choices made about each actor may be acceptable or disagreeable to those actors when presented back. Again, documenting decisions was used to mitigate against potential problems. Important decisions such as the scale of agents represented in the model (e.g. individual and organisational) could be impactful on outcomes. For example if individuals were represented the conclusions of the research may have personal consequences for those involved if they were seen to be directly represented, which may be more contentious than if just organisations were represented. Equally, there could be room for misrepresentation at such a level. Therefore the decisions need to be justified, documented and communicated correctly (here, using the ODD protocol).
The communication and dissemination of outcomes is another important aspect and relates to the need to avoid misleading the audiences of the model as to its purpose. In this research the model results are planned to be communicated back to the stakeholders involved in the research post-write-up, but the emphasis will be on the experimental format of the model and the purpose of the model to start discussions rather than predict any future behaviour or realistically represent a future scenario. There will be an emphasis on the use of the model in the research and its purpose as part of the evaluation process.
4.3. Summary
Chapters 3 and 4 have introduced and described the combination of methodological approaches utilised in this study to gain perspectives on a catchment management system. Chapter 3 first introduced the case study of the River Wear catchment in NE England as a suitable location to observe the collaborative Catchment-Based Approach to water management. The involvement of the stakeholders in the Wear catchment in CaBA through a pilot phase and into the full roll
121 out of the approach over a six year period meant they had experience of the transition of practice and were able to reflect on its impact and on its manifestation in current actions and activities.
The chapter outlined the process of data collection for the project, which foremost consisted of qualitative interviews with stakeholders involved in management activities. Chapter 4 then detailed the methodological approached to analysis of the qualitative interview data through a network approach and ABM. The techniques involved in transforming the data into representations of networks through diagramming and analysis, and by ABM as a heuristic research tool.
The following chapters describe and analyse the observations about the system of catchment management and the practices and mechanisms of stakeholder actions and interactions, that result from the multiple methodological approaches; Chapter 5 will outline the inferences from a network approach to analysing the system; Chapter 6 will explore the drivers and enablers of networked practice from the stakeholders perspectives; and Chapter 7 will present an ABM and analyse how it can offer a deeper understanding of processes and raise important questions about behaviour and influence on change.
122