Enumerators training, pre-testing and semi-structured interview

For the semi-structured interview, 15 Enumerators and 3 supervisors were selected based on their professional proximity to natural resource management. Two days of training on the concepts, definitions of CPRs and the contents, approaches and instruments of the survey was provided to all enumerators and supervisors. Before the actual implementation of the survey, interview schedule was pre-tested in 2 nearby villages as part of the training session.

The purpose of pre-testing the interview schedule was to expose the enumerators to a real life interview situation as well as to get feedback on the interview schedule for further amendment. Therefore, based on the feedback, amendments were made to the interview schedule and the final version was completed. From March 2-22, 2011 and October 10-30, 2011, semi-structured interview were conducted with 200 sample respondents.

v) Unstructured Observation

Observation provides direct access to the social phenomena under consideration. Instead of relying on some kind of self-report, such as asking people what they would do in a certain situation, the researcher actually observes and records their behavior in that situation (University of Strathclyde, 2013). In this study naturalistic and narrative methods of observation were used. These methods are a type of unstructured observation which was carried out in real-world settings that attempt to observe things 'as they are', without any intervention or manipulation of the situation itself by the researcher and attempt to 'tell the story' of what is happening in a given situation (University of Strathclyde, 2013). Recording sheets and check lists, observation guides and field notes were used as data collection methods. In addition, with a careful ethical consideration (like requesting permission and convincing the subjects), photo and video cameras were used. However, precautions were taken to avoid the researcher’s biased towards the phenomenon under consideration.

Subjective bias on the part of the observer (in this case the researcher) was triangulated by other means of data collections (such as key informant interview).

74 3.3.3.2 Secondary data

Primary data collected from focus group discussion, stakeholder identification and analysis workshop, key informant interviews, household survey and unstructured observation were supplemented by a documentary analysis at all levels of organization (at national, regional and district level) and literature review. The documentary data sources include: research publications and reports; policies, proclamation; legislation; administrative/executive regulations or orders; compensation arrangements; guidelines/advice; meeting reports and minutes. The legal and administrative framework for natural resource management and changes during 1990-2011 were identified by searching official documents and the scientific literature. Particularly, the legislative and policy environment that can impact critically on the CPR context were reviewed.

75

(a) (b)

Figure 3.3: Focus Group discussion (a) and Stakeholder Analysis workshop, 2011 (b) Source: The Author (2011)

( c) (d) Figure 3.4: Enumerators training (c) Household survey supervision (d) Source: The Author (2011)

76 3.3.4 Methods of data analysis

Quantitative measures of the causes or consequences of institutional arrangements and their change are difficult to develop; even when they are available, better evidence may come from the qualitative historical record (Alston et al. 1996). Arguably, while econometric analysis may be useful in delineating specific factors that determine the causes or driving forces of institutional changes, performance and their effect on common-pool resource management, it does not help much in analyzing processes of institutional origin and changes, attitudes of different stakeholders and conflict resolutions and management systems. Hence, qualitative and descriptive analysis were used to analyze the current state and dynamics of CPRs and policy implications for livelihood security and sustainable CPR use, management and governance, to identify the trends in conditions and describe the pressures being exerted on Lake Tana environment in general and CPRs in particular, identify institutional arrangements and enforcement mechanisms to govern common-pool resources.

Most data analyzed in this research were generated through a series of semi-structured in-depth qualitative and quantitative interviews, stakeholder identification and Analysis workshop, focus group discussions and key informant interviews conducted from September 2010 to December 2011. Following the household survey data collection, data were coded and entered in to SPSS software version 17. Simple descriptive statistics such as mean, standard deviation, frequency were used to analyze the socio economic variables of the respondents. For the analysis of data collected from semi-structured interviews that were administered to sample households, this makes reflection on background possible by enabling triangulation with the data from focus group discussions and key informant interviews.

77

Before the actual qualitative analysis, data collected from open ended questions and written comments on the household survey, testimonials, individual key informant interviews, tape recorded focus group discussions, observations (pictures), field notes, documents, reports, stories and case studies were translated into English, transcribed, coded, patterns and connections within and between categories were identified by using Word processing and Excel spread sheet. The different elements of evidence were used to develop narratives describing CPR situations. Qualitative data were analyzed using narrative data analysis and interpretation methods such as logical analysis, historical narratives and matrix analysis which outline generalized causation by using flow charts, spider diagrams to pictorially represent these; in addition written descriptions were used to understand the trends of resource use and interaction of stakeholders in resource management and governance of common-pool resources. Where relevant, secondary resources were consulted to triangulate and supplement the primary data sources.

For trends in resources management and governance, historical narratives and analysis were used to elicit the past events and conditions, to understand the CPR situation, why changes have occurred and why things are the way they are today. After initial identification of stakeholders, their stake value and power level were identified in a stakeholder identification and analysis workshop; for this purpose a computer based stakeholder Analysis Support tool developed under Rural Economy and Land Use (RELU) Program by Anil Graves was used.

This tool allowed stakeholders to be classified in an ‘‘interest-influence’’ matrix, which displayed and map their attributes and inter-relationships in CPR management and governance (Reed et al. 2009).

78 3.4 Chapter summary

This chapter sought to give an outline of the research approach and techniques adopted by the study. The research project took a scientific approach that combines qualitative and quantitative approaches. A related challenge is the integration of knowledge from qualitative case study research with quantitative research. Quantitative analyses are often criticized for overgeneralization since they disregard context by hiding processes behind data and variables. In contrast, qualitative studies are questioned for being vague and not transferable to other cases. This asserts a dichotomy between quantitative (statistical, mathematical, computational) and qualitative (interpretative, dialectic) methods (Eisenack et al. 2006). This combination of methods, also referred to as triangulation, helps to overcome the limitations and weaknesses inherent in each type of method and contributes to the validation of research findings. Triangulation entails using more than one method or source of data in the study of social phenomena (Bryman, 2012).

The study sample (200 respondents) was achieved on a very limited budget and as such the time spent in the local communities was also limited. With this arrangement, it is likely that discussions with the community members were not as deep as they might have been required. Therefore complementing the household survey with other methods such as key informant interview, focus group discussion, stakeholder analysis workshop was very imperative. Particularly multiple case studies (such as water, fish and wetlands) were studied and compared in their totality (in this case Lake Tana ecosystem). Intensive case study typically focuses on a small number of cases and examines them in depth. This case-study strategy is well suited for close examination of complex empirical processes, for assessing the meanings actors attach to their actions (Ragin et al. 2003). Table 3.3 summarizes the research methodology used in the study.

79 Table 3.3: Summary of research methodology

Research Questions Data sources and data collection methods

semi-structured interview schedule  Simple descriptive analysis (Using SPSS V.17 software)

 Review of relevant policy documents

 Trend and historical narratives and matrix analysis

 Ranking

2. Who are drivers of changes that affect CPR use, management and

 Simple descriptive analysis Chapter 5

3. Who are the key players in the process

semi-structured interview schedule  Simple descriptive analysis

 Ranking Chapter 7

arrangements that govern the behavior of CPR users and what are the factors influencing the effectiveness of CPR management and governance system?

semi-structured interview schedule  Simple descriptive analysis Source: own presentation, 2012

80