Determining the Reliability, Accuracy and Validity of the Case

Langley`s (1999) process strategy illustrates that there are trade-offs between accuracy, generality and simplicity, where the object of the strategy is to map the terrain and highlight the fact that a good process strategy takes different routes. This coincides with the view expressed by Langley (1999, p.706):

―the idea that multiple templates can produce better understandings may also be generalised to the use of multiple strategies, again, provided the combinations are complementary and provided simplicity is not compromised in the attempt to achieve integration.‖

Table 4.2 provides a scale of the elements of the sense-making strategies on the three areas of accuracy, simplicity and generality. It shows that narrative, grounded theory

103

temporal bracketing, and visual mapping are high on accuracy but low on simplicity and generality. Synthetic strategy, quantification and computer simulation are low on accuracy but high on simplicity and generality. This framework allows its users to determine which is best to use, given the context of their case. Hence, this case found that narrative and temporal bracketing were best suited for use in explaining and describing what happened during the period under review.

The ordering in table 4.2 demonstrates the ranking that is allotted to each element of the strategy; there are variations among specific applications. For example, while accuracy and simplicity are almost always in opposition to one another, the generality of emerging theories will depend on other factors such as the degree and scope of replications and the source of the conceptual ideas. There have been constant calls in scholarly literature for more in-depth process research that will add to a better understanding of organisational phenomenon. This thesis makes a contribution in this respect.

Table 4.2 Sense-Making Strategies, Accuracy, Simplicity and Generality

Strategy Accuracy Simplicity Generality

Narrative Grounded theory Temporal bracketing Visual mapping Synthetic strategy Quantification Computer simulation High Low Low High Low High Source: Langley, 1999, p.706.

While recognising the importance of the above strategies in presenting data from case studies, this case is, however, concerned with narrative and temporal bracketing strategy which Langley considers relatively high on accuracy, but low on simplicity and generality. The results from this study, therefore, will present a highly accurate account of the events studied in a simplified manner. The results, therefore, will be reflective of a particular situation but can also be applied to similar agreements. Nevertheless, the sense-making from the findings applying the theoretical frameworks (notably the conditions required for commodity agreements and cartels to survive, the position of commodity producers, notably small economies, in the global value chain and decision-making in entities

104

managing the commodity exports with information and knowledge asymmetry and management weaknesses), shows patterns of cause and effect which can be generalised to other situations. Further, the methodology adopted can be replicated in studies of other organisations.15

The issue of accuracy surrounds the mixed set of data which were collected. The first set is the financial data contained in the Annual Financial Statements of the GCNA and the Central Statistical Office. The second set of data relates to recurring data, such as the minutes of the meetings of the Board of Directors, reports and newspaper articles. The third set of data relates to non-recurring, researcher-provoked sets of data which were obtained from interviews and conversations using the semi-structured approach. With regard to the financial statements and statistics provided by the GCNA, these are generally regarded as reliable, since they are audited by a reputable accounting firm. The statistics from the GCNA demonstrate a high level of consistency through the years. The statistics provided by the Ministry of Finance Central Statistics Office are generally regarded as accurate and reliable, as well, being the official repository of such data.

For issues of accuracy, validity and reliability of the qualitative data referred to above as recurring and non-recurring and researcher-provoked, Denzin and Lincoln (2003) and Guba and Lincoln (1994) emphasise the trustworthiness of the investigation. In Guba and Lincoln‘s construct of trustworthiness, 1) credibility, 2) transferability, 3) dependability, and 4) conformability were identified.

1. The issue of credibility. The credibility of the research in this study was enhanced in three ways. First, the financial data used are considered to be reliable and were externally audited statements. Second, multiple sources were used (triangulation) to verify the data contained in reports and minutes of meetings. This involved conversations with actors such as Hachamoff (JHB International), Moermon (Catz International) and management and members of the Board of Directors of the GCNA. Third, the communications channels between the researcher and some key actors were opened, thus allowing the researcher to return to them from time to time to double-check information provided or to seek clarification on issues.

2. The issue of transferability. The key issue according to Lincoln and Guba (1985) is whether the results of the findings are transferable to other contexts. Transferability in the form of generalisability of findings and use of methodology have been discussed earlier in section 4.2.6 in relation to sense-making strategies. Furthermore, the study uses stakeholder analysis to examine the implications of the motivations and actions of

105

stakeholders on a commodity marketing cooperative. The mode of analysis and the findings are transferable to other such cooperatives in Grenada and to other developing countries.

3. The issue of dependability. The question that arises is whether the process of the study is consistent, and reasonably stable over time, and whether the research was done with reasonable care and, therefore, is dependable. This study sought to ensure that the process was reliable. This is seen in the thoroughness of ensuring the credibility of the data. Authenticated data from GCNA were consistently used as well as verified through inter-actions with other key actors.

The use of multiple sources of data is also evident. When there was need for clarity, the researcher either returned to the source and/or verified details by using other sources to cross-check. According to Miles and Huberman (1994), the issue of dependability also has to do with the extent to which the research process is connected to theory. Chapter 3 and earlier parts of this chapter have identified the theoretical contexts of this study. Additionally, the research methodology employed included triangulation, allowing for the use of multiple sources to tell the story, while relying on Ann Langley‘s sense-making (narrative and temporal bracketing) framework to report the findings. An attempt was made to ensure through cross-checking and reviewing that the narrative and explanations were appropriately rooted.

4. The issue of conformability that every finding can be traced back to the original source where the facts were first encountered.

The narrative strategy adopted by this thesis is deeply rooted in the raw data. The researcher is keenly aware that although the narrative strategy is high on accuracy while being relatively low on simplicity and generality, a trade-off is expected since the single- case-study method is focused on particularity and does not easily lend itself to generality (Yin, 1994). Nevertheless, it has been noted earlier that forms of generality can be achieved with respect to the findings and the methodology.