Data Collection, Analysis and Interpretation

The process for the collection of the required data consists of four primary stages: · Literature review of existing practices.

· Initial park manager interviews.

· Review of data for a number of selected commercial arrangements.

· Following the initial CBM development (using the literature review and other inputs detailed above), validation interviews with commercial operators and park managers.

In determining this approach to data collection and the related sample sizes, one of the

primary driving factors was the potential coverage of park management agencies in Australia. While the intent of this research project was to develop key features of an overall CBM, there are significant State-based differences which limit the ability to achieve this (as was discussed in Section 2.3). Therefore, the research was restricted to the development of a CBM for Victoria, with the research focus requiring the interviews to concentrate on the organisation responsible for park management.

In completing the research a theoretical sampling approach was used with the samples being stratified to ensure all target areas were adequately covered.3 The final feedback interviews were completed using discriminant sampling to ensure maximum benefit was achieved from the interviews. In particular, the interviewees were selected based on their ability to verify the developed model or to assist in the further development of the model. (For a discussion on the use of discriminant sampling in grounded theory see Cresswell 1998.)

Chapter 5 (and particularly Section 5.2.1 [for park manager interviews] and Section 5.3.1 [for the review of existing concession agreements]) provides specific information on the

population sizes, sample sizes, basis of selection of interviewee and approach to completion of interviews. Chapter 7 (and particularly Section 7.1) provides similar information in regard to commercial operator and park manager validation interviews.

The total data collection process along with the relevant population and sample sizes is summarised in Table 3.1 below.

3 _{In using theoretical sampling in grounded theory research, the researcher selects a sample based on the}

Table 3.1: Data Collection Procedures and Sample Sizes

Data Collection Procedure Population Size

Sample

Size Timing Comment

Examination of Victorian and

international practices N/A N/A 2003

Initially completed in 2003, with the literature review then updated in 2006.

Park manager interviews <20 3

January - March

2004

Sample was structured to ensure coverage of all levels of

management. Review of existing

concession agreements <30 16

May – June 2005

Existing agreements was

rationalised to ensure coverage of current agreements encompassing a wide range of services.

Following model development, validation interviews with - commercial operators <30 5 - park managers <20 4 July – Sept. 2006

Interviewees were provided with the proposed CBM for review and feedback.

§ Approach to Park Manager Interviews - The primary data was collected via face-to- face structured open interviews with individuals in the Victorian park management agency (Parks Victoria). In conducting the interview the researcher adopted the position of the ‘empathetic observer’. While the interviewer needs to be objective, it is necessary for the interviewer to understand the position and objectives of the interviewee if the subjective meanings of the information imparted were to be properly understood.

§ Initial Data Research - Based on the interviews with the Victorian park managers, a range of existing commercial relationships was identified and the existing documented information (i.e. the case files) on the relationship examined.

§ Validation Interviews with Commercial Operators and Park Managers - Upon completion of the initial development of the CBM, interviews with commercial operators and park managers were conducted to obtain feedback on the proposed model. Prior to each interview, the interviewee was provided with a copy of the developed CBM. During the interview the commercial operator/park manager was requested to comment on the appropriateness of the CBM (as it pertained to them), identify any perceived concerns with the model, comment on any possible omissions from the model, comment on any possible refinements, and provide any additional comments considered relevant.

3.4.2 Data and Research Timing

This research proposal represents a cross-sectional study as the data collection is from current sources representing the current position. While the sample of existing concession agreement files contains some data of a historical nature, the outcomes were considered based in the current context (as the sample selection criteria included only examining more recent concession agreements where the current context was most applicable).

3.4.3 Data Reduction and Analysis

The data obtained is both qualitative and quantitative in nature. One of the primary data sources are semi-structured interviews where qualitative data is expected to dominate. There will also be significant quantitative data sourced from the initial literature review (in Chapter 4) along with the concession agreement file review (in Chapter 5). This quantitative data will provide useful corroborative support for the analysis and interpretation of the qualitative data. The data will be measured at the nominal and ordinal levels.

Techniques for data reduction and analysis were determined a priori, as it was important the data was collected in a form appropriate to the technique. Content analysis techniques (for determining actual performance) and repertory grid techniques (for considering the relevance and effectiveness of key drivers such as incentive types) were used for the analysis of the quantitative and qualitative data. Content analysis is a research method that uses a set of categorisation procedures for making valid and replicable inferences from data to their context. The method combines qualitative (defining the categories) and quantitative

(determining numbers within categories) aspects. The completion of content analysis requires the conduct of a series of steps -coding, categorising, classifying, comparing and concluding.4 Repertory grid analysis has been used in this research to assist in the analysis of the outcomes of the interviews as it is a technique which enables the comparison and analysis of the

responses to common identified areas.

The reduction and analysis of the quantitative and qualitative types of data followed content analytical procedures based on the principles of grounded theory with data displays being used (where feasible) to summarise the data. In particular:

- initially, the overriding concepts, categories and properties were identified (being the coding step)

- these initial base concepts were further developed and clarified, as necessary, based on the output of the park manager interviews and concession agreement file reviews studies (being the categorising and classification steps), and

- these concepts and categories form the basis for the analysis of the data used for the development of the proposed CBM (being the comparing and concluding steps).

It is important to note that, under this process, the development of the form of data analysis and reduction occurred continuously through the study with it being based on the data actually collected.

3.4.4 Data and Theory Validation

Maxwell (1996, p.87) uses the term validity to refer to the “correctness or credibility of a description, conclusion, explanation, interpretation, or other sort of account”, and identifies two broad threats to validity that are often raised in relation to qualitative studies – researcher bias and reactivity.

Researcher bias is said to be present if data is selected that fits the researchers existing theory or ‘stand out’ to the researcher. Reactivity refers to the influence of the researcher on the setting or individual studies. Reactivity bias is unavoidable in interview situations. What the interviewee says is always a function of the interviewer and the interview setting.

Techniques used in this research project to reduce researcher and reactivity bias were:

· Interview questions were semi-structured and open-ended so as to reduce the possibility of asking leading questions.

· Interviewees were asked to review a written account of the interview.

· Sample sizes and specific samples (for the concession file review and the commercial operator interviews) were selected in conjunction with advice from park managers. · A large sample of concession agreement files was selected to ensure coverage of all types

of services and agreements as against a smaller number of interviews (thereby providing a counter to interviewee bias).

To improve validity triangulation of data was also completed. While one dimensional approaches to the collection and interpretation of data often rely on their own method to validation of approach, a greater measure of confidence can be obtained where a wider range of measures and data sources are used. Therefore, greater validity can be expected from an increased number of measures, with the use of multiple measures being a triangulation of data. (See Neuman 1991.) A number of data sources have been used in this study (being the completion of interviews at various stages, literature research and file reviews – using a variety of methods), with the various data sources enabling the required triangulation

validation of results. Importantly, the proposed CBM was ultimately submitted to a sample of commercial operators and park managers for review and update prior to finalisation.