The Major Data Collection Methods Used

Multiple qualitative data collection techniques were used to gather information. Participant observations were a major component of the data collection and were enhanced by interviews, focus groups and document analysis.

3.2.5.1 Participant Observations

Effective participant observation has the potential to minimize the distance between researcher and participants, allowing a greater understanding of the

complexity of the research context while at the same time enhancing relationships between the researcher and the participants (Dalton, Elias, & Wandersman, 2001). One of the advantages of participant observation is that it gives the researcher the opportunity to be viewed as someone from within the group rather than as an external researcher (Glesne & Peshkin, 1992).

One of the most important methods of data collection in this study was through participant observations, which were used throughout the entire data collection period. Being an active member of the CFK evaluation team for the vast majority of the program maximized my involvement with the case study, as well as enhancing my opportunities to be a participant observer. Initially it provided an opportunity to form relationships with my participants, while at the same time helping me gain a more thorough understanding of the context in which the program was being implemented. It also provided an opportunity to explain my study to participants and allowed them to see the potential benefits my findings may have for the implementation of the intervention. Later, as I became accepted as part of the ‘team’, I was able to use this method to observe discrepancies between verbal and non-verbal behavior and between program philosophy and action, as well as tensions within the group. This allowed me to gain insights into their implementation practices that would not have been available to me if I had merely conducted individual interviews and focus group sessions.

Throughout the two and a half years of data collection, I attended 24 monthly evaluation meetings, 10 advisory committee meetings, five reflective meetings and selected working party meetings. Monthly evaluation meetings were approximately two hours in length, while advisory committee meetings and working party meetings were approximately one hour in length. The reflective meetings ranged in duration from four hours to two days. I also attended a number of informal gatherings as well as formal program launches and

celebrations. The observations made during these meetings provided invaluable data regarding the internal functioning of the group.

Detailed written notes were kept of all meetings. Reflective meetings and selected monthly evaluation meetings were also recorded on an audio recording

and then expanded upon in private. They were designed to provide a

comprehensive description of the context, by including details of the physical setting, verbal and non-verbal behavior of the participants, conversations and activities (Merriam, 1998). In addition, reflective notes were recorded after the observations, which included my impressions, ideas and feelings (Glesne & Peshkin, 1992).

3.2.5.2 Semi-Structured Interviews and Focus Groups

Data gathered via an interview complements observational data. Interview data allows the researcher to move back and forth in time, while observations provide in-depth information about the present (Lincoln & Guba, 1985).

Interviews are used in case study research to expand upon the data gathered via observations. They allow researchers to gain access to other interpretations and perspectives of the case (Stake, 1995).

Twenty-nine interviews were conducted with a wide range of participants. Program staff and managers were interviewed on many separate occasions. Advisory committee members, volunteers and key stakeholders were also interviewed. The interviews were audio-taped and then transcribed by me. The majority of interviews were face to face, though some interviews with advisory committee members were conducted over the telephone due to difficulties in scheduling meeting times. Interviews were semi-structured and questions were constantly revised as data was analyzed.

Focus groups allow the researcher to observe interactions between a group of individuals in response to specific questions (Janesick, 1994). This method of data collection is not meant to replace interviews, but is an opportunity to gain insights into another perspective on the research questions that might not be available through interviews (Fontana & Frey, 1994). Focus groups were conducted with program staff and managers on three occasions. They provided an opportunity to examine the emerging themes with the participants, and to observe their interactions and reactions to these themes.

3.2.5.3 Informed Consent

As previously mentioned participants were given an outline of the research and data collection methods. Verbal permission to interview staff members was

obtained from the program manager and staff. Participants were asked if they would consent to be interviewed. Interviews were then scheduled at mutually acceptable times. Prior to the interview, participants were informed that the interview would be audio taped, that their participation was completely voluntary, that they could withdraw at any time, and that information given during the interview would be confidential. Participants were asked to sign the informed consent form if they understood and gave their consent to be

interviewed.

A similar process occurred for focus groups. Participants agreed to attend the focus group and signed an informed consent form. They were made aware that focus group sessions would be audio taped, that their participation was voluntary and that they could withdraw at any time. Confidentiality cannot be assured in focus groups, but at the commencement of the focus group,

participants were asked to treat all disclosed information as confidential. It should also be noted that names of places and organizations have not been changed in this thesis, however pseudonyms have been used to protect the identity of participants.

3.2.5.4 Document Analysis

The analysis of documents is another common method of data collection that occurs within a case study approach (Stake, 1995). Documents can include everything from newspaper articles to personal journals (Merriam, 1998). For this research, documents such as reports, minutes of meetings and other official documents were analyzed regularly throughout the study. Other documents that were analyzed included the original project proposals, the evaluation tender document and an honors thesis. These documents provided information about the program from various points in time, as well as about the community in which the program was being implemented. I also kept detailed records and notes of the many telephone conversations that I had with my participants and these

documents along with copies of emails and my research journal were included as part of my data.

3.2.5.5 Validity and Credibility

Research aims to produce valid and credible findings (Merriam, 1998). Qualitative research has been compared to quantitative research and has been considered to be lacking in the area of validity (Coakes & Bishop, 2002). Regardless of the paradigm under which it is conducted, research is a human process and validity exists within the relationship between the knower and what is to be known (Reason & Rowan, 1981).

A number of different techniques are suggested to increase the likelihood that qualitative research will produce valid and credible findings. The most widely recommended technique for establishing credibility and validity in qualitative research is triangulation (Lincoln & Guba, 1985; Merriam, 1998; Stake, 2003).

Triangulation is the use of multiple sources of data, methods of data collection and investigators to confirm findings as they emerge (Merriam, 1998). It assists in the clarification of meaning by uncovering the occurrence of the phenomenon in a number of different ways, at a number of different times and a number of different settings (Stake, 2003). The design of this research aimed to utilize data collection techniques that increased the probability of producing credible findings. The use of multiple sources of data, multiple methods of data collection, and multiple data collection points enabled triangulation of data and increased the validity and credibility of the findings. In addition to this I was in the fortunate position of having one of my research supervisors as the key evaluator for the CFK program. This gave me the opportunity to discuss my findings and conclusions with someone who knew the people and the program almost as well as I did.