3.3 RESEARCH DESIGN
3.4.5 Validity and Reliability
The principle of validity and reliability or trustworthiness is the cornerstone of any research. By following basic principles, this study will stand up to rigorous questioning and skepticism. Reliability (consistency) and validity (accuracy) are the key aspects in defining and measuring bias and distortion, and determine the trustworthiness of the research (Ali & Yusof, 2011: 30). The researcher should be attuned to the multiple factors that may pose risks to the trustworthiness of the findings (Carmines & Zeller, 1991: 13). To avoid these threatening
factors, the research was assessed, in order to ensure that it is free of bias and distortion. The reliability and validity of the research instrument will be discussed below.
Reliability of the research instrument: According to Phelan and Wren (2005: 6), reliability refers to the degree to which an assessment tool produces stable and consistent results. Shuttleworth (2008: 8) concurs that the idea behind reliability is that any significant result must be more than a once-off finding, and should be inherently repeatable. Other researchers must be able to conduct research under the same conditions and generate the same quality of results. Winter (2000: 7) defines reliability as the extent to which results are consistent over time and an accurate representation of the total population under study. The definition implies that if the same tool is used under different circumstances, or administered to different participants from the same group, the results should be the same. If such instrument yields the same score when used at any given time, it becomes reliable.
In order for this study to fulfill the prerequisite of testability, observation and interviews were conducted within the real-life environment with the affected participants. Six participants were required to answer the same questions in two categories. The observation and interviews were administered on different days. This was done to capture attitudes and moods of participants on different days. In order to increase the reliability of responses in such an environment, the researcher will ensure that participants are aware of the nature of the research and what it entails.
Validity of the research instrument: Validity in research is concerned with the accuracy and truthfulness of the investigation. A valid instrument must actually measure what it is supposed to measure. Joppe (2000: 221) indicates that validity determines whether the research truly measures what it was intended to measure, or how truthful the research results are. Phelan and Wren (2005: 7) further refer to validity as how well a test measures what it is supposed to measure. They both agree that while reliability is necessary, it is insufficient on its own, because for a study or test to be reliable, it also needs to be valid. McMillan and Schumacher (2010: 104) define validity as “the degree to which scientific explanation of the phenomenon matches reality”. According to them, it refers to the truthfulness of the findings and conclusions. Researchers construct their explanation based on the observed phenomenon and the ability to
approximate the observation with reality. The degree to which the explanations are accurate or match reality comprises the validity instrument.
In this study, the following strategies for ensuring trustworthiness were considered:
Credibility: McMillan and Schumacher (2010: 03) define credibility as the extent to which the results approximate reality and are judged to be accurate, trustworthy and reasonable. It is a criterion for evaluating the truthfulness of results. The researcher used this technique in the interviews, which were supplemented by observation. Dependability: Polit and Hungler (1997: 306) define dependability as the consistency
of the inquiry processes used over time. The more consistent the researcher has been, the more dependable the results will be. The researcher maintains stability in the logic used to select participants and settings for interviews and observation. The researcher ensures that the collected data are kept in the form of audited files for a maximum of five years.
Confirmability: Trochim (2006: 32) describes confirmability as the degree to which the results can be corroborated by others. The researcher ensures that the method used to collect and analyse data is objective and neutral. Critical to this process is the audit trail, which allows any observer to trace the course of the research, step-by-step, via the procedure described. The researcher has to bear in mind that any interested person can access the information upon request.
Transferability: Shenton (2004: 7) indicates that transferability is a technique which demonstrates that findings in a qualitative project can be applicable to other situations and populations. In the context of this study, data collection involved a small group of participants. Therefore, the researcher has to understand that findings can not necessarily be applied to a wider population. In this regard, this study applies to similar contexts in South Africa.
This study is able to contextualise collected data and findings within the body of existing knowledge on the topic, and to show how it corroborates what is known, as well as how emerging themes can enhance the neutrality and understanding of the phenomenon. To achieve this, data were read and re-read, in order to enhance the understanding and interpretation o f this data.