Piloting the study ensured that complications and difficulties were resolved before the main study was conducted (Robson, 2002). This included the validation of the instruments and in determining their reliability. The split-half method was used in ensuring reliability. Forty students and 10 lecturers from UEW were requested to fill the questionnaires for the pilot study. This university has a Faculty of Science, a relatively large student population and also a good wireless network available on campus.
84
The pilot study ensured that the items in the questionnaires were comprehensive and that there were no ambiguities so that respondents were able to understand what they were expected to do. The pre-test study proved very useful since it helped modify and reframe the items on the questionnaires. It also helped in enhancing the quality of the questionnaire for the main study. Students and lecturers included in the pilot study were a representative of the population studied and the pre-test was administered in conditions comparable to the final study.
3.6.1 Validity of the instruments
Validity is the exactness and precision of deductions based on the findings from the research (Mugenda & Mugenda, 2003). The validation of the instruments was carried out to check correctness of the data collection instruments during the pilot study. Wiersma (1995) emphasizes that pre-testing of study instruments, before the actual study support criterion and construct validation of the tools. Criterion and construct validation was established through pre-testing the instruments used in the study. This checks the appropriateness of the data collection instruments.
Content validity was ensured by effectively indicating the interests of the study (Fraenkel & Wallen, 2002). Comments were made on the language, clarity, relevance of the items, format, structure and content of the research instruments in order to deem it acceptable. Suggestions were made on rewording questions, adding questions, and deleting some irrelevant questions.
85
Therefore, amendments were made on the format of the questionnaires and the content in general. Items that were found to be unclear were reframed. This was done in order to make sure that the items in the questionnaire would target the information required by a given objective. The instruments were also examined to ensure that the presentation, structure and form of the items within the instruments were suitable. Therefore, face validity and construct were also ensured.
The interviews were unstructured, therefore consisted of only open ended questions. The questions in the interview guide were re-worded and those with ambiguities were removed. Responses from the pilot helped identify items that were unclear. These were reframed and this also ensured construct validity of the research tools. This was to make sure the instruments addressed the concerns of the study. It was important to place focus on clarity of questions and the ability of the instruments to answer the set objectives Content validation was carried out to ascertain the comprehensiveness of the items with regard to the study variables (Creswell, 2008).
Triangulation was also used to enhance validity of the research instruments. Triangulation refers to using varied methods and processes in the collection and analysis of data to enhance credibility and rigor of research (Robson, 2003). The study used two aspects of triangulation. One aspect of triangulation was the use of more than one method of data collection which included questionnaires, interviews and documents. The other aspect of triangulation was the combination of quantitative and qualitative approaches known as methodological triangulation. This was used in order to ensure content validity
86
of the research instruments. In order to ensure validity numerous sources and modes of evidence were incorporated into the design of this study so as to acquire credible results.
3.6.2 Reliability of the instruments
Reliability reveals that when procedures of the study are repeated, the exact same results are expected (Mugenda & Mugenda, 2003). A Reliability test was carried out with the purpose of testing the consistency of the research instruments. The research instruments were improved by revising or deleting items. For the purpose of this study, reliability of the instrument was established through a pilot study carried out with students and lecturers from UEW. Reliability was established through the piloting. This involved questionnaires from 10 lecturers and 40 students.
To test the reliability of the questionnaire, Cronbach‟s alpha formula was used, which measures the internal consistency and dependability of the items (Creswell, 2008). The Cronbach alpha coefficient was valued from 0 to 1. The items from each of the questionnaires for both lecturers and students were split into two, where one side had even-numbered items and the other side had odd-numbered items. Each item was scored from 1 which means “not difficult” to 4, meaning “difficult.” The scores on the items were summed up to give the total score.
Those items that had a high coefficient (0.7 and above) were retained in the SQ, SQRMPUSL and LQ, but the items that had a low coefficient (less than 0.4) were reviewed. This coefficient ensured internal reliability. The split-half method assisted in establishing language, bias in the instrument, methods of data collection, time of collection and level of accuracy.
87
According to Frankael & Wallen (2002), the coefficient for items is high when its absolute value is greater than or equal 0.7. Therefore, a correlation coefficient of 0.7 should be considered high enough to determine the reliability of the instrument for the study. Transcripts from interviews of ICT coordinators were checked for errors to make sure there was reliability (Creswell, 2009). Maree (2007) supported that the reliability of the research findings can be improved by collecting data from diverse sources as well as through a variety of research instruments.