CHAPTER 6 – Research Design and Methods of Analysis
6.3 QUESTIONNAIRE DESIGN
The questionnaire, which was individually coded for tracking, was specifically designed for this study. It uses only closed form questions with responses requested on a five-point Likert scale, by ranking or by a checklist of certain statements. The core content of the questionnaire was informed by an extensive literature review undertaken on the subject. While closed form questions can introduce a degree of bias they were considered more appropriate for the background study due to both the difficulty in interpretation and analysis of free-responses and the unknown variable of the respondents’ level of knowledge on the subject. It was felt that the questionnaire responses could be probed more effectively and in greater detail through the subsequent case study interviews. The questionnaire commenced with a definition of value engineering and was divided into 23 multi-part questions.
Pilot Study
The questionnaire was piloted with experienced construction professionals and academics to ensure all questions were clear and precise. The individuals were asked to complete the questionnaire, discuss any problems they encountered and suggest any modifications they felt would make the questionnaire more user-friendly. Their comments, focusing on the content, clarity and formatting of the questionnaire, were addressed where appropriate and the questionnaire was revised accordingly.
Amendments included the number of questions, which were reduced, as the questionnaire was considered to be too long, it was also felt appropriate to alter the order of presentation in areas to minimise the possibility of bias. As it was felt that the third and fourth levels of the original six level Likert rating scale could be construed as being similar this was changed to a five point Likert scale to give a more unambiguous result, a longer scale was considered too unwieldy and not a realistic option in this case.
In order to better focus the response it was suggested that the questionnaire be limited to the respondents experience in the Irish construction industry. It was further suggested the respondents be asked to indicate their current position, experience, and time with the firm being surveyed.
Nature of Sample, Sample Selection and Questionnaire Administration
Based on an abstract of the research submitted to them in March 2010 the Association of Researchers in Construction Management (ARCOM) considered the subject to be ‘an interesting concept of the consultant engineer engaging in value engineering as a new role [which] should provide some useful insights from industry’ and ‘an interesting area that does require further empirical research’.
The sampling frame chosen for the background study is the register of the Association of Consulting Engineers of Ireland (ACEI), which lists, as of 31st January 2010, a total of 188 member firms. The ACEI register is broken down by company name, region, activity and the number of employees. The regional offices of individual firms are registered separately.
The sample-group comprises of all the consulting civil/ structural engineering firms on the register (including the firm selected for the case study). Only the head office of each of the firms was included, and this formed the background study sample-group. Data collection for the background study sample-group was in the form of multi-part questionnaire; data collection for the case study utilised both the questionnaire and individual interviews with directors of the case study firm. The names of all firms and the directors remain confidential in the results. An examination of the register as of 31st January 2010 revels the following:
Directory of ACEI Registered Member Companies (January 2010) All employees 188 registered offices of 104 firms
(80 Civil & Structural - the sample-group) 6-20 employees 46 registered offices of 35 firms
21-50 employees 21 registered offices of 12 firms 50+ employees 83 registered offices of 22 firms 6+ employees 150 registered offices of 69 firms Table 6.3.1 developed from ACEI, 2010.
The initial sample proposed, the entire population of engineering consultants in Ireland, was considered beyond the resources available. While not encompassing all member firms the 80 firms finally selected represent the total population of civil and structural engineering consultants (head offices) on the directory of ACEI registered member companies and as such can be considered to be a highly significant and a complete population grouping.
Each firm was contacted by telephone in order to confirm their cooperation prior to sending out the questionnaires. The author explained the purpose of the study, the reason the firm had been selected. The identity of a senior director in the firm to whom the questionnaire could be addressed was obtained/confirmed.
The questionnaire was accompanied by a detailed cover letter addressed to a senior director. A stamped addressed envelope was included in all survey packs. The questionnaires were posted out in the first week of February 2010. To elicit a higher return rate all non-replying firms were contacted by telephone/e-mail at the end of March 2010 and advised that their participation would be both valued and appreciated. Of the 84 questionnaires distributed (80 postal and 4 case study), 33 valid relies were received which represents a response rate of 39.3%. All respondents had more than 5 years experience with (70%) having over 20 years
experience. More than 97% of the respondents held director positions, with 55% of the respondents being the firms Managing Director (Table 6.2.2). This indicates that the respondents were both credible and capable of answering the questions effectively (Chow and Ng, 2007). 88% of the respondents indicated a desire for a copy of the completed research, this may be indicative of an elevated engagement with the study.
Characteristics of respondents dissertation in Chapter 11, Appendix A and B.
Rationale of the Research Questionnaire
The first section of the questionnaire, questions 1-3, seek the respondent’s opinion on a range of statements. The second section, questions 4-6, seeks to capture their knowledge and experience on a range of topics. In the third section, question 7, opinion is sought, while questions 8-22 collect background information and opinion. The last section, question 23, requests respondent details.
Table 6.3.3 sets out the objective of each question/statement, the reasoning behind the chosen format, the response type sought/permitted and how the response was to be analysed.
Table 6.3.3
Table 6.3.3
Table 6.3.3
Table 6.3.3