Data collection methods are an integral part of research design. There are several data collection methods, each with its advantages and disadvantages. The selection of the appropriate method greatly enhances the value of the research (Sekaran, 2003, p. 223). The selection of the research method and data collection approach depends not only on the objective of the study but also on the constraints of the study (Sekaran, 2003; Punch, 1998). Taking into consideration the objective of the study and the constraints/potential constraints within the research context, the data collection method employed in this research is survey-based research supported by secondary sources of information.
5.2.1 Survey-based research – self-administered questionnaires
As the intention of this study is to investigate the strategic planning formation process within Dubai public sector organisations, a self-administered survey methodology was found to be the most appropriate tool to collect the data for the following reasons: first, it is an effective tool, especially when the investigator does not require, or has little control over occurring events (Yin, 1994). Second, it provides an accurate means of assessing sample information and enables the researcher to draw conclusions about generalising the findings from a sample of responses to the whole population (Chisnall, 1992; Creswell, 1994). Third, it is an appropriate data collection method
143
when relationships between variables such as correlations need to be established to answer the research questions (Sekaran, 2003, p. 126; Hair, Bush and Ortinau (2003). Fourth, it is considered useful because it is quick, inexpensive, efficient, and can be administered to a large sample (Churchill, 1995; Sekaran, 2000). Fifth, this method has been widely used and accepted in management literature (Amaratunga et al., 2002). Sixth, a number of constraints are found within the research context that prevents the researcher from selecting additional data collection methods, such as interviews (Sekaran, 2003). This will be described in the following section.
However, a number of problems are associated with this data collection method. These can be summarised as follows: first ambiguity of questionnaires, this was overcome by testing the questionnaires used in this study to ensure the suitability of the questions and to eliminate ambiguities as recommended by Sekaran (2000); details of the procedure used is listed in sections (5.4 and 5.5). Another potential problem is the low response rate: Sekaran (2000) suggests that sending follow-up letters, providing the respondent with self-addressed, stamped return envelopes and keeping the questionnaire brief are useful ways to improve the response rate to mail questionnaires. Also, the use of an online survey was suggested to overcome this problem as suggested while pre-testing the research instrument (section 5.4). Further, lack of control over timeliness, the difficulty in determining whether the selected respondents are being truthful, and the lack of detail and depth of information are seen as other problems associated with survey methods (Hair et al., 2003). For these reasons, the guidelines recommended by Hair et al. (2003) were taken into account. First, the reliability and the validity of the scales should be tested. Second, the questionnaire should be designed in a way that is easy for the respondents to understand and free of response bias. Third, a follow-up procedure should be made to increase the response rate. Details on how each of these potential problems were addressed is covered comprehensively in pre-testing the research instrument section (5.4) and final survey procedure section (5.5).
5.2.2 Constraints to alternative methods
The use of a quantitative/qualitative approach with multi data collection methods such as questionnaires and interviews would be most suitable for the research in hand. However, as stated earlier, the choice of research method and data collection approach is dependent not only on research objectives but also on constraints/possible constraints that may arise along the way (Sekaran, 2003). This is particularly true for this study. A number of constraints within the research context guide to some extent the choice of selecting the research method and data collection
144
method. The constraints can be categorised in two main points: First, the ability to conduct the research interview. Second, the reliability of research interview data. In relation to the first point, the researcher, before deciding on the most appropriate data collection method, contacted eight strategic planning managers working in government departments in Dubai to arrange interviews in an attempt to assess the suitability of conducting research interviews. A number of difficulties were experienced while doing so. First, it was difficult to contact interviewees (managers) to arrange meetings: the researcher had to call five times in some cases to be able to speak to managers. Second, all managers except one refused to conduct an interview and informed the researcher that this is mainly due to confidentiality of information and their busy schedules. However, three out of seven managers stated that they might consider participating in a survey questionnaire. Third, the manager that agreed to participate informed the researcher that the questions asked should not be specific but rather general and the interview should not be recorded. The previous difficulties can be greatly due to cultural and institutional factors. For example, all public sector organisations in Dubai compete for an excellence award as required by the Dubai government. This, to a large extent, prevents knowledge sharing and transparency between public organisations and with external parties. One of the managers that refused to conduct the interview stated over the phone that ‘I cannot share strategic planning information with external entities or individuals since this may reveal information that could affect our chances to win the Dubai Government Excellence Award’.
The second major constraint (reliability of research interview data) is mainly related to the knowledge and experience of the interviewee. As stated by Mukherjee (1995), experience is one of the main constraints of conducting research interviews. The Dubai government issued a government initiative to increase Emiratisation ‘nationalisation’ (increase the employment of local citizens), particularly at the managerial level within government departments. This has been adopted by all government departments. In fact, the nationalisation objective has been included in many strategic plans of government departments in Dubai. Due to ‘nationalisation’, critical managerial positions (such as strategic planning managers, department managers, VPs and EVPs) are filled with local nationals without some of them necessarily having the adequate knowledge and skills required to accommodate various managerial obligations. The employed local nationals depend heavily on experts/specialists or external consultants to perform their managerial functions. Research interviews with individuals lacking the necessary knowledge and experience will not necessarily lead to quality information since the interviewee might not be able to provide adequate
145
explanations. For the above reasons the adoption of qualitative research and research interviews as a data collection method is not only inapplicable within the research context, but also not reliable. Therefore, survey questionnaires as well as secondary sources of information were used as an additional source of information, as will be described next.
Before moving to the next section it is important to note that the participation of some respondents lacking the necessary expertise for a research interview, but able to answer a survey questionnaire is acceptable, since filling a research survey with multiple choice answers is much easier than conducting a research interview which may require in depth explanations. In addition the size of the sample of such respondents will not alter the overall statistical results of research survey in case their inputs were not entirely correct. However, that might not be the case for interviews, since the findings might be affected greatly if the interviewees lack necessary knowledge and expertise because there is usually limited number of participants in a research interview. Added to this, the respondents’ willingness to participate in a survey questionnaire instead of research interview is greatly influenced by cultural and institutional reasons.
5.2.3 Secondary sources of data
In addition to the primary data collection method ‘survey questionnaires’, a secondary method ‘secondary data’ was used to further validate the results gained by the primary method. Sekaran (2000) states that since almost all data collection methods have some biases, collecting data through multi-methods and from multiple sources lends rigour to the research and allows for cross checks.
The secondary data were collected throughout the various phases of the research study and included a variety of information from various sources. The secondary data were classified into two main groups: sector-related data and organisation-related data. The types of data gathered under each group are:
Sector-related information:
-
Dubai Government Strategic Plan 2010–2021-
Statistical Yearbook – Dubai 2008-
Dubai Government Excellence Program (DGEP) criteria146
Organisation-related information:
-
Strategic plans for public sector organisations in Dubai-
Organisations’ structure for public sector organisations in Dubai-
Annual reports, mandates, and publications for some public sector organisations.The collected secondary data were analysed using content analysis and data were recorded in an evaluation format. 19 strategic plans were collected; each collected strategic plan was evaluated as per the following quality criteria: formality, clarity, measurability, objectivity, coverage, and openness. The evaluation of each quality criteria was conducted through assigning scoring system for each element under each criterion. Then total scores were added to get the sum for quality criteria and the sum for the overall strategic plan quality. The evaluation format and the results of the evaluation for each strategic plan are presented in Appendix (B.1) Data collected from secondary sources were triangulated with primary data to validate and support results of the primary data collection method as described in section (6.5.3).
To summarise, because the objective of this thesis is to evaluate the effectiveness of SPFP in terms of measuring the degree to which the steps of the process are conducted, and to investigate the relationships between various research variables through testable propositions, quantitative research (survey) supported by secondary data will create the necessary fit between the research problem / context and research method for the following reasons:
-
Applying quantitative research helps the researcher to establish statistical evidence on the strength and direction of relationships between variables (Amaratunga et al., 2002).-
Quantitative research is used when the intention of the study is to describe through empirical statements what the case is in the real world rather than what ought to be the case Cohen (1980).-
Quantitative research is useful for segmentation (Kumar, 1996).-
When the information sought is reasonably specific and familiar to the respondents then quantitative research is suitable (Bryman, 1984).-
Quantitative research is useful when a quantitative answer is required (Bryman, 1984).-
Quantitative research is suitable to generalise the findings (Chisnall, 1992; Creswell, 1994).147
All of the reasons stated above are necessary to satisfy research questions and fulfill research aims. Added to this, this methodology has been successfully used in similar studies in the strategic management literature O’Regan and Ghobadian (2002); Hass, Burnaby, and Bierstaker (2005); Elbanna (2008 and 2010); Dyson and Meadows (2005); Luna, Ayerbe, and Torres (2008); Floyd and Wooldridge (1992). Moreover, a number of constraints found within the research context prevent the researcher from selecting additional data collection methods, such as interviews. This is particularly related to the culture and individual perceptions about participating in an interview. Last, quantitative approach with survey questionnaires is considered useful because it is quick, inexpensive, efficient, and can be administered to a large sample (Churchill, 1995; Sekaran, 2000).