• No results found

CHAPTER THREE METHODOLOGY

3.3 Pilot Study

3.3.1 Stage One

A 13-week study was conducted at the outset of this research and it

involved thirty students who were enrolled in an academic writing course

in the third semester of their Pre-Law programme at UiTM. First, a two-

day pilot testing of the questionnaires and written protocols was carried

out for the purpose of refining these instruments.

This stage of the study revealed several weaknesses in the approach taken

for data collection and helped determine the final data collection

procedure. Firstly, several questionnaires were administered to obtain

information on the students’ background and their self-assessment of their

writing ability. One was administered at the beginning and another at end

of the 13-week period to evaluate the effectiveness of SRSD instruction. In

addition, other questionnaires such as the learning style questionnaire, the

Strategy Inventory of Language Learning (SILL) questionnaire, and the

writing self-efficacy questionnaire were administered both as pre and post

instruction protocols. The use of numerous questionnaires made the

students feel uneasy and took up time that could have been used more

effectively for strategy instruction. The use of multiple questionnaire

resulted in too many variables being investigated although the learning

style and self-assessment questionnaires were administered primarily to

raise awareness among students about their learning style as well as the

strengths and weaknesses in their language ability. Although this practice

is part of the psychological preparation that is advocated in learner training

and is intended to promote learner autonomy (Dickinson, 1992; Lum,

research subjects and this was considered in the final research design. The

number of questionnaires was thus reduced to only three compared to the

six, which were used earlier.

Stage One also revealed that the weekly two-hour sessions allocated for

SRSD instruction were insufficient and the effect of this writing strategy

instruction on the Pre-Law students was questionable as these students

were already doing two other courses in English which involved reading

and writing for academic purposes. Therefore, the results of the study,

which indicated a favourable response to strategy training, may have partly

been influenced by the instruction provided in these two courses. Also, as

there was only one group of students taking the third semester Pre-Law

programme at the time of the study, it was not possible to validate the

findings in the absence of a control group. Pre-Law students were initially

the subjects of the study as they were the only ones doing EAP course at

the time of the study and also, it was the intention of the researcher to

investigate students’ response to the SRSD instruction in academic writing

which is vital for their academic success.

Based on these insights, changes were incorporated into the design of the

present study. One major change involved the selection of subjects for the

study. The aim of the present study is to investigate how students who

have not had any prior training in EAP manage their writing tasks.

Another change was in the selection of the EAP course as the earlier

course did not offer the researcher sufficient time to effectively apply

course, namely English for Academic Purposes (BEL 311) would be a

better option as it was a six-hour a week course focusing on reading,

writing and speaking. This course would allow the researcher-cum-

instructor to utilise at least four hours a week for SRSD writing

instruction.

Besides that, the number of questionnaires administered was also reduced

to just three compared to the six distributed in Stage One of the Pilot

Study. However, this was done without compromising the intent of

providing some form of psychological preparation in learner training.

Certain elements from the learning style questionnaire (i.e. independent

learner or group learner, and preference for oral expressiveness or written

expressiveness) as well as the self-assessment questionnaire were included

in an adapted version of the ESL Student’s Background and Writing

Ability questionnaire (Appendix C).

The evaluation questionnaire for the SRSD writing course, on the other

hand, was replaced with interview sessions to elicit information on the

progress of the learner and the effectiveness of the course while also

gaining insights into the impact the SRSD model had on the learner.

Another important improvement to the research instruments was the

inclusion of the goal setting component, which is an important strategy in

self-regulation (Graham & Harris, 2003). While SRSD has been

that its inclusion is necessary to promote generalisation or transfer of

strategies (Sawyer, Graham, & Harris, 1992).

Another change resulting from observations during the pilot study

involved the written protocol. It was decided that the research subjects

would no longer be given a timed essay to complete in class (Biedenbach,

2004). Instead, they would be allowed to take home their writing

assignment and submit the completed typed assignment within a stipulated

period of time, in this case within one week’s time. This change was

necessary in view of the fact that research in EAP and process writing has

recognised that writers need time to generate ideas and think over these

ideas before composing, and then revising what they have composed

(Williams, 2005). This makes the whole exercise more authentic and the

research relevant to the process a learner actually goes through for an EAP

writing assignment.