University of Southern Queensland
Using Second Life and Skype for Facilitating the Development
of Listening Comprehension in Second Language Learners
A dissertation submitted by
Natasha Levak, MAppling, MEd, BEd For the award of
i
Certification of Dissertation
The work submitted in this dissertation is original, except as acknowledged in the text. The material herein has not been submitted, either in whole or in part, for any other award at this or any other university except where acknowledged.
_______________________________ _______________________
Signature of Candidate Date
________________________________ ________________________
Signature of Principal Supervisor Date
________________________________ ________________________
ii
Abstract
The study investigated the effectiveness of using Skype and Second Life as part of facilitation techniques for promoting the development of listening
comprehension in learners of second languages. The languages used in the study were: English and Croatian. The 35 participants involved were studying at four universities located in Sydney and Brisbane in Australia, Split in Croatia and Mostar in Bosnia and Herzegovina. The effectiveness of the facilitation techniques, as measured by a pre-test and post-test, and the participants’ perceptions of the
techniques, as discussed in the interviews, were investigated. Information relating to the affordances of each online tool was also collected during the interviews.
Quantitative results indicated that both Second Life and Skype were beneficial tools for facilitating listening comprehension. Qualitative results assisted in building a more comprehensive understanding of the use of both Second Life and Skype for developing listening comprehension. Based on the interview results, a new version of the facilitation technique was developed that utilised both Second Life and Skype and focused on the pedagogical aims of tasks driving the selection of the most appropriate online tools, as determined by the tools’ affordances, to be utilised during the tasks. The framework for the selection and use of ICTs for facilitating second language learning was developed to assist educators in planning for using a range of learning tools effectively by aligning their affordances with the learning aims. The continuum of language learning spaces was created to assist in
conceptualising the range of learning opportunities available to language learners in various environments and their benefits. Further investigation to identify the
strategies language learners can use in virtual learning spaces is suggested.
iii
Acknowledgements
I would like to thank my Principal Supervisor Associate Professor Jeong-Bae Son who was a positive source of wisdom along my journey. His commitment and pursuit of excellence in all that he does is evident in his work as a supervisor. I especially enjoyed the gift he has of being able to answer a question with a question that would somehow lead me on the correct path. I would also like to thank my Associate Supervisor Professor Peter Albion for his comments and suggestions during the writing process.
Thank you to Luka Budak from the Croatian Studies Centre at Macquarie University,
7DQLD%ODåHYLü and Josipa Korljan from the University of Split, Vanessa Clark from the University of Queensland, and $QÿelND5DJXå from the University of Mostar: each of them a passionate educator who gave freely of their time and expertise to make this study a worthwhile process for all involved. A special thanks to the Croatian Consul General Mirjana Piskuliü for her expertise and consultation in relation to the Croatian language and 0DULD0LOLüwho assisted as a second rater.
1
Table of Contents
Certification of Dissertation ... i
Abstract ... ii
Acknowledgements ... iii
Table of Contents ... 1
List of Figures ... 5
List of Tables... 6
Chapter 1. Introduction ... 8
1.1 Background to the Research ... 9
1.2 Context of the study ... 10
1.3 Research aims and questions ... 12
1.4 Terms and definitions ... 14
1.5 Structure of the dissertation ... 16
Chapter 2. Literature Review ... 19
2.1 Introduction ... 19
2.2 Language Development ... 20
2.2.1 Theories of Language Development ... 20
2.2.1.1 Schema and script theory ... 20
2.2.1.2 Anderson’s three phase model of comprehension ... 23
2.2.1.3 Alderson’s linguistic threshold hypothesis ... 24
2.2.1.4 Cognitive load theory ... 25
2.2.1.5 Language learning spaces ... 25
2.2.2 Motivation and Authentic Texts ... 27
2.2.3 Learning Problems ... 28
2.3 Listening Comprehension ... 29
2.3.1 Definition of Listening Comprehension ... 29
2.3.2 Strategy Use ... 29
2.3.3 Task-based Learning ... 33
2.3.4 Facilitating Listening Comprehension in the Zone of Proximal Development ... 35
2.3.5 Planning for Tasks Using Development Standards ... 36
2.3.6 Testing for Listening Comprehension ... 38
2.3.6.1 Testing purposes ... 38
2.3.6.2 Assessment and the zone of proximal development ... 38
2.3.6.3 Listening test development and validation ... 41
2.4 Computer-mediated Communication ... 44
2.4.1 Importance of Researching the Use of CMC for Language Learning... 44
2.4.2 Methodological Considerations ... 45
2.4.3 Facilitating the Development of Foreign Language Learning and CMC ... 48
2.4.3.1 Roles of the computer in the language classroom ... 48
2.4.3.2 CMC, motivation and authentic texts ... 49
2.4.3.3 CMC and strategy use ... 51
2
Development ... 61
2.4.6 Utilising Second Life for Cross National Collaborative Learning and Listening Development ... 64
2.4.7 Facilitating Listening Comprehension Development using CMC ... 71
2.4.8 Barriers to Incorporating ICTs into Language Learning and Teaching Practices ... 73
2.5 Summary ... 74
Chapter 3. Methodology... 76
3.1 Subjects ... 76
3.2 Research Approach ... 81
3.3 Research Design ... 83
3.4 Facilitation Techniques ... 87
3.4.1 Development and Structure of Facilitation Techniques ... 87
3.4.2 Overview of the Second Life Facilitation Technique ... 94
3.4.3 Overview of the Skype Facilitation Technique ... 100
3.4.4 Content Modifications to Facilitation Techniques ... 104
3.5 Ethical Considerations ... 105
3.6 Methods of Data Collection ... 107
3.6.1 Overview ... 107
3.6.2 Pre-tests and Post-tests ... 109
3.6.2.1 Justification of the use of the pre-tests and post-tests ... 109
3.6.2.2 Utilising the Common European Framework of Reference for Languages: Learning, Teaching, Assessment (CEFR) ... 111
3.6.2.3. Operational model of listening comprehension competence ... 112
3.6.2.4 Validity, reliability and feasibility ... 112
3.6.2.6 Piloting the tests ... 122
3.6.2.7 Marking processes ... 123
3.6.2.8 Administration of the Tests ... 124
3.6.2.9 Training staff to administer the tests ... 125
3.6.2.10 Ethical considerations ... 125
3.6.3 Email Reflections ... 126
3.6.3.1 Justification for the use of email reflections ... 126
3.6.3.2 Email reflections from the participants ... 126
3.6.3.3 Email reflections from the facilitators... 126
3.6.3.4 Researcher observation notes ... 127
3.6.3.5 Ethical considerations ... 127
3.6.4 In-depth Interview ... 128
3.6.4.1 Justification of the interview ... 128
3.6.4.2 Validity and reliability ... 129
3.6.4.3 Interview development and structure ... 130
3.6.4.4 Ethical considerations ... 133
3.6.4.5 Administration of the interview ... 134
3.7 Methods of Data Analysis... 136
3.7.1 Overview of Data Analysis and Triangulation of Results ... 136
3.7.2 Analysis of the pre-test to inform teaching ... 137
3.7.3 Analysis of the Pre-test and Post-test ... 138
3.7.4 Analysis of the Interview ... 138
3.7.5 Analysis of the Email Reflections ... 139
3.7.6 Analysis of the Researcher’s Observation Notes ... 139
3
Chapter 4. Results ... 141
4.1. Treatment Period 1: Group 1 English Second Life ... 142
4.1.1 Pre-test and Post-test Results ... 142
4.1.2 Interview Results ... 143
4.1.3 Researcher’s Observation Notes... 148
4.1.4 Triangulation of Results and Summary ... 148
4.2 Treatment Period 1: Group 2 Croatian Second Life ... 149
4.2.1 Pre-test and Post-test Results ... 149
4.2.2 Interview Results ... 150
4.2.3 Researcher’s Observation Notes... 154
4.2.4 Triangulation of Results and Summary ... 155
4.3 Treatment Period 2: English Group 3 Skype ... 156
4.3.1 Pre-test and Post-test Results ... 156
4.3.2 Email Reflections ... 156
4.3.3 Interview Results ... 157
4.3.4 Triangulation of Results and Summary ... 160
4.4 Treatment Period 2: Croatian Group 4 Skype ... 160
4.4.1 Pre-test post-test Results ... 160
4.4.2 Interview Results ... 161
4.4.3 Triangulation of Results and Summary ... 164
4.5 Treatment Period 3: English Group 5 Second Life ... 164
4.5.1 Pre-test and Post-test Results ... 164
4.5.2 Interview Results ... 165
4.5.3 Triangulation of Results and Summary ... 167
4.6 Treatment Period 3: Croatian Group 6 Second Life ... 167
4.6.1 Pre-test and Post-test Results ... 167
4.6.2 Interview Results ... 168
4.6.3 Triangulation of Results and Summary ... 170
4.7 Treatment Period 3: English Group 7 Skype ... 171
4.7.1 Pre-test and Post-test Results ... 171
4.7.2 Interview Results ... 172
4.7.3 Triangulation of Results and Summary ... 174
4.8 Treatment Period 3: Croatian Group 8 Skype ... 175
4.8.1 Pre-test and Post-test Results ... 175
4.8.2 Interview Results ... 175
4.8.3 Triangulation of Results and Summary ... 177
4.9 Stage 2 Analysis... 178
4.9.1 Overview ... 178
4.9.2 Skype Data Collated ... 178
4.9.3 Second Life Data Collated... 180
4.10 Stage 3 Analysis... 182
4.11 Summary ... 190
Chapter 5. Discussion ... 191
5.1 Effectiveness of Utilising Second Life and Skype for Listening Comprehension Development ... 192
5.1.1 Schema and Script Theory ... 192
5.1.2 Alderson’s (1994) Linguistic Threshold Hypothesis (LTH) and Effectiveness ... 194
5.1.3 Cognitive Load Theory and Effectiveness ... 196
4
5.1.5 Authentic Purpose, Resources and Audience ... 199
5.1.6 Strategy Use and Effectiveness ... 203
5.1.7 Effectiveness of the Facilitation Techniques Related to Ability Level .... 205
5.2 Affordances of Second Life and Skype ... 206
5.3 Continuum of Language Learning Spaces ... 217
5.4 Facilitating Listening Comprehension Development Using Second Life and Skype ... 224
5.5 Summary ... 229
Chapter 6. Conclusions, Implications and Recommendations ... 231
6.1 Conclusions ... 232
6.1.1 Participants' Perceptions of Effectiveness ... 232
6.1.2 Effectiveness of the Facilitation Techniques ... 233
6.1.3 Affordances of Second Life and Skype ... 234
6.1.4 Proficiency in Using Online Tools ... 235
6.1.5 Challenges Encountered Influencing Effectiveness ... 236
6.1.6 Continuum of Language Learning Spaces ... 236
6.2 Implications ... 237
6.2.1 Student Perceptions: Interaction and Task Based Learning. ... 237
6.2.2 Training for Using Online Tools ... 237
6.2.3 Strategy Training for Learning ... 238
6.2.4 Appropriate Entry Level ... 239
6.2.5 Virtual Acculturation and Cultural Learning ... 239
6.2.6 Modified Combined Facilitation Technique ... 241
6.2.7 Continuum of Language Learning Spaces ... 242
6.3 Recommendations ... 243
6.3.1 Threshold Level for Participation ... 243
6.3.2 Training for Using Online Tools ... 243
6.3.3 Learner Strategy Training ... 243
6.3.4 Virtual Acculturation and Cultural Learning ... 244
6.3.5 Combined Facilitation Technique ... 245
6.3.6 Continuum of Language Learning Spaces ... 245
6.3.8 Further Studies ... 247
References ... 249
Appendices ... 266
Appendix A: Task Design and Evaluation Grid for Intercultural Communicative Tasks in Video-Web Communication or Virtual Worlds ... 266
Appendix B: Checklist of Listening Activities and Related Content A1-B1 ... 270
Appendix C: Participant Pair Groupings ... 273
Appendix D: An Introduction to Second Life Participant’s Manual ... 274
Appendix E. Skype Participant’s Manual: Beginners Level 2 ... 282
Appendix F. Croatian Pre-test of Listening Comprehension Level 1 ... 289
Appendix G: Croatian Pre-test of Listening Comprehension Level 2 : ... 301
Appendix H: Participant’s Guidelines to Writing Email Reflections ... 314
5
List of Figures
Figure 2.1. Framework for the selection and use of ICTs for facilitating
SL learning ... 73
Figure 3.1. Example of a Second Life virtual location ... 7
Figure 3.2. Clothing store in Second Life located at SLurl ... 99
Figure 3.3. Selected section of the centre of Zagreb, Croatia ... 101
Figure 3.4. Participant’s page from the barrier game ... 102
Figure 3.5. Screen shot of Croatian listening comprehension test using Articulate ... 122
Figure 3.6. Example of marking tool in Articulate quiz maker ... 124
Figure 3.7. Research design for Stage 1 analysis using triangulation for each treatment period ... 136
Figure C.1. How to join Second Life... 275
Figure C.2. Creating your avatar ... 275
Figure C.3. Adding your details ... 276
Figure C.4. Logging on to Second Life ... 276
Figure C.5. How to move in Second Life ... 277
Figure C.6. Searching for locations ... 277
Figure C.7. Teleporting to locations ... 278
Figure C.8. Finding a friend to send a teleport request ... 278
Figure C.9. Making a teleport offer ... 278
Figure C.10. Finding a Resident to Offer Friendship ... 279
Figure C.11. Making an offer of friendship... 279
Figure C.12. Talking in Second Life ... 280
Figure C.13. Enabling voice chat ... 280
6
List of Tables
Table 2.1 Two Perspectives on the Relationship between Assessment and
Vygotsky’s Concept of the ZPD... 39
Table 2.2 Overview of Studies Using CMC for Language Learning ... 46
Table 2.3 Continuum of Language Learning Spaces ... 58
Table 3.1 ESL Learners’ Participant Group Profiles ... 78
Table 3.2 CSL Learners’ Participant Group Profiles ... 79
Table 3.3 Overview of the Participant Groups in All Treatment Periods ... 87
Table 3.4 Overview of Data Collection and Analysis Techniques Relating to the Research Questions ... 108
Table 3.5 Matching Treatment Tasks, CEFR Levels A1+/A2 and Test Items . 115 Table 3.6 Overview of Content Themes for Treatment Periods 1, 2 and 3 ... 120
Table 3.7 Marking Key Excerpt for Pen and Paper Version of the English Pre-test... 123
Table 3.8 Stage 2 Comparing Data from all Skype Results and then All Second Life Results ... 137
Table 4.1 Group 1: Participants’ Results ... 142
Table 4.2 Group 1: Group Results ... 143
Table 4.3 Group 2: Participants’ Results ... 150
Table 4.4 Group 2: Group Results ... 150
Table 4.5 Group 3: Participants’ Results ... 156
Table 4.6 Group 3: Group Results ... 156
Table 4.7 Group 4: Participants’ Results ... 161
Table 4.8 Group 4: Group Results ... 161
Table 4.9 Group 5: Participant’s Results ... 164
Table 4.10 Group 6: Participants’ Results ... 168
Table 4.11 Group 6: Group Results ... 168
Table 4.12 Group 7: Participants’ Results ... 171
Table 4.13 Group 7: Group Results ... 172
Table 4.14 Group 8: Participants’ Results ... 175
Table 4.15 Group 8: Group Results ... 175
Table 4.16 Strategy Use during the Skype Facilitation Tasks ... 179
Table 4.17 Perceived Benefits of the Skype Facilitation Technique ... 180
Table 4.18 Pitfalls of the Skype Facilitation Technique ... 180
7
Table 4.20 Perceived Benefits of the Second Life Technique ... 181
Table 4.21 Pitfalls of the Second Life Facilitation Technique ... 182
Table 4.22 Comparison of Croatian Language Learners’ Results with English Language Learners’ Results for the Skype Facilitation Technique .. 184
Table 4.23 Comparison of Croatian Language Learners’ Results with All English Language Learners’ Results for the Second Life Facilitation Technique ... 185
Table 4.24 Skype Facilitation Technique Group 3 and Group 4 Compared ... 185
Table 4.25 Skype Facilitation Technique Group 7 and Group 8 Compared ... 186
Table 4.26 Comparison between Skype and Second Life: Strategies Used ... 188
Table 4.27 Comparison between Skype and Second Life: Benefits... 189
Table 4.28 Comparison between Skype and Second Life: Pitfalls... 190
Table 5.1 Comparison of Affordances of Skype and Second Life ... 215
Table 5.2 Continuum of Language Learning Spaces ... 219
Table A.1 Task Design and Evaluation Grid for Intercultural Communicative Tasks in Video-Web Communication or Virtual Worlds ... 266
Table B.1 Checklist of Listening Activities and Related Content/Topics CEFR Levels A1+; A2; A2+; B1 ... 270
Table C.1 Participant Pair Groupings...273