• No results found

Chapter 1 Introduction

3.5. Examining the ‘practice’ of e-assessment

3.5.2. Relevance to this study

As a theory of change, SPT is linked to an ideology of power, which operates through empowerment, collaboration, community of practice and collegiality (Boag, 2010). It is at this point where the ‘practice’ of e-assessment by academics

in institutions can be likened to Lave and Wenger’s (1991, 1999) communities of

practice, which many believe are very much commonplace in organisations, providing a useful vehicle to better describe the dynamics and actions of people involved, as well as capturing the tacit knowledge that they produce (de Freitas & Oliver, 2005; McDermott & Archibald, 2010; Wenger, 1998). At the heart of any CoP is the notion of ‘practice’, which Wenger claims is always social in nature:

The concept of practice connotes doing, but not just doing in and of itself. It is doing in a historical and social context that gives structure and meaning to what we do. In this sense, practice is always social practice (1998, p. 47).

Smith (2006) expands on the concept of practice, suggesting that it considers

both the ‘explicit’ – the formal procedures, documents and language - and the

‘tacit’ – the shared world view, intuitions, and underlying assumptions. But

whilst CoPs appear to place more emphasis on the negotiated nature of practice and a learning system, ‘social practice’ is more concerned with how they emerge,

42 and happen, in relation to other practices. Trowler (2014) posits that social practice theory views the social world as ‘ensembles of practices’, describing

them as “regular sets of behaviours, ways of understanding and know-how and

states of emotion that are enacted by groups configured to achieve specific

outcomes through their activities” (p. 21). In the HE domain, such ‘practice’ can

be likened to Trowler and Cooper’s (2002) concept of teaching and learning

regimes (TLR), with individuals actively involved the creation and enactment of ‘culture’, many of which are often invisible since they are often considered to be the norm.

Despite having been adopted in range of contexts, including: organisational studies (Antonacopoulou & Pesqueux, 2010; Feldman & Orlikowski, 2011; Holtz, 2014; Warde, 2005; Wilkinson & Kemmis, 2014); information literacy and science (Cox, 2012; Moring & Lloyd, 2013); professional practice (Binns, 2015; Lindberg & Rantatalo, 2014) and environmental change (Hargreaves, 2011), there has only been limited application of SPT in HE contexts (Trowler & Knight, 2002), with only a handful of examples considering the use of technology in learning and teaching (Bolldén, 2016; Brown & Duguid, 1991; Goodyear, 1995; Trowler, 2014). Given the similarities of SPT with a number of methodological approaches, including ethnomethodology, phenomenology and structural functionalism (Hopwood, 2010; Knight & Trowler, 2001), SPT provides a “more holistic and grounded perspective on behaviour change processes as they occur

in situ” (Hargreaves, 2011, p. 79), illuminating the difficulties when attempting

to challenge and change ‘practices’; an issue all too familiar in a university context (Binns, 2015; Wilkinson & Kemmis, 2014).

3.6. Summary

The issue of synonymous terminology in the education domain has long been acknowledged for many years, yet there still appears to be a range of terms in

use today to describe technology related practices. Tomas et al.’s (2015) claim

43 assessment rings true in that it has somewhat masked some of the bigger

problems involved in the design and implementation of e-assessment, which are more crucial to solve to ensure its success, rather than whether it has or has not

worked in a particular context. But whilst Gikandi et al.’s (2011) extensive

literature review has indeed served as a starting point to solving some of the

issues surrounding terminology, the exclusion of defining ‘e-assessment’, only

serves to add to the confusion regarding what it actually entails. If we are to move forward as aim for a more aspirational approaches towards enhancing assessment through technology as suggested by Timmis et al. (2016), then it is only right that we examine the terminology used by those involved in the design and implementation of e-assessment, and uncover to what extent the

synonymous use of terminology has impacted on practice.

Whitelock and Brasher’s (2006) early attempts to identify the enablers and

barriers to e-assessment was crucial in identifying the issues impacting on the widespread use of e-assessment, many of which are still evident in practice today: institutional culture; infrastructure; the attitudes and training of staff involved; and, the lack institutional policy to govern the quality, accessibility and reliability of e-assessment. My own earlier work on the challenges for

implementing continuous online assessment reported the evidence of historical practices with regards to assessment strategies (Alston, 2015), but this study was carried out at a small scale and focused on only academics in one

department. Similarly, whilst Tomas et al.’s (2015) institutional level study confirmed the existence a number of these barriers, there is no indication as to the type of institution involved given the differing affiliations of the authors, and only the views of academic staff were represented, without consideration of those in PS roles who often play an important part in the operational aspects of educational technologies. Do academics and PS align/differ in their views with regards to the barriers that impact on the successful design and implementation of e-assessment? Similarly, do they align/differ with regards to the impact of the structures and formal policies on e-assessment?

44 The gap uncovered in this chapter which this thesis aims to contribute to is that more needs to be done to examine the impact of e-assessment on culture, context, communities of practice, and the resulting change processes within HE institutions. To pursue this, social practice theory - which has only seen a limited application within HE and the use of technology in teaching and learning

(Bolldén, 2016; Brown & Duguid, 1991; Goodyear, 1995; Trowler, 2014) – is adopted as a theoretical framework to examine the situated practices of e- assessment within OldU, since they can often contribute to the creation and

enactment of ‘culture’ within institutions (Trowler & Cooper, 2002).

Chapter 4 presents the approach taken to the research study, detailing the rationale for the chosen methodology, the data collection methods, the

participants involved in the study and the data analysis framework. Finally, the quality of the research is considered, with regards to trustworthiness and limitations of the study, concluding with a discussion of the ethical

45

Chapter 4 - Research Design

This chapter describes the qualitative approach taken to this study in terms of the methodology used, the data collection methods adopted, the participants involved, and the approach to analysing the data. It also considers the

researcher's ontological and epistemological assumptions and how they related to the design of the study, whilst also highlighting the issues around insider research. Finally, the quality of the research is considered with regards to the trustworthiness and limitations of the study, concluding with a discussion of the ethical considerations.

The aim of this chapter is not to provide an exhaustive and comprehensive account of the various issues relating to the topics described. Instead, it highlights the key issues central to the approach taken in this study and the potential impact they have on subsequent conclusions.