National Peer Review Network Peer Review of Assessment

Peer Review of

Assessment

Dr Sara Booth

01

National Peer Review

Network

SESSION AIMS

1. To provide an overview of Higher Education Standards (HESF)

2. To provide an overview of institutional and national momentum in

peer review of assessment and standards

3. To provide an overview of models of peer review

4. To provide an overview of the national Peer Review Network

5. To get feedback on setting up and sustaining peer review networks

6. To get feedback on what are the key challenges in peer review and

what support can you provide in driving this national initiative

Peer review is the

responsibility of the provider not the

regulator.

We can’t meet standards without peer review

. It is a

very important part of the standards… We have to consider the

importance of peer review [ like the work of Kerri-Lee Krause

and Mark Freeman]…

If I go to the criteria on

Learning Outcomes 1.5.1

: The

expected learning outcomes are specified...

by informed by

national and/or international comparators.

I would be

expecting there would be periodic review by external people

that there is a standard. There are

three projects in this area

(UK and Denmark have the external examiners system).

Emeritus Prof Alan Robson, Chair, HESP

Information Session-Proposed Higher Education Standards

Framework

14

_{May, 2014}

See the proposed

Higher Education

Standards Framework

Standards 1.5.1;

5.3.2; 5.3.3; 5.3.5 and

Institutional Momentum in Peer Review

University of Tasmania

Benchmarking

•

2009-Present: 7 national and 4 international benchmarking projects including peer review

workshops ( for instance, academic transition, assessment policies & processes, higher degree

research, UES for Student Centre Directors, promotions policies & processes, health,

education in placements, professional studies and literacy numeracy standards,

internationalisation)

Peer Review of Assessment

•

2012 :

University’s participation in the Inter-institutional Review Project (Krause et al., 2013) in

Nursing, Economics and Journalism

•

2013:

Internal Teaching Development Grant to develop and trial an online Moderation Tool and

resources to support peer reviewers and reviewees and develop national network in peer

review

•

2013:

Trial of online Moderation Tool with Faculties of Education (Charles Sturt, Curtin, Griffith,

Tasmania & Western Sydney)

•

2013:

Peer review of assessment recognised in the Teaching Performance Expectations

(TPEs)

•

2014:

Identified as institutional priority for University Learning and Teaching Committee (ULTC)

•

2014:

Development of draft External Peer Review of Assessment Procedure

National Momentum in Peer Review of

Assessment and Standards

National Learning Outcomes Standards Forum

9 August, 2013

• How to make assessment moderation scalable and sustainable

• Identify how students, other faculty and external stakeholders can be involved in the assessment moderation process

• Development of a peer review network

Universities Australia Satellite Event, Comparing

Learning Outcomes Standards

28 Feb, 2014

• Peer moderation is core to standards • Need to get public confidence

• When and how are important questions of moderation • Infrastructure, resourcing and costs to the institutions • Network of peer reviewers: models to fit the Australian

context

• How can we make it work?

• The challenge of calibration and the concept of judgement (QAA/HEA research study, 2013 on examiners’ understanding of standards)

Senior Fellowship

Emeritus Professor Geoff

Scott 2014

• Assist the higher education sector to establish the policy and practice frameworks to embed

inter-institutional peer review of teaching and learning standards, and

• Identify and disseminate the most effective assessment practices identified through peer review in each professional or disciplinary area

Higher Education Standards

Panel Research Fellow

Professor Christine Ewan

consensus on higher education standards in a disaggregated learning environment

See the proposed

Higher Education Standards Framework

Standards 1.5.1; 5.3.2; 5.3.3; 5.3.5 and 5.3.6

Course

design &

approval

Selected

Units

Admission/

pathways

Course

Delivery

Assessment

Student

Grades

Assessment

Design

Learning

outcomes

Assessment as the main measure of learning outcomes

Michael Wells, TEQSA, Satellite Event: Comparing Learning

Outcomes, Universities Australia, Feb 28

₂₀₁₄

Other measures of learning outcomes

Student Progression/ Retention Data

National Peer Review

Network

Peer review is core to assuring standards.

External peer review of assessment is

gaining momentum in the Australian higher

education sector. The aims of this national

Peer Review Network (PRN) are to:

– Provide a forum for sharing and

disseminating good practice in external

peer review of assessment across

different

– Identify key academics experienced in

external peer review of assessment

– Provide professional learning opportunities

for academics and benchmarking partners

Core Peer Review Network Team

Dr Sara Booth, Project Leader, University of Tasmania

Assoc Prof Mark Freeman, The University of Sydney

Assoc Prof Heather Alexander, Griffith University

Prof Ron Oliver, Edith Cowan University

Mr Mark Thompson, Edith Cowan University

Prof Jane Fernandez, Avondale College Project Officer

• Dr Jeff Beckett, University of Tasmania

External Reference Group

Professor Richard James, Melbourne University

Professor Kerri-Lee Krause, UWS Professor Emeritus Royce Sadler, UQ Professor Chris Rust

Di Weddell, OLT

Peer Review Network

State-based Workshops

–

13

_August

_{: Melbourne University}

–

18

_September

_{: University of Western}

Sydney

–

19

_September

_{: Griffith University}

–

25

_September

_{: Edith Cowan}

University

Register your expression of interest to

attend:

Sara.Booth@utas.edu.au

Peer Review

Network

Peer Review Network

Forum

‘Assuring Grades

Across Course

Boundaries’

– 12

_{November 2014}

– Park Royal Hotel, Melbourne

Airport

Networking Dinner

Register your expression of

interest to attend:

Progress to date

Progress to date

DVC(A) Universities Australia

Meeting

Regular agenda item

RUN

Keep informed

23 Council of Deans

7 presentations (DASSH, ABDC, ACDE,

ACED, CADAD, DDoGS, CDNM)

1 submitted report for funding for professional

learning ACDICT

COPHE and ACPET

Keep informed

IRU

Keep informed and involved in testing UTAS

online moderation tool

OLT National Conference

Poster presentation

Victorian Quality Managers

Network

Peer Review Networks in

Assessment

1. What networks are currently established for the

external peer review of assessment?

2. How do you establish networks in peer review at

the national, disciplinary and interdisciplinary

levels?

3. Where do you use peer review to good effect?

4. What evidence do you have on how it works?

5. What are your cunning tips?

National Level

Models of peer review Support structures

Higher Education Standards Framework

Higher Education Standards Panel TEQSA Accreditation Bodies Quality Verification System Inter-institutional Moderation Achievement Matters

Peer Review Network Peer Review Forum

Institutional Level

Academic quality structures & processes

Models of peer review Support structures

Quality unit role in coordinating blind peer review

Secure data collection/storage of data

Internal register of units for peer review

Academic governance processes in external peer review

Accreditation Policies/procedures

Subject/unit outlines include peer review feedback

Which model/s of peer review will be

adopted?

Internal peer review networks Discipline networks

Alignment to teaching criteria/frameworks

Professional learning on peer review of assessment

National conversation on peer review of assessment

What are the key

challenges in

peer review of

assessment?

What support can

you provide for

this national

initiative to go

forward?

For more information

on the External Peer

Review Network

http://www.utas.edu.au/student-evaluation-review-and-reporting-unit/nprn