Assessing Graduate Programs: Outcomes-Based Assessment. Workshop 1

Assessing Graduate Programs:

Outcomes-Based Assessment

What Is Outcomes-Based

Assessment?

The process of (1) determining the

indicators of an effective program, (2) using those indicators as criteria for assessing the program, and (3) applying the results of the assessment toward the ongoing and

Outcomes for Workshops

ƒ

workshop, you will be able to lead your graduate committee in the process of

generating objectives and outcomes for your programs.

„ Outcome for workshop 2: By the end of the

workshop, you will be able lead your graduate committee in the process of

identifying ways of assessing the program outcomes and creating an assessment plan.

Pilot Programs

„ Food Science

„ Mathematics Education

„ Mechanical and Aerospace Engineering

„ Psychology

Potential Benefits of Assessment

Planning Process

„ Gives faculty a voice in defining the

program and thus a stake in the program

„ Gives faculty an investment in assessing the

program

„ Provides faculty-approved indicators for

gauging and improving the effectiveness of the program

What Are Objectives?

Program objectives are the general goals that define what it means to be an effective

Objectives: Food Science

1. To guide the graduate education of students

preparing for professional careers

2. To prepare students to be effective researchers in

contributing to the advancement of the safety, variety, and quality of food products for the state, the nation, and the world

3. To maintain and improve the program’s

Objectives: MAE

1. To enable students to develop as successful

professionals for highly competitive positions in industry, government, and academic

departments

2. To prepare students to be effective researchers

in the fields of mechanical or aerospace engineering

3. To enhance visibility of the doctoral programs

in mechanical and aerospace engineering nationally

Objectives: Science Education

1. To prepare students to achieve their professional

goals in science education in a collaborative environment

2. To prepare students to conduct research

effectively in science education in a collaborative environment

3. To provide leadership and expertise at local,

state, national and international levels for the improvement of science education

Three Common Objectives

„ Developing students as successful

professionals in the field

„ Developing students as effective researchers

in the field

„ Maintaining or enhancing the overall

What Are Outcomes?

Program outcomes are specific results the

program seeks to achieve in order to attain the general goals defined in the objectives.

Outcomes: MAE

1. To enable students to develop as successful professionals for highly competitive positions in industry, government, and academic departments, the programs aim to provide a

variety of experiences that help students to:

a. achieve the highest level of expertise in mechanical or aerospace engineering, mastery of the knowledge in their fields and the ability to apply associated technologies to novel and emerging problems b. present research to local, regional, national, and international

audiences through publications in professional journals and conference papers given in a range of venues, from graduate seminars to professional meetings

c. participate in professional organizations, becoming members and attending meetings

d. broaden their professional foundations through activities such as teaching, internships, fellowships, and grant applications

Outcomes: Science Education

2. To prepare students to conduct research effectively in science education in a collaborative environment, the program aims to offer a variety of educational experiences that are designed to develop in students the ability to:

a. read and review the literature in an area of study in such a way that reveals a comprehensive understanding of the literature

b. identify research questions/problems that are pertinent to a field of study and provide a focus for making a significant contribution to the field

c. gather, organize, analyze, and report data using a conceptual

framework appropriate to the research question and the field of study d. interpret research results in a way that adds to the understanding of

the field of study and relates the findings to teaching and learning in science

Outcomes: Food Science

3. To maintain and improve the program’s leadership position nationally and internationally, the program aims to:

a. continue to be nationally competitive by attracting high-quality students

b. provide effective mentoring that encourages students to graduate in a timely manner

c. place graduates in positions in industry and academics

d. maintain a nationally recognized faculty that is large enough and appropriately distributed across food science disciplines to offer students a wide range of fields of expertise

Objectives and Outcomes

„ Objectives: general, indefinite, not intended

to be measured; they set the overall agenda for the program

„ Outcomes: specific, definite, intended to be

measured; they establish the particular means by which the agenda is achieved

Program Outcomes:

Similarities and Differences

DGPs at each table work as a group to study the same kind of objective from two different programs and identify similarities and

differences between the sets of outcomes. Designate one person to take notes on the discussion. What do the similarities and

Procedure for Generating

Programs Outcomes

„ Lead collective brainstorming of committee

members; take notes

„ Draft the notes in the form of objectives and

outcomes

„ Direct collective revision of drafts

„ Gain approval of committee/graduate

Generating Program Outcomes

DGPs at each table work as a group: • Designate a group leader

• Choose one of the standard objectives

• Using one or two of the Questions to Guide Brainstorming, the group leader will guide brainstorming related to chosen objective • Group leader will take notes

• Together the group members will compose two or three outcomes based on the notes

• Write outcomes on the large tablet and post on a wall

Questions and Concerns

What questions or concerns do you have about working with your graduate

committee in creating program objectives and outcomes?

Consultant

Mike Carter 515-4120