Graduate Assessment Plan (Doctoral program)
Environmental Sciences Graduate Program (ESGP) Graduate School
1.
Program Information:
Program Environmental Sciences Graduate Program (ESGP)
Department ESGP
College Graduate School
Report Submitted by Andrew R. Blaustein
2.
Program Outcomes
Provide the Graduate Learning Objectives/Outcomes for your PhD program.
Attachment 1 (“Graduate Learning Objectives/Outcomes…”), below, includes a broad
statement of universal graduate learning objectives and outcomes for programs in the sciences.
Objectives and outcomes specific to Environmental Sciences Graduate Program include:
The purpose of the ES Graduate Program is to develop scientists who will be able to
analyze and understand environmental systems, predict environmental change, and
participate in the management of the environment. Upon completing their ES graduate
degrees, students will be prepared to conduct research in national research laboratories,
field stations, universities, as well as institutes and corporations in the private sector.
Graduates may find careers in federal, state, and local government agencies that are
charged with managing natural resources. Students completing the ES Graduate Program
will also find employment in the private sector with productive careers in industry and
consulting firms.
3. Measurement – Provide a detailed narrative or schematic to articulate how all the outcomes will
be measured.
a) Describe the methods you will use to assess each outcome.
Paragraph 2 in Attachment 1 lists the means of assessment employed in measuring outcomes:
•
minimum admission standards, assessment of application materials, admissions process
interviews;
•
meeting a predetermined standard in graduate level coursework (content/subject matter and
GPA);
•
graded cumulative exams;
•
a pass/fail oral preliminary exam;
•
written thesis or research paper;
•
oral defense.
Measurement methods specific to ESGP include:
See attachments and details outlined in the ESGP Handbook available online:
b) Describe and attach any measurement tools to be used (exam results, performance criteria,
evaluation/performance rubrics, etc.,)
Attachment 2 is a “Scoring Guide (Rubric)” for the Ph.D. Preliminary Exam; attachment 3 is a
“Scoring Guide” for the Ph.D. Thesis Defense. These tools will be used in conjunction with
existing metrics as listed above and in Attachment 1.
4. Please provide a skeletal assessment plan (Mapping Guide) for your program:
Provide a skeleton plan describing the specific activities and assessment method for each
outcome. Map all required courses (with their learning outcomes) and assessments to the
program outcomes.
The mapping guide is included as Attachment 4, “Mapping Guide for the Ph.D. Degree”.
ESGP
5. Other activities that have informed decision making:
Please report on any other activities that you feel fall under assessment that were not captured
above. This may include general satisfaction surveys, employer input, or other initiatives that
contribute to student learning or program improvement.
Participation in the joint Inter-campus conference is required. This is an annual meeting of
Environmental Science/Studies students from Oregon State University, University of Oregon and
Portland State University. OSU students are required to attend and present either a poster or oral
talk once during their career. Students are encouraged to attend each year.
Graduate Learning Objectives/Outcomes for Ph.D. & MS Programs
ESGP, Graduate School
The following table indicates what we have identified as “universal” graduate learning objectives, by which we assess
graduate learning outcomes; also for each we include the broadly used means of assessment. Individual programs and Departments may have additional graduate learning objectives; most often these are explicitly stated in a
Departmental Graduate Handbook, in documentation provided by a professional organization or society, or included as degree requirements. The overarching objectives in the table address what are considered to be critical areas of competency (a comprehensive appreciation of the field of study, an understanding of current issues of importance in the field, a grounding in ethics, and a demonstration of creativity) at various points on the path through graduate studies (admissions, matriculation to candidacy, graduation). Some of the objectives apply to any degree program, and some are specific to the non-thesis (coursework) MS, the non-thesis (project) MS, the thesis MS, or the PhD, as indicated. Likewise there is some variation amongst the degree programs as regards means of assessment.
Means of assessment referenced in the table below include:
(1) minimum admission standards, assessment of application materials, admissions process interviews; (2) meeting a predetermined standard in graduate level coursework (content/subject matter and GPA); (3) graded cumulative exams;
(4) a pass/fail oral preliminary exam; (5) written thesis or research paper; (6) oral defense;
(7) participation in the inter-campus conference.
Ph.D. Objective MS Objective
Students will havemet the objectives for learning outcomes in an undergraduate discipline relevant to their graduate field of study.
Scoring methods: 1
Students will havemet the objectives for learning outcomes in an undergraduate discipline relevant to their graduate field of study.
Scoring methods: 1 Graduates will be able to summarize major central
issues and current research problems in their field.
Scoring methods: 2,3,4,5,6
Graduates will be able to summarize major central issues and current research problems in their field.
Scoring methods: 2,5,6 Graduates will be able to communicate the major
tenets of their field and their work orally and in writing
for students, peers and the lay public.
Scoring methods: 2
Graduates will be able to communicate the major tenets of their field and their work orally and in writing
for students, peers and the lay public.
Scoring methods: 2 Graduates will be able to explain and identify areas of
uncertainty in their fields.
Scoring methods: 2,3,4
Graduates will be able to identify areas where ethical issues may arise in their work or discipline.
Scoring methods: 2,5,6
Graduates will be able to identify areas where ethical issues may arise in their work or discipline.
Scoring methods: 2,5,6 Graduates will be able to articulate strategies for
dealing with ethical issues in their field.
Scoring methods: 2,4,5,6
Graduates will have designed, carried out and presented an original work of research at the leading edge of their discipline.
Scoring methods: 2,5,6
Graduates will have completed and defended:
(1) an original manuscript based on either a review and synthesis of the primary literature [non-thesis (project) MS] or original research [[non-thesis MS]; or
(2) mastery of appropriate advanced coursework in the field. [non-thesis (coursework) MS]
Scoring methods: 2,5,6
Scoring Guide (Rubric) for Graduate Learning Outcome Assessment
Ph.D. PRELIMINARY EXAM in ESGP
Candidate Name: ___________________________________________________________ Date: __________________ Title of Thesis: _____________________________________________________________________________________
Evaluation/Guidance Does not meet
Expectations
Meets Expectations
1. Problem Definition: States the research problem clearly, providing motivation for undertaking the research
2. Literature and Previous Work: Demonstrates sound knowledge of literature in the area, and of prior work on the specific research problem
3. Impact of Proposed Research: Demonstrates the potential value of the proposed solution to the research problem in advancing knowledge within the area of study
4. Solution Plan: Provides a sound plan for applying state of- the-art research methods/tools to solving the defined problem and shows a good understanding of how to use methods/tools effectively
5. Expected Results: Provides a sound plan for analyzing and interpreting research results/data
6. Quality of Written Communication: Communicates research proposal clearly andprofessionally in written form
7. Quality of Oral Communication: Communicates research proposal clearly andprofessionally in oral form
8. Critical Thinking: Demonstrates capability for independent research in the area of study, preparedness in core disciplines relevant to research, and ability to complete the proposed research
9. Broader Impact: Demonstrates awareness of broader
implications of the proposed research. Broader implications may include social, economic, technical, ethical, business, etc. aspects.
Overall Assessment: The assessment of the overall performance of the candidate based on the evidence provided in items 1 – 9 above.
CRITERIA PERFORMANCE RATINGS for PRELIMINARY EXAM
Does NOT PASS Exam PASSES Exam
OVERALL, My rating of this preliminary exam indicates that it:
Does not meet expectations
Meets expectations
Name of the Examining Committee Member: ___________________________________ Signature of the Examining Committee Member: ________________________________
Examiner: Please use the reverse side of this form for written commentary as needed.
Scoring Guide (Rubric) for Graduate Learning Outcome Assessment
Ph.D. THESIS DEFENSE EXAM in ESGP
Candidate Name: _________________________ Date: __________________ Title of Thesis: ______________________________________________________
Evaluation/Guidance Does not meet
Expectations
Meets Expectations
1. Problem Definition: Has stated the research problem clearly, providing motivation for undertaking the research
2. Literature and Previous Work: Demonstrated sound knowledge of literature in the area, and of prior work on the specific research problem
3. Impact of Proposed Research: Demonstrated the potential value of solution to the research problem in advancing knowledge within the area of study
4. Solution Approach: Has applied sound state-of-the field research methods/tools to solve the defined problem and has described the methods/tools effectively
5. Results: Analyzed and interpreted research results/data effectively
6. Quality of Written Communication: Communicates research results clearly andprofessionally in written form through a thesis and or publications in peer reviewed journals
7. Quality of Oral Communication: Communicates research results clearly andprofessionally in oral form
8. Critical Thinking: Has demonstrated capability for
independent research in the area of study and expertise in the area
9. Broader Impact: Demonstrated awareness of broader implications of the concluded research. Broader implications may include social, economic, technical, ethical, business, etc. aspects.
10. Publications: Journal or conference publications have resulted (or are anticipated) from this research
11. Knowledge of Ethical Considerations in Science
Overall Assessment: The assessment of the overall performance of the candidate based on the evidence provided in items 1 – 10 above.
CRITERIA PERFORMANCE RATINGS for THESIS EXAM
Does NOT PASS Exam PASSES Exam
OVERALL, My rating of the Thesis indicates that it:
Does not meet expectations
Meets expectations
Name of the Examining Committee Member: ___________________________________ Signature of the Examining Committee Member: ________________________________
Examiner: Please use the reverse side of this form for written commentary as needed.
Mapping Guide for the Ph.D. Degree - ESGP
Only the top 5 activities are listed for each outcome. Other activities may also support the outcomes, however data will be collected for those listed in each column
Learning Outcomes: Graduate students in the PhD program will demonstrate
Outcome 1: Knowledge and Scholarship
Outcome 2: Communication
Outcome 3: Critical Thinking and Problem Solving
Outcome 4: Ethical Conduct
Outcome 5: Professional Development
Activities and Evidence: Identify and conduct original research, scholarship or creative endeavors
Effectively communicate their field of study
Think critically, creatively and solve problems in their field of study
Conduct research in an ethical and responsible manner
Demonstrate attributes of professional
development consistent with expectations within their field of study 1. Teaching Seminar
(one time for all incoming graduate students)
Attend workshops or take online training on effective service as a TA and responsible conduct of research
Gain appreciation for membership in professional societies; Attend scientific seminars across campus 2. Research Seminar (for
advanced 2nd or 3rd year PhD students)
Critically analyze ideas and data presented and discussed by others and participate in the peer review process
Participate in discussions on responsible conduct of research
Understand the importance of membership in professional societies; Organize a departmental seminar with an invited speaker; Participate in a graduate research competition; Attend at least one professional development workshop 3. Plan of Study
Coursework
Gain knowledge needed for conducting original research
4. Research credits Earn a Satisfactory in all credits of ENSC 601 5. Core Courses Earn a Satisfactory in
Core Courses ENSC 515, 520, 508 (Inter-campus
6. PhD Research Proposal
Define and justify a set of original research objectives in a formal research proposal
Write and defend an original proposal
Define and defend a set of research methods and analyses that will achieve the research objectives
Define methods to achieve the research objectives in an ethical and responsible manner
7. Oral Preliminary Exam
Demonstrate sufficient knowledge of subject matter to become a PhD Candidate
Demonstrate ability to communicate
knowledge and research through an oral
preliminary exam
Demonstrate the ability to think clearly and solve problems through an oral preliminary exam
8. Publish Research in Appropriate Outlets
Submit manuscripts for publication in the peer-reviewed literature
Publish research, extension, or teaching results in peer-reviewed and/or other outlets 9. Presentation of
Research at Appropriate Venues
Present an oral presentation or poster to a professional audience
Present an oral presentation or poster to a professional audience and at least one presentation in the Inter-Campus
Conference with the University of Oregon, OSU and Portland State University
10. Ph.D. Dissertation Prepare a dissertation that meets expectations for original, independent research
Prepare a dissertation that demonstrates critical thinking and creativity
Prepare a dissertation based on ethical and responsible research.
11. Dissertation Defense Present the research in a public seminar and defend the dissertation
Defend the dissertation research before the student’s Advisory Committee
Present the dissertation research in a public seminar and defend the dissertation research before the student’s Advisory Committee