ADAMS STATE UNIVERSITY
DEPARTMENT OF COUNSELOR EDUCATION
Counseling Program Evaluation
2012-2014
Program Evaluation
Department of Counselor Education
The information contained in this report represents an analysis of the comprehensive assessment process completed by the Department beginning in the fall of 2012 through the summer of 2014.
The plan includes a developmental assessment on each student throughout the program and is based on academic performance, professional development, and personal development. The plan also evaluates the four student competencies the department deems vital in reaching its mission.
1. Sound practical therapeutic and relational skills 2. Comprehensive theoretical knowledge base 3. Strong counselor identity
4. Personal and professional dispositions necessary to work in the counseling field.
This document provides a summary of assessment data for the two programs available to students at ASU: M.A. in Counseling with a Clinical Mental Health emphasis; and M.A. in Counseling with a School Counseling emphasis. Outcome data is provided for the following areas: (a) demographic trends; (b) end of program service and operations survey data; (c) candidacy assessment; (d) evaluation of students’ field experience; (e) student learning outcomes; (f) evidence of demonstrated knowledge in the core areas.
The report is posted on the ASU Counselor Education Department webpage and can be found here: http://www.adams.edu/gradschool/counselored/index.php
The document is updated annually to keep stakeholders of the Department informed. Criteria are determined through the analysis of intentional feedback solicited from current students, alumni, faculty, program advisory boards, various agencies, and school personnel on an annual basis. The acquired information is used to make program decisions when warranted.
Counselor Education Demographic Trends (2012-2013)
Approximately 506 students are enrolled in the Counselor Education program. Last year there were 164 graduates, broken down by specialty: 117 in Clinical Mental Health Counseling and 47 in School Counseling. Our graduates consistently achieve high pass rates on licensing exams.
The pass rate for graduates taking the NCE in 2012---13 was 96%, with 94% of school
counseling graduates passing the PLACE exam. Ninety---four percent (94%) of students graduate within the expected time period, broken down by specialty: 90% in Clinical Mental Health Counseling and 97% in School Counseling. The average job placement for students is 93%, by specialty: 90% of Clinical Mental Health Counseling graduates and 95% of School Counseling graduates responding to surveys obtained employment in the recognized occupation for which they were trained or in a related comparable recognized occupation.
164 Graduates from Summer 2012---Spring 2013 94 Percent (%) Program Completion Rate
95 Percent (%) Licensing Exam Pass Rate 93 Percent (%) Job Placement Rate
PROGRAM DEMOGRAPHICS (Student)
325 The number of applications for the Master’s level CACREP accredited programs from June1, 2012 to May 31, 2013.
15 Masters Students with Disabilities (3 MALE; 12 FEMALE) 8 MALE: African America/Black
23 FEMALE: African American/Black 1 MALE: Asian American
8 FEMALE
65 MALE: Caucasian/White 274 FEMALE: Caucasian/White
8 MALE: Hispanic/Latino/Spanish American 41 FEMALE: Hispanic/Latino/Spanish American 1 MALE: Multiracial
9 FEMALE: Multiracial 4 MALE: Other/Undisclosed 19 FEMALE: Other/Undisclosed
PROGRAM DEMOGRAPHICS (Faculty)
12 The total number of full time faculty (DOES NOT include adjunct or clinical)
5 MALE: Caucasian/White 5 FEMALE: Caucasian/White
1 MALE: Hispanic/Latino/Spanish American 1 FEMALE: Hispanic/Latino/Spanish American
End of Program Services and Operations Survey Data
(Alumni/Surveys)
Adams State University
Department of Counselor Education
Employer and Alumni Survey Report
Fall 2012
In fall of 2012, the Department of Counselor Education sent emails to 150 alumni who had graduated in the previous five years. The population included graduates from the on-‐campus and online programs. The packets included an alumni survey for the graduate to complete, and a link with the employer survey for the alumnus to forward to his/her employer. Both the alumnus and the employer were given directions for returning the survey to ASU. Copies of the survey are attached to this report.
For the alumni survey, 33% returned completed surveys. The first part of the survey asks for demographic information while the second part of the survey asks for program satisfaction and preparation for the counseling field. The Department of Counselor Education received above average marks for all 16 questions. The summary information is included with this report. (see chart below)
Eleven percent of employers completed and returned the survey. Overall, employers rated the program higher than alumni, with most ratings above the satisfied mark. The summary information is included with this report. (See results below)
Both surveys allow for comments on what works, what needs improvement, and general comments. Some of the themes concerning what works were courses, knowledge and skill development, some professors, opportunities for personal growth, and convenience of program either online or at off-‐campus sites. Comments regarding what needs to be improved, generally called for more focus on school counseling, continued improvement in technology for online classes, and several reinforcing comments regarding the benefits of summer intensives.
Input related to program quality is solicited from students at the end of their program. Scores are represented by Likert scales of 1 through 5 with 1- very unsatisfied to 5- very satisfied and 3- being neutral. ( reflected below)
Alumni Survey Results 2012
Employer/Supervisor Survey Results 2012
Input related to program quality is solicited from the employer/supervisor of the former student.
Scores are represented by Likert scales of 1 through 5 with 1- very unsatisfied to 5- very satisfied and 3- being neutral. The average scores provided by employer/supervisors in each area are listed below:
• Applies academic coursework/knowledge to current position. 4.10
• Uses appropriate counseling skills. 4.40
• Realizes the important of self-exploration, self-growth, and self-care. 4.70
• Models ethical and professional behavior of the counseling profession. 4.20
• Participates and is involved in professional organizations. 3.90
• Works collaboratively with other staff. 4.50
• Keeps current in profession by attending workshops and trainings. 4.10
• Would you hire another graduate from Adams State University Counselor Ed? Yes 16 No 0
4.10
4.40
4.70
4.20
3.90
4.50
4.10
4.00
16
0
0
Candidacy Assessment
Candidacy Interview
At the end of the Pre-practicum course, all students are required to meet with a minimum of two faculty members (Candidacy Committee) to discuss the student’s progress regarding skill development, professional development, and personal development. The interview provides an opportunity for an open and frank discussion about the student’s progress in the program to date and the faculty’s effectiveness in providing a meaningful learning experience. Additionally, the interview provides an opportunity for the student to ask questions about the program and a forum for a discussion of the types of growth the student needs to make in subsequent semesters.
Following the Candidacy Interview, the Committee will decide if the student 1) is to be fully admitted as an M.A. Candidate, 2) is to be fully admitted as an M.A.
Candidate with remediation, or 3) is to have admission withdrawn. MA Candidates with remediation must satisfy these requirements in the semester following the Candidacy Interview. Decisions are based on the student’s demonstrated skill level, knowledge base, professional behavior, and appropriateness for the field, which includes emotional and psychological
maturity. Students will be notified of the decision at the Interview and will receive a follow-up letter.
Prior to admission as an M.A. Candidate, the Candidacy Interview serves as the formal retention and dismissal process unless the behaviors are of such an egregious nature as to warrant immediate dismissal. Students do have the opportunity to appeal the Committee’s decision. This information can be found in the Appeals section of the handbook.
In 2012, there were six students who self-selected to leave the program following their candidacy interview. There were 26 who were admitted with remediation.
Evaluation of Students’ Field Experience
Formal evaluation by site supervisors to assess their perceptions and evaluations of students’ performance in the areas of professional identity, professional practice, and program standards.
The culminating course for the Community Clinical Mental Health M.A. program is COUN 585. The final course for the School Counseling M.A. program is COUN 586.
This course provides students with the opportunity to practice the role of professional counselor under supervision. Students in COUN 585/586 Field Internship are evaluated by their site supervisor at mid-term and at the end of the semester. An overview of the evaluation responsibilities for site supervisors is provided through an online supervisor workshop required for all new supervisors at the beginning of the first semester they supervise internship students. At the initial supervisor workshop, new supervisors are informed of their responsibilities and detailed information concerning the assessment of students’ professional skills and behaviors are explained.
Student Learning Outcomes
CACREP standards require students who are preparing to work as clinical mental health (CMH) counselors to demonstrate the professional knowledge, skills, and practices necessary to address a wide variety of circumstances within the clinical mental health counseling context. (Table 1) reflects evidence of student learning outcomes in each domain.
Table 1 n=224
Domain Mean Score Combined Mean
Foundations
2.75 2.69
Knowledge
Skills & Practices 2.63
Counseling, Prevention, & Intervention 2.83
Knowledge 2.83 2.83
Skills & Practices
Diversity and Advocacy 2.69
Knowledge 2.88 2.79
Skills & Practices
Assessment 2.32
Knowledge 2.74 2.53
Skills & Practices
Research and Evaluation 2.75
Knowledge 2.63 2.69
Skills & Practices
Diagnosis 2.97
Knowledge 2.81 2.89
Skills & Practices
CACREP standards require students who are preparing to work as school counselors to demonstrate the professional knowledge, skills, and practices necessary to promotes academic, career, and personal/social development of all K-12 students. (Table 2) reflects evidence of student learning outcomes in each domain.
Table 2 n=120
Domain Mean Score Combined Mean
Foundations 2.94
Knowledge 2.96 2.95
Skills & Practices
Counseling, Prevention, & Intervention 2.83
Knowledge 2.84 2.83
Skills & Practices
Diversity and Advocacy 2.69
Knowledge 2.88 2.78
Skills & Practices
Assessment 2.61
Knowledge 2.53 2.57
Skills & Practices
Research and Evaluation 2.75
Knowledge 2.63 2.69
Skills & Practices
Academic Development 2.81
Knowledge 2.86 2.83
Skills & Practices
Collaboration and Consultation 2.75
Knowledge 2.58 2.66
Skills & Practices Leadership
Knowledge Skills
& Practices
2.93
2.82 2.87
Students submit specific assignments designed to address standards of each domain.
Each assignment is assessed on a 3, 2, 1 scale: 3 = Exceeds Expectations; 2 = Meets Expectations; 1 = Below Expectations; 0 = Serious Concerns. All assignments assessed with a score lower than 2 must be revised and resubmitted as a part of the individual remediation plan.
CACREP also requires programs to provide evidence that student learning has occurred in the eight common core areas. (Table 3) reflects evidence of student learning in each domain.
Table 3
Core Area n= Mean Score
Professional Orientation & Ethical Practice 298 2.73
Social & Cultural Diversity 227 2.89
Human Growth & Development 394 2.72
Career Development 291 2.81
Helping Relationships 261 2.83
Group Work 288 2.67
Assessment 189 2.61
Research & Program Evaluation 242 2.78
The information provided in this report is based on data collected by the Adams State University Department of Counselor Education. If you have questions about the program or the data presented here, please contact the Department of Counselor Education.
