Presented by: Kimberly Tynes, Ph.D.

(1)

(2)

CP AS SUR VI V AL BOO T CA MP

Prep Course Execution

•

CTE 2001 CPAS Prep

• This course will focus on four major areas: Reading Strategies, Understanding Key Testing Terms, Reading diagrams and an extensive review of the CPAS course blueprint.

•

Began course in Spring 2012

•

Three ways of conducting the CTE 2001 CPAS Prep Course:

• 1. In-person class utilizing ExamView LAN testing software

• 2. Online class utilizing CANVAS

• 3. In-person class utilizing CANVAS

•

CD will be provided at the end of this presentation. Contents

of the CD will be discussed and instructions are outlined

(3)

CP AS SUR VI V AL BOO T CA MP

Course SUCCESS

•

Fall 2012 Stats

• 24 out of 29 of our students successfully passed the CPAS assessment

• 8 out of 9 of our CTE programs passed CPAS

• 6 of our programs had a 100% passage rate

•

Fall 2013 Stats

• 15 out of 20 students successfully passed the CPAS assessment

• 14 out of the 15 students scored 70% or above

(4)

Course SUCCESS—Continued

•

Spring 2013 Stats

• Highest individual CPAS score on record for SMCC—98% (2012 highest score was 93%)

• 18 students scored 80% or higher (13 in 2012)

• 7 students scored 90% or higher (1 in 2012)

• 7 programs had a mean average 60% (6 programs in 2012)

• 2 programs had a 100% passage rate (1 program in 2012)

• 58% of the total students passed the CPAS in Spring 2013 with a 60% or higher (48% in 2012and only 36% in 2010)

(5)

CP AS SUR VI V AL BOO T CA MP

Course SUCCESS—Continued

• Spring 2014 Stats

• Highest individual score is a 100% (Early Childhood Education Technology student). This is the highest individual CPAS score on record for SMCC.

• 47 students (59%) of the total students passed the CPAS this Spring with a 60% or higher

• 32 students made a 70% or higher

• 10 students made an 80% or higher

• 4 students made a 90% or higher

• Early Childhood Education Technology--100% passage rate two years in a row

• Heating and Air Conditioning—Highest individual score on record: 90%

• Electrical Technology—Highest individual score on record: 90%

• 7 programs have a mean average of 60% or higher

• The mean average of all tested programs combined is a passing 61.92%

(6)

CP AS SUR VI V AL BOO T CA MP

Survey Results

•

Fall 2012 Student survey results (N=29)

• Fall 2012--94% completed surveys, N=29

• 69% agreed that the Prep Course were related to material covered in program area, 24% neutral.

• 59% agreed that the CPAS assessment was related to material covered in program area, 34% neutral.

• 62% agreed that the Prep Course made them feel more comfortable and relaxed during CPAS assessment, 24% neutral.

• 79% agreed that the Prep Course helped improve overall performance on CPAS assessment, 17% neutral.

• 97% agreed that they would recommend future students to take the CPAS Prep Course, 3% neutral.

• Comments included: “The only improvements I would like to see is

more time on practice test such as two days a week if possible. But everything else works great.” and my personal favorite “free food and drinks”

(7)

CP AS SUR VI V AL BOO T CA MP

Survey Results—Continued

•

Spring 2013—only 68% completed surveys, N=73

• 53% agreed that the Prep Course made them feel more

comfortable and relaxed during CPAS assessment, 33% neutral.

•

Comments included: “I think they should use more pictures on

the test”, “study guide information”, and my personal favorite,

“I hope me and my class done very well on it”

(8)

• Fall 2013 Student survey results (N=29)

• Fall 2013—85% completed surveys, N=22

• NEW Question—32% stated they have taken remedial course(s) and 57% agreed that the remedial course(s) helped them succeed in their program of study, 43% neutral.

• Comments included: “I think a big improvement for the cpas test will be

to get a hands on study guide so that we can actually study it off

campus. I believe that this will improve alot of test scores.”, “Print outs of the practice test so student may go home and study.”

(9)

CP AS SUR VI V AL BOO T CA MP

•

ONLINE course started in Spring 2013

•

ONLINE Student results for Spring 2013/Fall 2013

• 80% completed survey, N=4 (3 students Spring 2013, 1 Fall 2013)

• 50% agreed that the Online Prep Course were related to material covered in program area, 0% neutral.

• 50% agreed that the Online Prep Course made them feel more comfortable and relaxed during CPAS assessment, 0% neutral.

• 25% agreed that the Online Prep Course helped improve overall performance on CPAS assessment, 25% neutral.

• 0% agreed that they would recommend future students to take the Online CPAS Prep Course, 50% neutral.

• 2 students passed with scores greater than 70%

• No comments were left by online students

•

Spring 2014 Results –total students that will be tested=103,

including 6 online students.

(10)

•

Spring 2014 Student survey results (N=82)

• Spring 2014—100% completed surveys, N=82

• NEW Question—9% stated they have taken remedial course(s) and 40% agreed that the remedial course(s) helped them succeed in their program of study, 27% neutral.

• Comments included: “To be able to print out to the CPAS questions

to be able to look over them before taking the overall test”, “Study the code book more”.

(11)

CP AS SUR VI V AL BOO T CA MP

•

Spring 2014 ONLINE Student results

• ONLINE Student results (much more positive than last group of online students)

• 67% completed survey. N=4

• 75% agreed that the Online Prep Course were related to material covered in program area, 25% neutral.

• 75% agreed that the Online Prep Course made them feel more comfortable and relaxed during CPAS assessment, 0% neutral.

• 75% agreed that the Online Prep Course helped improve overall performance on CPAS assessment, 25% neutral.

• 75% agreed that they would recommend future students to take the Online CPAS Prep Course, 0% neutral.

(12)

CP AS SUR VI V AL BOO T CA MP

“Soldier” Comments

•

“We are very proud of the hard work that each of our faculty

have put into preparation of this assessment. It is a true

indication of the commitment and dedication our instructors

have for our students as we strive to offer the best programs in

the state.” (Jeremy Smith, VP of SMCC-CTE)

•

“Since the course, test scores have improved. Students appear

to be more comfortable using the computer to complete the

test.” (Aurelia Gayden, Counselor/CPAS Test Proctor, SMCC)

•

“CPAS preparation has given our students an excellent

opportunity to improve CPAS scores. It has provided practice in

testing taking and allowed the students to review their studies

throughout the program. It has improved final scores.” (Carol

(13)

“Soldier” Comments Cont’d

•

“Collectively my student’s scores on the CPAS test have

increased since the CTE 2001 CPAS Prep Course was added. In

addition their scores have increased on classroom

administered test thereby helping the HRAC program achieve a

higher rate of student completion.” (Michael Kyzar, Heating

and Air Conditioning Instructor, SMCC)

•

“My students have done so much better on CPAS after going to

the CPAS Review. We had one student score 98% and she

said that the CPAS review helped her so much, because while

taking the tests each week, she realized what she needed to go

back and review before the real CPAS later in the year.” (Kim

(14)

• “The CTE 2001 PREP course has been a huge help to the Automotive program by helping prepare students for the CPAS. They must apply what they have learned in the shop back to a written test and hands-on. This course has also helped me as an instructor to realize areas that we should go back and spend more time on to help the students have a better understanding of the material.” (Josh Troxler,

Automotive Technology Instructor, SMCC)

• “One main point of practicing the CPAS test is that it teaches the students to carefully read the questions before answering, and helps them learn ‘how to take a test’. The other aspect is that it helps them realize how much information they do not know and has given them more of an incentive to study the workbooks in class.” (Joe

(15)

CP AS SUR VI V AL BOO T CA MP

• “I feel that the CTE 2001 CPAS Prep course has had a positive impact on me, our program, and our students in the following ways:

• Students are made aware, through practice test, of the possible

content for CPAS testing. They no longer have to go in blind-sided not knowing what to expect on the day of CPAS testing.

• Students test scores are improved due to the fact that they have to attend focused CPAS prep test sessions.

• By making it a requirement and a credit, students take the CPAS

Assessment seriously and do try to do their very best on it. This helps to improve our state scores.

• If other community colleges are not already requiring this as one of their program requirements, I would highly recommend them

implementing this type of requirement into their curriculum.”

(16)

CP AS SUR VI V AL BOO T CA MP

• “CTE 2001 has afforded my students in the Business & Marketing

Management program an opportunity to better prepare for our state mandated CPAS exam. The students have become more comfortable with testing on the computers and familiarizing themselves with the atmosphere and conditions which they will experience sitting for their actual CPAS exam. As an instructor, I feel the CPAS prep course provides a wonderful platform and opportunity for me to present a review of my program’s state competencies to my students! I am also able to track my students’ efforts; including viewing their scores and the time they spend taking each test. I can use this information to motivate and encourage my students to learn something from each practice test in order to improve their test score each week; whether it’s to read the questions more thoroughly, spend more time taking the test or familiarizing themselves with material that they did not remember. As a result, most of my students challenge themselves to improve their test score each week; therefore, improving their odds of performing better on their actual CPAS exam.” (Deanna Martin, Marketing Management Technology

(17)

• “The CPAS Prep Course has helped changed my attitude about CPAS which in turn has created a positive attitude and learning

environment for my students. Our attitude and behaviors trickle down to our students.” (Brad Van Norman, Electrical Technology

Instructor, SMCC)

• “It’s the best thing that’s every happened at Southwest, getting students to practice what they’ve learned through tests. They

practice what they’ve learned a year and a half ago, which will help increase their scores.” (Danny Esch, Diesel Equipment Technology

Instructor, SMCC)

• “The biggest way CPAS Prep has affected my classes is that my students are not afraid of the test. They used to be intimidated by the test. Now they are relaxed because they practice once a week. As a matter of fact, they get competitive and that’s a good thing.” (Phil

(18)

CP AS SUR VI V AL BOO T CA MP

Contents of CD

• When you insert CD, it will auto run an executable menu with the following items available from that menu.

• CTE 2001-CPAS Prep Course Information Folder

• ExamView Information Folder

• Software Folder

• Presentations Folder

• SMART Sync Information Folder

• Evaluation Version—30 Day Folder

• Test Files—Per Program Area Folder

• The Online Environment Folder

• Online Test Files—

(19)

CP AS SUR VI V AL BOO T CA MP

CTE 2001-CPAS Prep Course Folder

•

CPAS Computer Instructions for Students—Word Document

• Step-by-step pictorial guide for students to complete practice assessments

•

CPAS Gradebook

• Excel document that contains a pre-calculated grading system for the CTE 2001 CPAS Prep Course

• First column provides space for student names per program area

• 12 additional columns for each test score

• One column (in red) to place actual CPAS score at end of the

semester and students averages at bottom of each program area

• Grade automatically generated based upon 50% completion of practice assessments + 50% completion of MS-CPAS2 Assessment

•

CPAS Review Schedule—Excel Document to place on door

(20)

ExamView Information Folder

• Software Folder

• ExamView 6.2—OLD Version

• Contains executable version of the software. This software is useful if you are accessing your server remotely because it allows easy-access of folder location

• ExamView 7.5—NEW Version

• Contains the installation files for installing ExamView Instructor

version and the ExamView Player software for the client/student computers. Also contains a user-friendly, 95-page ExamView Manual (PDF file).

• ExamView Player Executable Program Folder

• Contains 4 executable files that can be placed on a server and accessed by students without installing the ExamView Player on each client

(21)

CP AS SUR VI V AL BOO T CA MP

Presentations Folder

•

Contains the following PowerPoint Presentations:

• 2010—How To Use ExamView (PPT)

• Presentation on the ExamView Assessment Suite Version 6.2

including how to use the Test Generator, Test Manager, Test Player, Viewing Test Results, and the Import Utility (applicable to 7.5)

• 2010—KTynes Dissertation PDF document (Research Data)

• 2012—CPAS Presentation (PPT)

• Presentation on the longitudinal study conducted in 2010 that led to the current creation of the CTE 2001 CPAS Prep Course.

• Additional information on how the ExamView Assessment Suite 7.5 has been utilized to effectively administer the testing sessions for the course

• SMART Sync software introduced as a secondary lab monitoring tool for the CPAS Prep Course

• 2014—CPAS Survival Boot Camp (PPT)

(22)

CP AS SUR VI V AL BOO T CA MP

SMART Sync Information Folder

•

Evaluation Version—30 Day Folder

• Contains four installation files for a 30-day trial version:

• 1. SMART Sync Teacher Setup—Windows version

• 2. SMART Sync Student Setup—Windows version

• 3. SMART Sync Teacher Setup—MAC version

• 4. SMART Sync Student Setup—MAC version

• Regedit Instructions (.txt file)

• Simple text file containing instructions to setup one student computer in desired configuration (such as auto-connect to

instructor, not allowing students to disconnect, etc.) and then to be copied to all additional installations.

• SMART Sync Fact Sheet—PDF file

• SMART Sync User Manual—110-Page PDF File

(23)

CP AS SUR VI V AL BOO T CA MP

Test Files—Per Program Area Folder

•

ATT—Automotive Technology

•

BOT—Business and Office Related Technology Department

•

CAV—Residential Carpentry

•

CDT—Early Childhood Technology

•

DET—Diesel Equipment Technology

•

ELT—Electrical Technology

•

HVAC—Heating and Air Conditioning

•

IST—Computer Networking

•

MMT—Marketing Management Technology

•

PPT—Process Operations Technology

(24)

Test Files Folder –Continued

•

Each program folder contains the following information:

• Test Files Folder—contains the ExamView test files (.tst) along with the ExamView test banks (.bnk)

• 12 ExamView Online Test files (.eot) that the students will access

• The 4 executable files that are accessed by students without

installing the ExamView Player on each client computer. Students will simply open his/her program folder then double-click

“ExamView Player.exe”

• CPAS Review Class Roster—A Sample ExamView Class file (.cls) that displays sample student information and sample setup of the 12 practice online test files

•

TIP: Select all test files except “ExamView Player.exe”,

right-click and change to “Hidden”. Helps eliminate confusion for

students accessing the practice tests.

(25)

The Online Environment Folder

•

Online Test Files—Per Program Area Folder

• Contains folders for each program area previously listed.

• Each folder contains six compressed test files (.zip)

• These are the same six test files utilized in the in-person course

•

CTE 2001—CPAS Prep Online Syllabus Document

•

Final Exam Information Document

•

Instructions for Students Document

(26)

In-Person Class—Software

•

ExamView Assessment Suite Testing Software—FREE

• http://www.einstruction.com/products/examview/examview-assessment-suite

•

Smart Sync Classroom Management Software—Approximately

$1800 for 12 instructor computers and unlimited students

(27)

In-Person Class—Server/LAN Setup

•

One regular classroom computer needed with any flavor of

server software installed

•

One shared folder setup with the following access for students

and full access for you:

•

Root folder will propagate the same rights to any folder within

•

If you decide to run the ExamView Player from the server

instead of installing on all client computers, place the four

(28)

Server/LAN Setup—Continued

•

Server setup advantage: Internet connection not needed

•

Student access: Open your shared

folder on client computer. Click and

drag to make shortcut on desktop.

(29)

Canvas Setup

•

To create tests for CANVAS in ExamView, export each test file

as a “WebCT CE 6/VISTA 4…” compressed file format

(30)

Canvas Setup—Continued

•

Within CANVAS, go to Settings.

•

Select Import Content into this

Course on the right.

•

Select QTI .zip file from the

Content Type list.

•

Click Browse… to locate your zip file

(31)

• You have two ways to

administer the test.

1. With total questions you imported or…

2. Select Quizzes—Create a

New Quiz. Select Questions

tab. Click New Question Group.

Select the Link to a Question Bank option. Select your test from the list. (NOTE: upon

initial import, test has “no name”. Now you have option to select amount of questions and as a random block. You can go to Manage Course Question

Banks to rename each bank as

you import them.

(32)

CP AS SUR VI V AL BOO T CA MP

• Easy way to keep up with grades.

• Change Quiz Type to Practice Quiz.

• Select Allow Multiple Attempts.

• Practice Quizzes will not be added to your gradebook; therefore, if you

have students from multiple programs enrolled in your online

course, you will not have test columns for each program area visible to all students. Plus, the gradebook is more manageable for you.

• To view student results, select

Quizzes, select a quiz,

select to show student

quiz results on the right.

Attempts are shown as total points.

(33)

CP AS SUR VI V AL BOO T CA MP

•

Within Assignments , items

are weighted in three

categories: Resume Project,

CPAS Test, Participation

Practice Tests.

•

Select Add Assignment

Group to create groups.

•

On the right in Canvas, you can assign

weights per group area.

•

Students are required to have their

school’s test proctor fax/email me

official CPAS scores.

(34)

Additional Uses for Test Files

•

If you prefer paper tests, you can print out any of those

ExamView test files (.tst) as long as the ExamView Assessment

Suite is installed on your computer

•

You can export those test files as rich text files (.rtf) and open

them in Microsoft Word if you prefer this method

•

You can utilize the Online Test Files, export to CANVAS and

utilize CANVAS in your in-person courses instead of the

ExamView Test Player/LAN setup.

(35)

Future Survival Tips

• Limit all interactive test files to 50 questions.

• Students react better to 30-50 questions instead of 50-75.

• Student averages increase and they tend to retake tests more often when they can do so in shorter time spans.

• Work with the students!! Positive reinforcement!!

• Communication is the key to successful passage rates

• Utilize student and instructor feedback

• Online course still a work in progress

• Remember the test files provided are a work in progress and should be updated on a continuous basis!!!

• CD TIP: If you do not have admin rights on your office computer, you will need to copy the ExamView test files to your computer before you can open them.

CPAS Prep will always be a work in progress.

If it helps at least one student,

(36)

Presented by: Kimberly Tynes, Ph.D.

Instructor, Southwest Mississippi Community College

[email protected]

http://www.einstruction.com/products/examview/examview-assessment-suite

http://smarttech.com/sync

in \\servername