ASSESSMENT TECHNOLOGY, INCORPORATED

A ^SSESSMENT T ^ECHNOLOGY , I NCORPORATED

A Guide for Galileo

K-12 Online School Performance Dashboard: Risk Level Summary

PURPOSE

This report shows progress reflected in performance on a series of benchmark tests that have been placed on a common scale. Since the tests have been placed on a common scale, the scores can be directly compared and an estimate can be generated related to each student’s risk of not meeting the standards on the next state standardized assessment. This risk level is based on where his or her

Development Level (DL) score falls relative to the Meets cut score on each ATI benchmark assessment taken. The cut scores on the benchmark assessments are set to correspond to the cut score on the state standardized test.

ACCESS

Risk Level Summary Data may be easily accessed from the School Performance Dashboard page’s Risk Level Summary widget.

Please note, risk level data may also be analyzed by running the Aggregate Multi- test with Risk Levels report.

Refer to A Guide for Galileo^® K-12 Online Generating Aggregate Multi- Test with Risk Level Report.

GENERATE REPORT

1. Click the Dashboard link.

2. Use the down arrow to select School Performance.

3. Use the down arrow to select the desired School(s). To run a District-level Risk Level Summary report, select [All Schools].

4. On the Risk Level Summary widget, select the Library and Subject.

5. Click the Run Report button.

6. The number of students in each risk level will be represented in the bar graph.

7. Click either the:

a. risk level bar to view the

Instruction Performance Tracker report for the selected risk level.

b. the View Instruction

Performance Tracker for all Risk Levels link.

REPORT INTERPRETATION

a. The selected District or School.

b. The Library and Subject where the assessments reside.

c. The table lists all administered ATI- created

assessments, the number of students included in the report, the average Developmental Level (DL) score and the cutscores for each state- defined achivement level.

d. The risk level, based on all ATI- created

assessments.

Click the Student Risk Level radio button to change the risk level displayed.

e. The total number of students in the selected risk level.

f. The step to move the selected Student Risk Level (d) from one risk level to another risk level.

g. The Assignment and Quiz Builder buttons allow the user to quickly schedule an assignment and/or quiz for the standards in that step.

h. The ATI-created assessment on which the standard appeared. If multiple numbers appear (1, 2) this indicates that the standard appeared on first and second assessment.

i. The total number of test items that appeared on all the benchmarks addressing this standard.

j. The learning standard addressed.

k. The probability that the students in the selected Student Risk Level have mastered the standard. This is generated using Item Response Theory (IRT).

IRT estimates the probability of mastering an item based on the ability of the students and the item characteristics. Item characteristics include the

difficulty of the item and the ability of the item to discriminate between students of differing levels.

l. The average points earned is the earned points divided by the total number of questions for that standard.

m. Checkbox to select (or deselect) the learning standard for an action (g).

ASSIGNMENTS

By clicking on the Assignment button and completing the Schedule

Assignments page, you can

automatically generate an assignment (e.g., a Dialog) for the selected

Student Risk Level. An assignment within Galileo is defined as either an Instructional Dialog or a user-created student activity. Assignments are standards-driven. Dialog assignments can be done online by students or presented as whole class instruction.

1. Click the radio button for the desired Student Risk Level.

2. (optional) Uncheck the Learning Standard(s) you want to exclude from the assignment.

3. Click on the Assignments button.

You are brought to the Schedule Assignments page.

4. A list of assignments is displayed ordered by standard.

5. Review the list; click the View icon or Dialog name link to preview the assignment.

6. Place a checkmark by the desired assignment(s) that you want to administer.

S

O

7. Click the radio button to schedule the Assignment(s) for a(n):

a. Class – Select the Class from the drop-down field.

b. New intervention group – Select the desired Intervention Group Library and name the Intervention Group.

c. Existing intervention group – Select the desired Intervention Group Library and

Intervention Group.

Most often, you will want to schedule it for an Intervention Group.

A

D

8. Select the Dialog Library in which to store the copied dialog.

9. Select the test Library in which to copy the associated test.

10.Use the Assign on: and Due Date: calendars to select when and for how many days you wish this assignment to be available to students.

11.Use the Available From and to dropdown fields to select the start and end times.

A

12.Click on the “Post assignment”

box to make the assignment

available for students to take in the K-12 Student-Parent Center.

13.Click the Save Schedule button.

14.Students are now ready to take the Assignment in the K-12 Student- Parent Center.

15.The scheduled assignment now appears on the Teaching

Dashboard and Class Calendar pages.

QUIZ BUILDER

By clicking the Quiz Builder button and completing the Quiz Builder page, you can automatically generate a quiz for the selected Student Risk Level. A quiz generated this way will contain a 5-item test for each designated

objective.

1. Click the radio button for the desired Student Risk Level.

2. (optional) Uncheck the Learning Standard(s) you want to exclude from the Quiz Builder tool.

3. Click the Quiz Builder button. You are brought to the Quiz Builder page.

4. Verify the objectives for which you’d like to generate a quiz.

L

5. Select the quiz library.

6. Select the Subject.

A

7. Select the dates and times for which you would like to have students take the quiz(zes).

8. Click the Generate Quizzes button.

9. One quiz is created per objective.

You may change the name,

scheduling date and time of any of the quizzes. We recommend you change the quiz name from the default name.

10.Click the View/Edit Quiz icon to preview the quiz and/or edit the quiz.

REPLACE A QUESTION (OPTIONAL) 11.Click the Replace… link by the

question.

12.The current test item displays.

Underneath you will see all of the questions in the bank that can replace the current question.

13.Click the Select button beside the question you would like to appear on the quiz. This question will replace the current question.

14.Click the Finished button.

15.You are brought back to the Quiz Builder page.

S

S

16.Click the radio button to schedule the quiz(zes) for a(n):

a. Class – Select the Class from the drop-down field.

b. New intervention group – Select the desired Intervention Group Library and name the Intervention Group.

c. Existing intervention group – Select the desired Intervention Group Library and

Intervention Group.

S

17.Click the Schedule Quizzes button.

Students are now ready to take the online quiz via the K-12 Student- Parent Center. If you want students to take quiz(zes) offline you must schedule the quiz(zes) through traditional means (Teaching Dashboard page).

INTERVENTION GROUPS

An Intervention Group is a way to group students who share

commonalities. You can use an Intervention Group when assigning quizzes or assignments to a particular group of students. For example, Galileo creates Intervention Groups based on risk-levels or allows the user to create them based on

demographics.

Refer to A Guide for Galileo K-12 Online Intervention Groups for

directions on creating, modifying, and deleting an Intervention Group.

Rename quiz to include learning