• No results found

Interpreting the Mean Comparisons Report

N/A
N/A
Protected

Academic year: 2021

Share "Interpreting the Mean Comparisons Report"

Copied!
17
0
0

Loading.... (view fulltext now)

Full text

(1)

Benchmark

Mean

Effect Size

Class

Effect size indicates the “practical significance” of the mean difference. It is calculated by dividing the mean difference by the standard deviation of the group with which the institution is being compared. In practice, an effect size of .2 is often considered small, .5 moderate, and .8 large. A positive sign indicates that your institution's mean was greater, thus showing an affirmative result for your institution. A negative sign indicates the institution lags behind the comparison group, suggesting that the student behavior or institutional practice represented by the item may warrant attention. An exception to this interpretation is the “coming to class unprepared” item (item 1f.) where a negative sign is preferred EEE=Enriching Educational Experiences SFI=Student-Faculty Interaction ACL=Active and Collaborative Learning LAC=Level of Academic Challenge SCE=Supportive Campus Environment

Results are reported separately for first-year students (FY) and seniors (SR). Institution-reported class ranks are used. The mean is the

weighted arithmetic average of student responses on a particular item. Means are provided for your institution and all comparison groups. For more information about weighting go to:

www.nsse.iub.edu/html/2006_inst_report.htm.

each variable appears in the second column for easy reference to your data file and the summary statistics at the end of this section. Response options are also provided to help you interpret the statistics.

Items that comprise the five “Benchmarks of Effective Educational Practice” are indicated by the following:

of mean differences may be inconsequential. It is recommended to start by interpreting only those items with three asterisks (p<.001) and to consult effect sizes (see below) to judge the practical meaning of the results.

(2)

Variable mark Class Mean Mean Sig Size Mean Sig Size Mean Sig Size

1. Academic and Intellectual Experiences

FY 2.52 2.76 *** -.30 2.65 ** -.15 2.78 *** -.31 SR 2.70 2.90 *** -.23 2.96 *** -.30 3.06 *** -.42 FY 2.37 2.37 2.09 *** .35 2.23 *** .17 SR 2.57 2.89 *** -.39 2.69 * -.14 2.80 *** -.26 FY 2.25 2.32 2.62 *** -.38 2.65 *** -.41 SR 2.24 2.36 * -.14 2.48 *** -.26 2.49 *** -.26 FY 2.91 2.93 2.97 3.03 ** -.15 SR 3.11 3.25 ** -.18 3.25 ** -.18 3.30 *** -.25 FY 2.64 2.50 ** .16 2.72 2.76 * -.13 SR 2.14 2.26 * -.13 2.71 *** -.61 2.78 *** -.71 ACL ACL

Worked on a paper or project that required integrating ideas or information from

various sources

INTEGRAT

Included diverse perspectives (different races, religions, genders, political beliefs, etc.) in class discussions or writing assignments

DIVCLASS

Made a class presentation CLPRESEN

Prepared two or more drafts of a paper or assignment before turning it in

REWROPAP

Asked questions in class or

contributed to class discussions CLQUEST

In your experience at your institution during the current school year, about how often have you done each of the following? 1=never, 2=sometimes, 3=often, 4=very often

a.

b.

c.

d.

(3)

Variable mark Class Mean Mean Sig Size Mean Sig Size Mean Sig Size FY 2.16 1.99 *** .23 2.11 2.03 ** .17 SR 2.35 2.21 * .17 2.17 *** .23 2.12 *** .29 FY 2.60 2.56 2.39 *** .25 2.40 *** .24 SR 2.43 2.56 * -.15 2.47 2.51 FY 3.02 2.95 2.36 *** .76 2.36 *** .77 SR 3.28 3.29 2.79 *** .54 2.75 *** .59 FY 2.59 2.70 * -.13 2.55 2.57 SR 2.97 3.04 2.90 2.91 FY 1.92 2.07 * -.15 1.71 *** .26 1.67 *** .31 SR 2.28 2.26 1.89 *** .41 1.88 *** .41 FY 1.36 1.40 1.51 *** -.19 1.50 *** -.18 SR 1.49 1.45 1.66 *** -.19 1.69 *** -.22 ACL ACL ACL ACL

Worked with classmates outside of class to

prepare class assignments

OCCGRP

Put together ideas or concepts from different courses when completing assignments or during class discussions

INTIDEAS

Come to class without completing

readings or assignments CLUNPREP

Worked with other students on

projects during class CLASSGRP

f.

g.

h.

Tutored or taught other students

(paid or voluntary) TUTOR

Participated in a community-based project (e.g. service learning) as part of a regular course

COMMPROJ i.

j.

(4)

Variable mark Class Mean Mean Sig Size Mean Sig Size Mean Sig Size FY 2.63 2.89 *** -.26 2.69 2.64 SR 2.77 3.05 *** -.28 2.88 2.85 FY 2.91 3.06 ** -.18 3.02 * -.12 3.01 * -.12 SR 3.28 3.29 3.31 3.31 FY 2.38 2.62 *** -.29 2.51 * -.14 2.56 *** -.21 SR 2.64 2.80 ** -.18 2.76 * -.13 2.79 ** -.17 FY 1.97 2.11 * -.16 2.07 2.11 ** -.15 SR 2.24 2.49 *** -.27 2.33 2.41 ** -.17 FY 1.71 1.92 *** -.24 1.75 1.81 * -.12 SR 2.00 2.13 * -.14 2.02 2.08 FY 2.54 2.68 ** -.17 2.50 2.58 SR 2.75 2.76 2.69 2.76 FY 2.38 2.55 ** -.19 2.54 ** -.19 2.58 *** -.23 SR 2.55 2.61 2.67 * -.14 2.69 ** -.16 SFI LAC SFI SFI SFI EEE

Received prompt written or oral feedback from faculty on your academic performance

FACFEED

Worked harder than you thought you could to meet an instructor's

standards or expectations

WORKHARD

Talked about career plans with a faculty member

or advisor

FACPLANS

Discussed ideas from your readings or classes

with faculty members outside of class

FACIDEAS

Used e-mail to communicate with an

instructor EMAIL

Discussed grades or assignments with

an instructor FACGRADE

Used an electronic medium (listserv, chat group, Internet, instant

messaging, etc.) to discuss or complete an assignment ITACADEM l. m. n. o. p. q. r.

(5)

Variable mark Class Mean Mean Sig Size Mean Sig Size Mean Sig Size FY 1.62 1.74 * -.14 1.51 * .13 1.56 SR 1.95 2.03 1.75 *** .22 1.81 * .15 FY 2.52 2.65 * -.15 2.68 ** -.18 2.69 ** -.19 SR 2.67 2.74 2.85 *** -.22 2.84 *** -.21 FY 2.25 2.74 *** -.47 2.54 *** -.28 2.55 *** -.29 SR 2.36 2.67 *** -.30 2.64 *** -.28 2.64 *** -.28 FY 2.59 2.85 *** -.26 2.66 2.68 SR 2.59 2.75 * -.17 2.67 2.71 * -.13 EEE EEE SFI ACL

Had serious conversations with students of a different race or ethnicity than your own

DIVRSTUD

Had serious conversations with students who are very different from you in terms of their religious beliefs, political opinions, or personal values

DIFFSTU2

Worked with faculty members on activities other than coursework (committees, orientation, student life activities, etc.)

FACOTHER

Discussed ideas from your readings or classes with others outside of class (students, family members, co-workers, etc.) OOCIDEAS s. t. u. v.

(6)

Variable mark Class Mean Mean Sig Size Mean Sig Size Mean Sig Size 2. Mental Activities FY 2.69 2.70 2.91 *** -.26 2.87 *** -.21 SR 2.60 2.63 2.78 ** -.20 2.74 * -.15 FY 3.03 3.20 *** -.23 3.05 3.06 SR 3.17 3.27 * -.15 3.22 3.22 FY 2.79 2.95 ** -.19 2.81 2.83 SR 2.92 2.99 2.99 3.01 FY 2.78 2.83 2.78 2.82 SR 2.86 2.93 2.92 2.94

During the current school year, how much has your coursework emphasized the following mental activities? 1=very little, 2=some, 3=quite a bit, 4=very much

LAC

LAC LAC

Synthesizing and organizing ideas, information, or experiences into new, more complex interpretations and relationships

SYNTHESZ

Making judgments about the value of information, arguments, or methods, such as examining how others gathered and interpreted data and assessing the soundness of their conclusions

EVALUATE

Memorizing facts, ideas, or methods from your courses and readings so you can repeat them in pretty much the same form

MEMORIZE

Analyzing the basic elements of an idea, experience, or theory, such as examining a particular case or

situation in depth and considering its components ANALYZE a. b. c. d.

(7)

Variable mark Class Mean Mean Sig Size Mean Sig Size Mean Sig Size

FY 3.06 3.29 *** -.29 2.98 2.98

SR 3.26 3.35 3.16 3.17

3. Reading and Writing

FY 3.33 3.22 * .13 3.23 3.26 SR 2.80 3.00 ** -.21 3.14 *** -.34 3.18 *** -.38 FY 1.91 2.04 * -.14 2.05 * -.15 2.06 ** -.16 SR 2.18 2.21 2.20 2.21 FY 1.32 1.30 1.23 * .15 1.25 SR 1.70 1.93 *** -.28 1.61 * .13 1.64 FY 2.14 2.28 ** -.16 2.24 * -.12 2.29 *** -.17 SR 2.48 2.51 2.49 2.59 FY 3.38 3.00 *** .37 3.04 *** .32 3.05 *** .31 SR 2.96 2.80 * .14 2.95 2.98

During the current school year, about how much reading and writing have you done? 1=none, 2=between 1 and 4, 3=between 5 and 10, 4=between 11 and 20, 5=more

LAC LAC

LAC

LAC LAC

Number of written papers or reports

between 5 and 19 pages WRITEMID

Number of written papers or reports

of fewer than 5 pages WRITESML

Number of books read on your own (not assigned) for personal enjoyment or academic enrichment

READOWN

Number of written papers or reports

of 20 pages or more WRITEMOR

Applying theories or concepts to practical problems or in new situations

APPLYING

Number of assigned textbooks, books, or

book-length packs of course readings

READASGN e. a. b. c. d. e.

(8)

Variable mark Class Mean Mean Sig Size Mean Sig Size Mean Sig Size 4. Problem Sets FY 2.90 3.13 ** -.20 2.65 *** .22 2.63 *** .25 SR 3.00 2.91 2.60 *** .32 2.57 *** .35 FY 2.97 2.81 * .13 2.77 ** .17 2.74 ** .19 SR 2.42 2.26 2.37 2.34

5. Examinations 1=very little to 7=very much

FY 5.50 5.60 5.42 5.42

SR 5.51 5.42 5.41 5.41

6. Additional Collegiate Experiences

FY 2.18 1.81 *** .48 2.12 2.10

SR 1.85 1.78 1.98 * -.14 2.01 ** -.17

To what extent have your examinations during the current school year challenged you to do your best work?

EXAMS

During the current school year, about how often have you done each of the following? 1=never, 2=sometimes, 3=often, 4=very often

In a typical week, how many homework problem sets do you complete? 1=none, 2=1-2, 3=3-4, 4=5-6, 5=more than 6

Attended an art exhibit, gallery, play,

dance, or other theatre performance ATDART05

Number of problem sets that take you

more than an hour to complete PROBSETA

Number of problem sets that take you

less than an hour to complete PROBSETB

a.

b.

(9)

Variable mark Class Mean Mean Sig Size Mean Sig Size Mean Sig Size FY 2.97 3.00 2.78 ** .18 2.77 *** .19 SR 3.02 2.94 2.70 *** .30 2.70 *** .31 FY 1.94 1.80 * .14 2.21 *** -.23 2.09 * -.13 SR 2.05 1.88 * .16 2.36 *** -.26 2.18 * -.12 FY 2.44 2.54 2.57 ** -.15 2.58 ** -.15 SR 2.47 2.54 2.70 *** -.26 2.69 *** -.26 FY 2.58 2.65 2.72 ** -.16 2.74 ** -.19 SR 2.59 2.68 2.83 *** -.28 2.83 *** -.28 FY 2.66 2.79 * -.16 2.79 ** -.16 2.80 ** -.17 SR 2.63 2.76 * -.16 2.87 *** -.30 2.87 *** -.29

7. Enriching Educational Experiences

FY .06 .05 .07 .07

SR .62 .57 .50 *** .25 .53 ** .18

f.

Learned something that changed the way you understand an issue or concept

CHNGVIEW e.

Tried to better understand someone else's views by imagining how an issue looks from his or her perspective

OTHRVIEW d.

Examined the strengths and

weaknesses of your own views on a topic or issue

OWNVIEW

Participated in activities to enhance your spirituality (worship, meditation, prayer, etc.)

Which of the following have you done or do you plan to do before you graduate from your institution? (Recoded: 0=have not decided, do not plan to do, plan to do;

EEE WORSHP05

b. Exercised or participated in physical

fitness activities EXRCSE05

Practicum, internship, field experience, co-op experience, or clinical

assignment

INTERN04 c.

(10)

Variable mark Class Mean Mean Sig Size Mean Sig Size Mean Sig Size FY .33 .38 .37 .37 SR .62 .59 .57 .59 FY .34 .12 *** .67 .18 *** .43 .15 *** .52 SR .36 .21 *** .37 .26 *** .23 .25 *** .25 FY .04 .05 .04 .05 SR .24 .25 .19 * .14 .19 FY .15 .09 * .20 .22 ** -.16 .22 *** -.17 SR .26 .21 .41 *** -.31 .41 *** -.32 FY .02 .02 .02 .03 SR .12 .16 .13 .14 FY .02 .02 .03 .03 SR .13 .22 *** -.22 .17 * -.12 .19 ** -.15 FY .01 .01 .01 .01 SR .56 .56 .30 *** .58 .32 *** .51 EEE EEE SFI EEE EEE EEE

Culminating senior experience (capstone course, senior project or thesis, comprehensive exam, etc.)

SNRX04

Study abroad STDABR04

Independent study or self-designed

major INDSTD04

Work on a research project with a faculty member outside of course or program requirements

RESRCH04

Foreign language coursework FORLNG04

Community service or volunteer work VOLNTR04

Participate in a learning community or some other formal program where groups of students take two or more classes together LRNCOM04 c. d. e. b. f. g. h.

(11)

Variable mark Class Mean Mean Sig Size Mean Sig Size Mean Sig Size 8. Quality of Relationships FY 5.53 5.69 5.44 5.48 SR 5.74 5.61 5.59 * .11 5.60 FY 5.00 5.31 *** -.24 5.01 5.20 ** -.15 SR 5.24 5.41 5.28 5.42 * -.13 FY 4.75 4.80 4.47 ** .18 4.60 SR 4.56 4.49 4.43 4.50

Mark the box that best represents the quality of your relationships with people at your institution. 1=unfriendly, unsupportive, sense of alienation to 7=friendly, supportive,

1=unavailable, unhelpful, unsympathetic to 7=available, helpful, sympathetic

1=unhelpful, inconsiderate, rigid to 7=helpful, considerate, flexible

SCE SCE

SCE ENVFAC

Relationships with other students ENVSTU

Relationships with faculty members

Relationships with administrative

personnel and offices ENVADM

b. a.

(12)

Variable mark Class Mean Mean Sig Size Mean Sig Size Mean Sig Size 9. Time Usage FY 4.32 4.60 * -.16 4.02 ** .18 3.99 *** .20 SR 4.59 4.53 4.10 *** .28 4.10 *** .28 FY 1.57 1.64 1.50 1.53 SR 2.14 2.21 1.87 ** .16 1.83 ** .19 FY 1.35 1.61 ** -.18 2.34 *** -.45 2.59 *** -.52 SR 1.80 2.36 *** -.25 3.68 *** -.67 3.81 *** -.72 COCURR01 EEE FY 2.66 2.88 * -.13 2.18 *** .32 2.17 *** .32 SR 2.94 2.85 2.00 *** .66 2.08 *** .57 FY 4.05 3.79 * .16 3.90 3.79 ** .15 SR 3.61 3.74 3.48 3.48 FY 1.21 1.27 1.57 *** -.26 1.78 *** -.34

About how many hours do you spend in a typical 7-day week doing each of the following?

LAC

Providing care for dependents living

with you (parents, children, spouse, CAREDE01

Relaxing and socializing (watching TV,

partying, etc.) SOCIAL05

Working for pay on campus WORKON01

WORKOF01

Participating in co-curricular activities (organizations, campus publications, student government, fraternity or sorority, intercollegiate or intramural sports, etc.)

Preparing for class (studying, reading, writing, doing homework or lab work, analyzing data, rehearsing, and other academic activities) ACADPR01 b. c. a. f. d. e.

(13)

Variable mark Class Mean Mean Sig Size Mean Sig Size Mean Sig Size SR 1.39 1.47 2.31 *** -.41 2.34 *** -.42 FY 1.96 1.97 2.33 *** -.35 2.24 *** -.27 SR 2.12 2.14 2.42 *** -.29 2.38 *** -.25 10.Institutional Environment FY 3.19 3.29 * -.14 3.04 ** .19 3.07 * .15 SR 3.20 3.31 * -.15 3.07 ** .16 3.08 * .15 FY 3.13 3.22 2.93 *** .25 2.99 ** .17 SR 2.89 3.00 2.80 2.87 FY 2.56 2.55 2.52 2.57 SR 2.24 2.18 2.34 2.40 ** -.16

To what extent does your institution emphasize each of the following? 1=very little, 2=some, 3=quite a bit, 4=very much

SCE

EEE LAC

with you (parents, children, spouse, etc.)

CAREDE01

Commuting to class (driving, walking,

etc.) COMMUTE

Spending significant amounts of time

studying and on academic work ENVSCHOL

Providing the support you need to

help you succeed academically ENVSUPRT

Encouraging contact among students from different economic, social, and racial or ethnic backgrounds

ENVDIVRS b. a. f. c. g.

(14)

Variable mark Class Mean Mean Sig Size Mean Sig Size Mean Sig Size FY 2.06 2.19 * -.14 2.09 2.13 SR 1.80 1.89 1.90 1.91 FY 2.33 2.37 2.37 2.37 SR 2.09 2.07 2.14 2.14 FY 2.86 2.88 2.78 2.75 * .12 SR 2.52 2.56 2.58 2.57 FY 3.56 3.65 3.35 *** .28 3.32 *** .31 SR 3.63 3.73 * -.19 3.47 *** .22 3.47 *** .22

11.Educational and Personal Growth

FY 2.89 2.89 3.10 *** -.28 3.12 *** -.29

SR 2.93 2.88 3.22 *** -.36 3.24 *** -.39

FY 2.97 3.19 *** -.25 2.68 *** .31 2.70 *** .28

SR 3.13 3.33 *** -.24 3.01 * .13 3.02

To what extent has your experience at this institution contributed to your knowledge, skills, and personal development in the following areas?

SCE

SCE

ENVEVENT

Providing the support you need to

thrive socially ENVSOCAL

ENVCOMPT

Attending campus events and activities (special speakers, cultural performances, athletic

events, etc.)

Using computers in academic work Helping you cope with your non-academic responsibilities (work, family, etc.)

ENVNACAD

Acquiring a broad general education GNGENLED

Acquiring job or work-related knowledge and skills GNWORK f. d. e. a. b. g.

(15)

Variable mark Class Mean Mean Sig Size Mean Sig Size Mean Sig Size FY 2.53 2.68 * -.16 2.89 *** -.41 2.95 *** -.49 SR 2.55 2.70 * -.16 3.02 *** -.54 3.07 *** -.61 FY 2.47 2.67 ** -.21 2.67 *** -.21 2.75 *** -.31 SR 2.59 2.77 ** -.20 2.90 *** -.34 2.96 *** -.41 FY 3.18 3.36 ** -.23 3.14 3.16 SR 3.36 3.43 3.32 3.33 FY 3.16 3.37 *** -.28 2.85 *** .34 2.85 *** .34 SR 3.41 3.41 3.03 *** .43 3.01 *** .45 FY 3.37 3.49 * -.17 3.00 *** .41 2.99 *** .42 SR 3.52 3.58 3.23 *** .35 3.20 *** .37 FY 3.14 3.23 2.88 *** .30 2.92 *** .25 SR 3.17 3.32 ** -.20 3.10 3.14

Using computing and information

technology GNCMPTS

Working effectively with others GNOTHERS

Thinking critically and analytically GNANALY

Analyzing quantitative problems GNQUANT

Writing clearly and effectively GNWRITE

Speaking clearly and effectively GNSPEAK

f. d. e. c. g. h.

(16)

Variable mark Class Mean Mean Sig Size Mean Sig Size Mean Sig Size FY 1.55 1.55 1.93 *** -.38 1.92 *** -.37 SR 1.64 1.62 2.09 *** -.43 2.10 *** -.44 FY 2.75 2.87 * -.14 2.85 * -.12 2.85 * -.12 SR 2.94 3.00 2.99 3.00 FY 2.36 2.50 * -.14 2.68 *** -.33 2.71 *** -.36 SR 2.43 2.49 2.75 *** -.31 2.78 *** -.35 FY 2.28 2.29 2.55 *** -.28 2.58 *** -.30 SR 2.18 2.11 2.54 *** -.37 2.57 *** -.40 FY 2.74 3.01 *** -.29 2.56 ** .20 2.58 ** .18 SR 2.98 3.07 2.73 *** .26 2.72 *** .28 FY 2.47 2.48 2.59 * -.12 2.59 SR 2.42 2.46 2.67 *** -.24 2.65 *** -.22 FY 2.13 2.20 2.37 *** -.24 2.34 *** -.21 SR 2.10 2.09 2.44 *** -.32 2.42 *** -.31

Contributing to the welfare of your

community GNCOMMUN

Solving complex real-world problems GNPROBSV

Voting in local, state, or national

elections GNCITIZN

Learning effectively on your own GNINQ

Developing a personal code of values

and ethics GNETHICS

Understanding yourself GNSELF

Understanding people of other racial

and ethnic backgrounds GNDIVERS

m. l. i. j. o. k. n.

(17)

Variable mark Class Mean Mean Sig Size Mean Sig Size Mean Sig Size

FY 1.61 1.63 2.10 *** -.44 2.05 *** -.41

SR 1.61 1.50 2.01 *** -.35 1.92 *** -.29

12.Academic Advising 1=poor, 2=fair, 3=good, 4=excellent

FY 3.02 3.12 2.90 * .14 2.94

SR 2.89 2.92 2.75 * .14 2.82

13.Satisfaction 1=poor, 2=fair, 3=good, 4=excellent

FY 3.20 3.30 3.15 3.16

SR 3.20 3.22 3.16 3.19

14. 1=definitely no, 2=probably no, 3=probably yes, 4=definitely yes

FY 3.29 3.27 3.22 3.20

SR 3.24 3.07 * .17 3.16 3.17

IPEDS: 171128

p. Developing a deepened sense of

spirituality GNSPIRIT

Overall, how would you evaluate the quality of academic advising you have received at your institution?

ADVISE

ENTIREXP

If you could start over again, would

you go to the same institution you

are now attending?

SAMECOLL

How would you evaluate your entire educational experience at this institution?

References

Related documents

The performance involves the participation of the king of Ataoja of osogbo, Arugba (votary mad) Aworo Osun , Iya Osun (chief priest and priestess), and the entire  people

Under Local Law 87, the Association of Energy Engineers' Certified Building Commissioning Firm, Certified Building Commissioning Professional, and Existing

Each sensor strip consists of three 9 D inertial sensors (MPU9250), 512 kBit SPI flash memory, and one connector to the base unit.. All components are connected by a 19 cm long

NLP Coaching Language (including the infamous NLP Meta-Model) is the most powerful set of questions and linguistic tools there is for helping people to solve problems, make

[r]

The lift to drag ratio increases as the angle of attack increased on both wings, for rear wing the lift to drag ratio is reduced when compared to that of front wing due to

As mentioned at the beginning of this paper, the methodology of risk assessment is to assemble the results of the Threat Assessment, Vulnerability Assessment, and Impact Assessment

The provision of fermented cassava peel using local microorganisms has a very significant effect (P &lt;0.01) on the quality content of local rams meat in terms of protein content