Generalizability and reliability
The Generalizability and Reliability of Scores on the Rosenberg Self-Esteem Scale Over Forty-Eight Years
... acceptable reliability for low-stakes research contexts in the populations explored here (Stephanie, ...The reliability of scores on the Single-Item Self-Esteem Scale (SISE) were not considered because it ...
48
Design and evaluation of video portfolios : reliability, generalizability, and validity of an authentic performance assessment for teachers
... the reliability of assessors’ scoring and the generalizability of judgments were investigated based on several quantitative analyses concerning scores assigned to video episodes and overall ...the ...
177
Creating Test Score Bands for Assessments Involving Ratings using a Generalizability Theory Approach to Reliability Estimation
... the generalizability theory ...the reliability estimates from the traditional methods are not appropriate for many rating designs and they are less accurate (especially when there are a small number of rat- ...
10
Marker effects and examination reliability: a comparative exploration from the perspectives of generalizability theory, Rasch modelling and multilevel modelling
... Classical reliability coefficients are most often constructed as intra-class correlations, ratios of true score variance to the combination of true score and error ...variance. Generalizability coefficients ...
87
A Scale of Parental Anxiety about Pediatric Emergency Medical Care Services of Japan: Development, Reliability, Validity, Generalizability and Usefulness
... To provide suitable PEMCS that eliminate parental anxieties with limited health resources, it is firstly essential to investigate the multifarious parental an- xieties about PEMCS. If a scale for quantifying the contents ...
33
Reliability and Generalizability of Similarity-Based Fusion of MEG and fMRI Data in Human Ventral and Dorsal Visual Streams
... Received: 22 October 2018; Accepted: 13 January 2019; Published: 10 February 2019 Abstract: To build a representation of what we see, the human brain recruits regions throughout the visual cortex in ...
18
Reliability of a viva assessment of clinical reasoning in an Australian pre-professional osteopathy program assessed using generalizability theory
... The results of the present study suggest that further examiner train- ing is required in order to improve the reliability of the examination. A number of the examiners reported difficulty completing the full suite ...
6
Reliability analysis of the Chinese version of the Functional Assessment of Cancer Therapy – Leukemia (FACT-Leu) scale based on multivariate generalizability theory
... Discussion Reliability of the Chinese version of the FACT-Leu The reliability is the extent of variation reflected by the measured results that is the result of accidental errors in the ...the ...
12
Multiple tutorial-based assessments: a generalizability study
... A literature search on TBA reveals several forms of varying length (e.g., 3 to 31 items) and proposed adminis- tration frequency (e.g. end of each session within a unit vs. at the end of a unit). Studies on the ...
6
Clinical assessment of transthoracic echocardiography skills: a generalizability study
... accounted for the test stability of the TTE technical pro- ficiency assessment instrument. This would however have required a repetition of the whole test set-up on a second occasion, which was not feasible in the ...
7
Score Generalizability of Writing Assessment: the Effect of Rater’s Gender
... score reliability of language performance tests has attracted increasing ...error. Generalizability theory extends Classical Test Theory to provide a practical framework to identify and estimate multiple ...
24
Using Rater Cognition to Improve Generalizability of an Assessment of Scientific Argumentation
... Courtney Castle, Woodrow Wilson Graduate School of Teaching and Learning Rater cognition or “think-aloud” studies have historically been used to enhance rater accuracy and consistency in writing and language assessments. ...
24
CiteSeerX — Revision of a Criterion-Referenced Vocabulary Test Using Generalizability Theory
... Results Table 1 provides the descriptive statistics. The mean of the vocabulary test was 12.37 out of 25; this is desirable because it reveals that the examinees have not yet mastered all the vocabulary words. However, ...
20
The Cross-National Generalizability of Biographical Data: An Examination within a Multinational Organization
... Including items with smaller relationships with the criterion has the potential to disproportionally increase error variance, which will impact the reliability and criterion-related validity of the instrument. ...
140
Identifying and Overcoming Threats to Reproducibility, Replicability, Robustness, and Generalizability in Microbiome Research
... Both of these anecdotes are at odds with the tone of a recent report by the American Academy of Microbiology’s (AAM’s) 2015 colloquium “Promoting Responsible Scientific Research” and its accompanying editorial in mBio (4, ...
13
The General Psychopathology Factor: Structural Stability and Generalizability to Within-Individual Changes
... construct reliability coefficients are presented in Supplementary Tables ...construct reliability, with the exception of the specific internalizing factor, which was not well defined, as it included both ...
10
Generalizability revisited: Comparing undergraduate business students to credit union managers
... predictor variable is thoroughly supported by the sheer volume of published descriptive statistics and measures of reliability attached to their use. Ward compared 207 undergraduate students to 180 full time ...
11
On generalizability of MOOC models
... mator of the relation between y and independent variable x and Var corresponds to the sample variance. 4.2 Example method In the linear regression, the main source of complexity is due to the number of variables in the ...
6
Reliability and Generalizability of Similarity-Based Fusion of MEG and fMRI Data in Human Ventral and Dorsal Visual Streams
... Experiment 1 Twins-set spatiotemporal neural dynamics of vision in dorsal stream: ( a ) An axial. 187[r] ...
20
A Critique of Generalizability in Interpretive Research
... As a critique method, argumentative inquiry encourages questions such as, “What was the chapter’s argument? Were terms well defined (common ground)? Was the supporting evidence convincing? Was the counter evidence dealt ...
6