Generalizability Theory
Squibs and Discussions: Identifying Sources of Disagreement: Generalizability Theory in Manual Annotation Studies
... Manual annotations are still a major source of information in many small- and large- scale projects in diverse areas of corpus and computational linguistics. Often, however, manual annotations are not reliable enough for ...
6
Reliability analysis of the Chinese version of the Functional Assessment of Cancer Therapy – Leukemia (FACT-Leu) scale based on multivariate generalizability theory
... In generalizability theory, a latent trait is defined by sets of conditions under which it may be observed; each set of conditions is called a facet. Usually, the latent trait is the object of measurement ...
12
Development and validation of the coronary heart disease scale under the system of quality of life instruments for chronic diseases QLICD-CHD: combinations of classical test theory and Generalizability theory
... test theory analysis above, we also ap- plied Generalizability Theory (G theory) to investigate the score dependability of the ...G theory has been presented as a way to refine the ...
11
Reliability of a viva assessment of clinical reasoning in an Australian pre-professional osteopathy program assessed using generalizability theory
... Clinical reasoning is situation-dependent and case-specific; therefore, assessments incorporating different patient presentations are war- ranted. The present study aimed to determine the reliability of a multi-station ...
6
Marker effects and examination reliability: a comparative exploration from the perspectives of generalizability theory, Rasch modelling and multilevel modelling
... were Generalizability Theory (G-theory), Item Response Theory (IRT) – in particular the Many-Facets Partial Credit Rasch Model (MFRM), and Multilevel Modelling ...
87
USING GENERALIZABILITY THEORY TO MEASURE SOURCES OF VARIANCE ON A SPECIAL EDUCATION TEACHER OBSERVATION TOOL
... multivariate generalizability theory to more precisely measure the influence of occasions on scores (Meyer, Cash, & Mashburn, 2011), suggesting that more complex uses of G theory might be ...
168
Using Generalizability Theory to Evaluate the Applicability of a Serial Bayes Model in Estimating the Positive Predictive Value of Multiple Psychological or Medical Tests
... Although the testing problem presented within this hy- pothetical example focused on the interpretation of a hypothetical diagnostic biomedical test, G theory meth- odology coupled with Bayes serial estimations ...
5
Score Generalizability of Writing Assessment: the Effect of Rater’s Gender
... Test Theory cannot examine multiple sources of measurement ...error. Generalizability theory extends Classical Test Theory to provide a practical framework to identify and estimate multiple ...
24
Clinical assessment of transthoracic echocardiography skills: a generalizability study
... test theory (CTT) measures of reliability are usually not sufficiently suitable in such circumstances, because they only allow for accounting for one source of error at a time, ...use generalizability ...
7
Multiple tutorial-based assessments: a generalizability study
... relative importance with regard to score variability. Moreover, the missing data created by trying to estimate the variance due to tutors (groups differed by tutor and tutor differed by unit, thus there was no ...
6
A generalizability study of the medical judgment vignettes interview to assess students' noncognitive attributes for medical school
... earlier, generalizability theory provides a method to determine the dependability of an assessment approach by isolating the main and interaction effects that can lead to sources of measurement ...a ...
7
Accuracy and generalizability of using automated methods for identifying adverse events from electronic health record data: a validation study protocol
... Patient demographic characteristics, comorbidities and severity of illness can influence the likelihood of AE oc- currence, the accuracy of AE detection models and the generalizability of these models across ...
9
Analysis of the Invariance and Generalizability of Multiple Linear Regression Model Results Obtained from Maslach Burnout Scale through Jackknife Method
... Generalizability of the results of a scientific study is very important as one of the scientific features [7]. This is because the results of especially experimental studies will shed light on similar future ...
7
How Should Stressors Be Examined in Teachers? Answering Questions about Dimensionality, Generalizability and Predictive Effects Using the Multicontext Stressors Scale
... cross-gender generalizability, or the examination of its effects following theoretical frameworks, still remain ...self-determination theory (SDT) [11–13], this study also aims to know the extent to which ...
17
Design and evaluation of video portfolios : reliability, generalizability, and validity of an authentic performance assessment for teachers
... the generalizability of judgments were investigated based on several quantitative analyses concerning scores assigned to video episodes and overall ...the generalizability of scores across ...the ...
177
Validity of a self-administered food frequency questionnaire (FFQ) and its generalizability to the estimation of dietary folate intake in Japan
... In addition, our analysis is unique because we used regres- sion analysis to identify the foods most predictive for inter-individual variation in dietary folate, and then eval- uated both the internal and external ...
10
Reliability and Generalizability of Similarity-Based Fusion of MEG and fMRI Data in Human Ventral and Dorsal Visual Streams
... Experiment 1 Twins-set spatiotemporal neural dynamics of vision in dorsal stream: ( a ) An axial. 187[r] ...
20
Testing the generalizability of national reimbursement rates with respect to local setting: the costs of abdominal aortic aneurysm surgery in Denmark
... Yet, such tariffs do not necessarily reflect costs in different local settings, even when the clinical condition or procedure category appears similar. Furthermore, national DRG-type systems are not identical and are not ...
5
A Scale of Parental Anxiety about Pediatric Emergency Medical Care Services of Japan: Development, Reliability, Validity, Generalizability and Usefulness
... The generalizability of the PAPEMCS was evaluated by congruence tests and multigroup ...All generalizability estimates fulfilled the predeter- mined levels of acceptability (Tucker’s congruence ...
33
Comparative Analysis of Theory X, Theory Y, Theory Z, and Theory A for Managing People and Performance
... possible. Theory Z of ...1980s. Theory Z focused on increasing employee loyalty to the company by providing a job for life with a strong focus on the well-being of the employee, both on and off the job ...
11