inter-rater agreement evaluation
Reliability of a seminar grading rubric in a grand rounds course
... The seminar evaluation rubric demonstrated inter-rater grade agreement and internal consistency. While this rubric was designed specifically for a pharmacy curriculum, it could be easily ...
11
Chest radiograph reading and recording system: evaluation in frontline clinicians in Zambia
... at inter-rater reliability using kappa statis- ...“moderate” agreement for HIV-infected ...the agreement between MOs was very similar for HIV-infected and HIV-uninfected patients, but their ...
8
Using an Analytic Dichotomous Evaluation Checklist to Increase Inter- and Intra-rater Reliability of EFL Writing Evaluation
... further agreement when scored essays analytically rather than ...lower inter-rater reliability of holistic scoring can be due to raters’ training ...
33
Inter-rater agreement and reliability of the COSMIN (COnsensus-based Standards for the selection of health status Measurement Instruments) Checklist
... the inter-rater agreement and reliability of the COSMIN checklist Firstly, based on the results of this study, and feedback we received from raters, we improved the wording and gram- mar of a few ...
11
Clinical Validation of Mobile Cardiotocograph Device for Intrapartum and Antepartum Monitoring Compared to Standard Cardiotocograph: An Inter-Rater Agreement Study
... group 2 participants were: age 18-45 years, singleton pregnancy, gestation age > 32 weeks, and not in active labour. After obtaining consent the participants in both groups were randomised into two arms: Arm 1 ...
7
Reliability and Validity of the Dutch Physical Activity Questionnaires for Children (PAQ-C) and Adolescents (PAQ-A)
... and evaluation by expert committee), content validity of both PAQs was assessed and calculated using item-level (I-CVI) and scale-level (S-CVI) content validity ...indexes. Inter-item and ...
7
Rater agreement of visual lameness assessment in horses during lungeing
... poor agreement for less experienced equine veterinarians and moderately acceptable agreement for experienced orthopaedic equine ...The inter-rater agreement was higher for the videos ...
5
A new two tier strength assessment approach to the diagnosis of weakness in intensive care: an observational study
... excellent inter-rater reliability for overall MRC-SS regardless of testing technique or scoring sys- tem ...the inter-rater agreement for the diagno- sis of ICU-AW was less accurate ...
10
Evaluation of Cosmetic Results of Surgical Wound Closure in Dogs
... of inter-rater agreement with 1 indicating perfect ...of agreement likely reflects the fairly uniform levels of inflammation between wounds at this ...the evaluation compared to that at ...
10
Inter-rater agreement in trait judgements from faces
... Cronbach’s captures the average social trait rating attributed to a certain face by the total population of perceivers. Thus, a high value means only that the ratings given are able to esti- mate those of the general ...
18
Classification of substandard factors in perinatal care: development and multidisciplinary inter rater agreement of the Groningen system
... multidisciplinary inter-rater agreement is moderate to ...the inter-rater agreement. Further testing of the inter- rater agreement outside our region will ...
9
Estimation of inter-rater reliability
... The results were not too unexpected as greater amount of deviation from the definitive mark is likely to occur where markers have to mark extended response questions by applying complex mark schemes. Massey & Raikes ...
40
Developing and testing a street audit tool using Google Street View to measure environmental supportiveness for physical activity
... of inter-rater reliability where variables require a judgement on quality or aesthetics ...lowest inter-rater agreement here was reported for the pavement quality ...detail, ...
7
Evaluation of Oxford instability shoulder score, Western Ontario shoulder instability Index and Euroqol in patients with slap (superior labral anterior posterior) lesions or recurrent anterior dislocations of the shoulder
... In agreement with previous studies [2,6,12,37-43], all the questionnaires reflected the constructs to be mea- sured. One of the aims of the present study was to evaluate the questionnaires for use in studies with ...
10
Psychometric comparison of three behavioural scales for the assessment of pain in critically ill patients unable to self report
... the inter-rater reliability because this psychometric property is paramount and, if deficient, precludes implementation of a pain tool and associated diagnostic and therapeutic pain strategies by the ICU ...
12
The Mini-BESTest - a clinically reproducible tool for balance evaluations in mild to moderate Parkinson’s disease?
... The analysis of the subcomponents of the Mini-BESTest showed that sensory orientation (consisting of only stationary exercises) had the highest agreement, both regarding inter-rater and test-retest ...
8
Reviewer agreement trends from four years of electronic submissions of conference abstract
... Inter-rater agreement was measured using the Intraclass Correlation Coefficient (ICC), which is commonly used to measure agreement between two or more ...of rater agreement used ...
6
Validity and reliability of using photography for measuring knee range of motion: a methodological study
... considerable. Rater error, therefore, is not the only source of variation and thus the level of acceptable var- iation when assessing validity will necessarily be greater than what would be acceptable for ...
10
Implementation of a nurse-led behaviour change intervention to support medication taking in type 2 diabetes: beyond hypothesised active ingredients (SAMS Consultation Study)
... Fidelity assessment of behaviour change interventions is important for several reasons. When a hypothesised mechanism of effect or logic model has been defined, fi- delity can be assessed in relation to hypothesised ...
13
Lane Formation Beyond Intuition Towards an Automated Characterization of Lanes in Counter-flows
... of inter-rater agreement between the results achieved by the automated tool and by an expert human coder through a series of Cohen's Kappa statistical analysis ...
8