Rating the ratings: Assessing the psychometric quality of rating data.
Cited by (567)
Items 201–300 of 567
- A Monitoring and Evaluation Sustainability Framework for Road Freight Transporters in South AfricaChumasande Lalendle, Leila Louise Goedhals-Gerber, Joubert van Eeden · 2021 · Sustainability
- Judging behaviour and rater errors: an application of the many-facet rasch model.Noor Lide Abu Kassim · 2011 · GEMA Online Journal of Language Studies
- A note on the response effects of laboratory- versus respondent-located computer-administered questioningEugene D. Jaffe, Hanoch Pasternak · 1997 · Industrial Marketing Management
- Bias in psychotherapist ratings of client transference and insight.Rayna D. Markin, Dennis M. Kivlighan · 2007 · Psychotherapy
- Assessment center construct-related validity: Stepping beyond the MTMM matrixMark C. Bowler, David J. Woehr · 2009 · Journal of Vocational Behavior
- A critical evaluation of the validity and the reliability of global competency constructs for supervisor assessment of junior medical traineesDarryl Andrew McGill, Cees P. M. van der Vleuten, Mike J Clarke · 2012 · Advances in Health Sciences Education
- The Reliability of Simulated Clients' Quality-of-Care RatingsFederico R. León, Gustavo Quiroz, Alfredo Brazzoduro · 1994 · Studies in Family Planning
- The Retention Effect of Withholding Performance InformationKorok Ray · 2007 · The Accounting Review
- Designs for evaluating the validity and accuracy of performance ratingsTerry L. Dickinson · 1987 · Organizational Behavior and Human Decision Processes
- The Role of Motor Excess and Instrumented Activity Measurement in Attention Deficit Hyperactivity DisorderWarren W. Tryon · 1993 · Behavior Modification
- STREAM (ChemBio): A Standard for Transparently Reporting Evaluations in AI Model ReportsTegan McCaslin, Jide Alaga, Samira Nedungadi, Seth Donoughe, Tom Reed, Rishi Bommasani, C. Painter, Luca Righetti · 2025 · arXiv.org
- On the history of rating scalesPaul McReynolds, Klaus Ludwig · 1987 · Personality and Individual Differences
- The limits of institutional isomorphism in the design of e-recruitment websites: a comparative analysis of the USA and SpainCristina Simón, José Esteves · 2015 · The International Journal of Human Resource Management
- Properties of the Achievement of Therapeutic Objectives Scale (ATOS): A Generalizability Theory studyLene Berggraf, Pål Ulvenes, Bruce E. Wampold, Asle Hoffart, Leigh McCullough · 2012 · Psychotherapy Research
- Halo effect: Conceptual definition and empirical exploration with regard to South Korean subsidiaries of US and Japanese multinational corporationsMi‐Young Oh, Jyotika Ramaprasad · 2003 · Journal of Communication Management
- Ratings of performance in multisource feedback: comparing performance theories of residents and nursesMuhammad Tariq, Marjan Govaerts, Azam Saeed Afzal, Syed Ahsan Ali, Tabassum Zehra · 2020 · BMC Medical Education
- Evaluating the Quality of Ratings Obtained from Standard-Seting JudgesGeorge Engelhard, Gregory Ethan Stone · 1998 · Educational and Psychological Measurement
- The stability of marker characteristics across tests of the same subject and across subjects.Iasonas Lamprianou · 2006 · PubMed
- Detecting Differential Rater Functioning in Severity and Centrality: The Dual DRF Facets ModelKuan‐Yu Jin, Thomas Eckes · 2021 · Educational and Psychological Measurement
- An Examination of Negative Halo Error in RatingsCharles E. Lance, Sebastiano A. Fisicaro, Julie A. LaPointe · 1990 · Educational and Psychological Measurement
- Content and Effect of Introduction Programmes to Increase Retention and Decrease Turnover of Newly Graduated Nurses in Hospitals: Umbrella ReviewConnie Bøttcher Berthelsen, Carrinna Aviaja Hansen · 2024 · Journal of Clinical Nursing
- Establishing reliable procedures for rating ell students’ reading comprehension using oral retellingsRichard R. Sudweeks, Connie B. Glissmeyer, Timothy G. Morrison, Bradley R. Wilcox, Mark W. Tanner · 2003 · Reading Research and Instruction
- Implementation contextual factors related to community-based active travel to school interventions: a mixed methods interview studyMacKenzie N. Koester, Carolina M. Bejarano, Ann McGrath Davis, Ross C. Brownson, Jon F. Kerner, James F. Sallis, Chelsea Steel, Jordan Carlson · 2021 · Implementation Science Communications
- Performance AppraisalAngelo S. DeNisi · 2013 · Oxford University Press eBooks
- A study of validity and usability evidence for non-technical skills assessment tools in simulated adult resuscitation scenariosHelen Higham, Paul Robert Greig, Nick Crabtree, George Hadjipavlou, Duncan Young, Charles A. Vincent · 2023 · BMC Medical Education
- Beautiful is Good and Good is Reputable: Multiple-Attribute Charity Website Evaluation andInitialPerceptions ofReputationUnder the Halo EffectDong-Heon Kwak, Keshavamurthy Ramamurthy, Derek L. Nazareth · 2019 · Journal of the Association for Information Systems
- An Experimental Comparison of Rater Performance on an SP-Based Clinical Skills ExamJae Jin Han, Clarence Dennis Kreiter, Hyesook Park, Kristi J. Ferguson · 2006 · Teaching and Learning in Medicine
- Exploring the Influence of Range Restrictions on Connectivity in Sparse Assessment Networks: An Illustration and Exploration Within the Context of Classroom ObservationsStefanie A. Wind, Eli A. Jones · 2018 · Journal of Educational Measurement
- School adjustment and health in Russian adolescentsGennady G. Knyazev, Helena R. Slobodskaya, Margarita V. Safronova, Irina A. Kinsht · 2002 · Psychology Health & Medicine
- Behavior Checklists and Rating FormsTimothy K. Daugherty, Steven K. Shapiro · 1994 · Issues in clinical child psychology
- The Economic Value of Ratings in App MarketHao Lin, Xiaofei Li, Yong Tan, Lei Xu · 2011 · SSRN Electronic Journal
- Administrators' Uses of Teacher Observation Protocol in Different Rating ContextsYi Qi, Courtney A. Bell, Nathan D. Jones, Jennifer M. Lewis, Margaret W. Witherspoon, Amanda Redash · 2018 · ETS Research Report Series
- We agreed to measure agreement - Redefining reliability de-justifies Krippendorff’s alphaXinshu Zhao, Guangchao Charles Feng, Jun S. Liu, Ke Deng · 2018 · HKBU Institutional Repository (Hong Kong Baptist University)
- Halo Error: A Field Study Comparison of Self -and Subordinate Evaluations of Leadership Process and Leader EffectivenessMichael R. Frone, Jerome Adams, Robert W. Rice, Debra Instone · 1986 · Personality and Social Psychology Bulletin
- Replication and Extension of Models of Supervisory Job Performance RatingsCharles E. Lance, Winston R. Bennett · 2000 · Human Performance
- A Field Study of Rating Conditions and Leniency in Performance AppraisalDavid A. Waldman, George C. Thornton · 1988 · Psychological Reports
- How Do Indonesia Firms Encounter Covid-19 Pandemic? An Evidence of Transformation of the Roots of Competitive Advantage from EMDE Country2023 · Quality - Access to Success
- An Analysis of Rater Severity and Leniency in Open-ended Mathematic Questions Rated Through Standard Rubrics and Rubrics Based on the SOLO TaxonomyBayram Çetin, Mustafa İlhan · 2017 · TED EĞİTİM VE BİLİM
- Validity And Reliability Rubric Of Performance Assessment Geometry Study In Junior High School Using The Many Facet Rasch Model ApproachRivo Panji Yudha · 2020 · Eduma Mathematics Education Learning and Teaching
- Self-organization in online collaborative work settingsIoanna Lykourentzou, Federica Lucia Vinella, Faez Ahmed, Costas Papastathis, Konstantinos Papangelis, Vassilis-Javed Khan, Judith Masthoff · 2022 · Collective Intelligence
- On the Relationship Between Job Performance and Ratings of Job Performance: What Do We Really Know?David J. Woehr · 2008 · Industrial and Organizational Psychology
- OperationalisierungNicola M. Döring, Jürgen Bortz · 2015 · Springer-Lehrbuch
- Effects of Dextroamphetamine on the Cognitive and Social Play of a Preschooler with ADHDSteven M. Alessandri, Kathleen Schramm · 1991 · Journal of the American Academy of Child & Adolescent Psychiatry
- Has the problem of judgment in utility analysis been solved?Michael K. Judiesch, Frank L. Schmidt, John E. Hunter · 1993 · Journal of Applied Psychology
- Individualized feedback to raters in language assessment: Impacts on rater effectsJing Huang, Gaowei Chen · 2022 · Assessing Writing
- Robot-Led Vision Language Model Wellbeing Assessment of ChildrenNida Itrat Abbasi, Fethiye Irmak Doğan, Guy Laban, Joanna Anderson, Tamsin Jane Ford, Peter Brian Jones, Hatice Güneş · 2025 · IEEE RO-MAN
- Test theories, educational priorities and reliability of public examinations in EnglandJo‐Anne Baird, Paul Black · 2013 · Research Papers in Education
- Evaluating Rater Accuracy in Rater-Mediated Assessments Using an Unfolding ModelJue Wang, George Engelhard, Edward W. Wolfe · 2015 · Educational and Psychological Measurement
- Evaluating the Construct Validity of an Automated Writing Evaluation System with a Randomization AlgorithmMatthew C. Myers, Joshua Wilson · 2022 · International Journal of Artificial Intelligence in Education
- Rating Errors and Rating Accuracy: A Field ExperimentRonen Kasten, Zisu Weintraub · 1999 · Human Performance
- Investigating Central Tendency in Competency Assessment of Design Electronic Circuit: Analysis Using Many Facet Rasch Measurement (MFRM)Universiti Tun Hussein Onn Malaysia, 86400 Parit Raja Batu Pahat Johor, Malaysia, Azmanirah Ab Rahman, Jamil Ahmad, Ruhizan Mohammad Yasin, Nurfirdawati Muhamad Hanafi · 2016 · International Journal of Information and Education Technology
- Prompt and rater effects in second language writing performance assessmentGad S. Lim · 2009 · Deep Blue (University of Michigan)
- Assessing Treatment Fidelity in a Cultural Adaptation of Motivational InterviewingChristina S. Lee, Tonya Tavares, Ami Popat-Jain, Pamela Naab · 2015 · Journal of Ethnicity in Substance Abuse
- Influence of prior acquaintance with the ratee on rater accuracy and haloJames Robert Van Scotter, Karen South Moustafa, Jennifer R. Burnett, Paul G. Michael · 2007 · Journal of Management Development
- Uncertainty-tolerant design: Evaluating task performance and drag-and-link information gathering for a news-writing taskSimon Attfield, ANN E. BLANDFORD, J.D. Dowell, Paul A. Cairns · 2008 · International Journal of Human-Computer Studies
- Beurteilerübereinstimmung und BeurteilerstrengeThomas Eckes · 2004 · Diagnostica
- Construct validation of assessment center final dimension ratings: Definition and measurement issuesRobert G. Jones · 1992 · Human Resource Management Review
- AN EVALUATION OF ALTERNATE SCORING METHODS FOR THE MIXED STANDARD SCALEGarry L. Hughes, Erich P. Prien · 1986 · Personnel Psychology
- Measuring treatment motivation and treatment engagement in forensic psychiatric outpatient treatment: development of two instrumentsKlaus Heinrich Drieschner · 2005 · Radboud Repository (Radboud University)
- Measuring and correcting staff variability in large-scale OSCEsSkerdi Haviari, Christian de Tymowski, Nelly Burnichon, Cédric Lemogne, Martin Flamant, Philippe B Ruszniewski, Saja Bensaadi, Grégory Mercier, Hasséne Hamaoui, Université Paris Cité OSCE study group et al. · 2024 · BMC Medical Education
- Automated low‐contrast pattern recognition algorithm for magnetic resonance image quality assessmentMorgan O. Ehman, Zhonghao Bao, Scott O. Stiving, Mallikarjunarao Kasam, Dianna Lanners, Teresa Peterson, Renee Jonsgaard, Rickey E. Carter, Kiaran P. McGee · 2017 · Medical Physics
- Evaluating the Bookmark Judgments of Standard-Setting PanelistsGeorge Engelhard · 2011 · Educational and Psychological Measurement
- Establishing clinician reliability using the therapy outcome measure for the purpose of benchmarking servicesAlexandra John, Anthony Hughes, Pam Enderby · 2002 · International Journal of Speech-Language Pathology
- Congeneric Modeling of Reliability Using Censored VariablesRoger Brown · 1989 · Applied Psychological Measurement
- EXPLORING THE EXISTENCE OF GRADER BIAS IN BEEF GRADINGJu Won Jang, Ariun Ishdorj, David P. Anderson, Tsengeg Purevjav, Garland R. Dahlke · 2017 · Journal of Agricultural and Applied Economics
- Crowdsourcing for quantifying transcripts: An exploratory studyTarek Azzam, Elena Harman · 2015 · Evaluation and Program Planning
- Comparison of Automatic and Expert Teachers’ Rating of Computerized English Listening-Speaking TestCao Linlin · 2019 · English Language Teaching
- Reconsidering the Equivalence of Multisource Performance Ratings: Evidence for the Importance and Meaning of Rater FactorsBethany H. Bynum, Brian James Hoffman, Adam W. Meade, William A. Gentry · 2012 · Journal of Business and Psychology
- Monitoring Reader Performance and DRIFT in the AP English Literature and Composition Examination Using Benchmark EssaysJonathan R. Manalo, Carol M. Myford, Edward W. Wolfe, George Engelhard · 2007
- Examining severity and centrality effects in TestDaF writing and speaking assessments: An extended Bayesian many-facet Rasch analysisEckes, Thomas, Jin, Kuan-Yu · 2021 · International Journal of Testing
- Bibliometric and Content Analysis of Sustainable Education in Biology for Promoting Sustainability at Primary and Secondary Schools and in Teacher EducationEila Kyllikki Jeronen, Juha Jeronen · 2026 · Education Sciences
- A LLTM approach to the examination of teachers' ratings of classroom assessment tasksKaren Draney, Mark R. Wilson · 2008 · Psychology science
- Exploring the Relationship Between Interrater Correlations and Validity of Peer RatingsRonen Kasten, Baruch Nevo · 2008 · Human Performance
- Maximum Likelihood Item Easiness Models for Test Theory Without an Answer KeyStephen L. France, William H. Batchelder · 2014 · Educational and Psychological Measurement
- Quantifying social skill deficits and strengths profiles in autistic youthJacquelyn A Gates, Alan S. Gerber, C. Miller, Matthew D. Lerner · 2022 · Child Development
- Theories, Models, and Standard Systems of MeasurementMarion S. Aftanas · 1988 · Applied Psychological Measurement
- AN EXAMINATION OF THE LINK BETWEEN RATER CALIBRATION PERFORMANCE AND SUBSEQUENT SCORING ACCURACY IN GRADUATE RECORD EXAMINATIONS® (GRE®) WRITINGKathryn L. Ricker‐Pedley · 2011 · ETS Research Report Series
- Examining Rater Effects in a WDCT Pragmatics TestJianda Liu, Lijun Xie · 2014
- Annotating affective dimensions in user-generated content: Comparing the reliability of best–worst scaling, pairwise comparison and rating scales for annotating valence, arousal and dominanceLuna De Bruyne, Orphée De Clercq, Véronique Hoste · 2021 · Language Resources and Evaluation
- Confounding among Measures of Leniency and HaloGeorge M. Alliger, Kevin J. Williams · 1989 · Educational and Psychological Measurement
- Supervisory Performance RatingsDavid J. Woehr, Sylvia G. Roch · 2012 · Oxford University Press eBooks
- EFFECTS OF STANDARD EXTREMITY ON MIXED STANDARD SCALE PERFORMANCE RATINGS1Janet L. Barnes-Farrell, Howard M. Weiss · 1984 · Personnel Psychology
- An analysis of the uncertainty factors affecting the sustainable supply of rice production in ThailandPhatcharee Toghaw Thongrattana · 2012 · Research Online (University of Wollongong)
- Design and implementation of an intelligent assessment technology for elementary school students’ scientific argumentation abilityLI-JIE TIAN, Yunan Ding, Xuewei Tian, Yuqing Chen, Jingying Wang · 2025 · Assessment in Education Principles Policy and Practice
- High Stakes Tests with Self-Selected Essay Questions: Addressing Issues of FairnessIasonas Lamprianou · 2008 · International Journal of Testing
- Unsupervised consensus analysis for on-line review and questionnaire dataStephen L. France, William H. Batchelder · 2014 · Information Sciences
- Examining reliability and validity of job analysis survey data.Ning Wang · 2003 · PubMed
- Permutation Statistical MethodsKenneth J. Berry, Janis E. Johnston, Paul W. Mielke · 2018 · Springer eBooks
- Investigation of Rater Effects Using Social Network Analysis and Exponential Random Graph ModelsIasonas Lamprianou · 2017 · Educational and Psychological Measurement
- Leniency Bias in Subjective Performance Evaluation: Contextual Uncertainty and Prior Employee PerformanceNa Gong, Wai Fong Boh, Anne Wu, Tsuilin Kuo · 2019 · Emerging Markets Finance and Trade
- Gathering evidence on e-rubrics: Perspectives and many facet Rasch analysis of rating behaviorInan Deniz Erguvan, Beyza Aksu Dünya · 2021 · International Journal of Assessment Tools in Education
- PsychometricsMark R. Wilson, Perman Gochyyev · 2013 · SensePublishers eBooks
- Detecting Rater Centrality Effects in Performance Assessments: A Model-Based Comparison of Centrality IndicesKuan‐Yu Jin, Thomas Eckes · 2022 · Measurement Interdisciplinary Research and Perspectives
- Examination of map reading skills with orienteering activity: An example of Many Facet Rasch ModelŞeyma Uyar, Onur Yayla, Hidayet ZÜNBER · 2022 · International Journal of Assessment Tools in Education
- Evaluation von Beurteilungen:Thomas Eckes · 2005 · Zeitschrift für Psychologie
- Estimating the Consistency of Third-Party Evaluator Scoring of Organizational Self-AssessmentsGarry D. Coleman, C. Patrick Koelling · 1998 · Quality Management Journal
- Interrater Reliability of the Devereux Behavior Rating Scale-School Form: the Influence of Teacher Frame of ReferenceAmanda B. Nickerson, Richard J. Nagle · 2001 · Journal of Psychoeducational Assessment
- Development and evaluation of validity scales for the Neuropsychology Behavior and Affect Profile: A dissembling study.Paul Satz, Steven G. Holston, Craig Lyons Uchiyama, Grace Shimahara, Maura Mitrushina, David L. Forney, Ken Zaucha, Roger K. Light, Robert F. Asarnow, Charles E. Drebing et al. · 1996 · Psychological Assessment
- Interpersonal Behavior, Range of Ratings, and Personal SecurityJohn R. Hurley · 1986 · Psychological Reports
- The Structure of Instruction Rating Scale (SIRS): Development and Technical Characteristics.Stanley L. Deno · 1983
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.