Rating the ratings: Assessing the psychometric quality of rating data.
Cited by (567)
Items 301–400 of 567
- Evaluating Rater Effects of Large Language Models in Automated Essay Scoring: GPT, Claude, Gemini, and DeepSeekHong Jiao, Dan Song, Won‐Chan Lee · 2026 · Educational Measurement Issues and Practice
- Can two psychotherapy process measures be dependably rated simultaneously? A generalizability study.Pål Ulvenes, Lene Berggraf, Asle Hoffart, Raymon A. Levy, J. Stuart Ablon, Leigh McCullough, Bruce E. Wampold · 2012 · Journal of Counseling Psychology
- Reflection of GDPR by the Czech PopulationRadek Tahal, Tomáš Formánek · 2020 · Management & Marketing
- Voice stress analysis: Use of telephone recordingsRobert F. Wain, Ronald G. Downey · 1987 · Journal of Business and Psychology
- Sequential Effects in Essay Ratings: Evidence of Assimilation Effects Using Cross-Classified ModelsHaiyan Zhao, Björn Andersson, Boliang Guo, Tao Xin · 2017 · Frontiers in Psychology
- Rating teacher performance to determine career ladder advancement: An analysis of bias and reliabilityDavid W. Peterson · 1988 · Iowa State University Digital Repository (Iowa State University)
- When raters generalize: Examining sources of halo effects with mixture Rasch facets modelsKuan‐Yu Jin, Thomas Eckes · 2025 · Behavior Research Methods
- Enhancing Cultural Heritage Archive Analysis via Automated Entity Extraction and Graph-Based Representation LearningA. Alper. Ozdemir, Berke Odaci, Lorans Tanatar Baruh, Onur Varol, Selim Saffet Balcisoy · 2025 · Journal on Computing and Cultural Heritage
- Peer effects in subjective performance evaluationGavin Cassar, Taeho Ko · 2023 · Contemporary Accounting Research
- Exploring rater judging behaviour using the many-facet rasch modelNoor Lide Abu Kassim, Noor Lide · 2007 · Universiti Utara Malaysia Institutional Repository (Universiti Utara Malaysia)
- The Economic Role of Rating Behavior in Third-Party Application MarketHao Lin, Xiaofei Li, Yong Tan, Lei Xu · 2011 · Journal of the Association for Information Systems
- Rational Dictators in the Dictator Game Are Seen as Cold and Agentic but Not IntelligentJanna Katrin Ruessmann, Christian Unkelbach · 2021 · Personality and Social Psychology Bulletin
- Automated Essay ScoringBeata Beigman Klebanov, Nitin Madnani · 2021 · Synthesis lectures on human language technologies
- Towards an Operational Definition of Clinical Competency in PharmacyL. Douglas Ried, Charles Allen Douglas · 2015 · American Journal of Pharmaceutical Education
- Investigating the Judges Performance in a National Competition of Sport DanceLaura Anderlucci, Alessandro Lubisco, Stefania Mignani · 2020 · Social Indicators Research
- Estimating Interrater Reliability of Examiner Scoring for a State Quality AwardGarry D. Coleman, Eileen M. Van Aken, Shen Jianming · 2002 · Quality Management Journal
- Nurse appraisal systems: Characteristics and effectivenessRobert L. Cardy, Cathy Korodi · 1991 · Social Science & Medicine
- The Utility of Utility AnalysisRobert J. Vance, Adrienne J. Colella · 1990 · Human Performance
- The Development and Validation of an Informal Rating Matrix to Measure Social Skills in Early AdolescentsAlan Bain · 1991 · Educational Psychology
- Evaluating the Validity of Educational Rating DataMichael R. Harwell · 1999 · Educational and Psychological Measurement
- Good News: Work Sample Administrators' Global Performance Judgments are (About) as Valid as We've SuspectedCharles E. Lance, C. Douglas Johnson, Shane S. Douthitt, Winston Bennett, Donald L. Harville · 2000 · Human Performance
- Using Automated Scoring to Monitor Reader Performance and Detect Reader Drift in Essay ScoringSusan M. Lottridge, E. Matthew Schulz, Howard C. Mitzel · 2015 · Routledge eBooks
- Short‐listing of applicants from UCCA forms: the structure of pre‐selection judgementsI. C. McManus, Sally Maitlis, Peter Richards · 1989 · Medical Education
- The latent distribution of a rating observedJeffrey C. Bodington · 2022 · Journal of Wine Research
- Combining Dual Scaling with Semi-Structured Interviews to Interpret Rating DifferencesRuth A. Childs, Anita Ram, Yunmei Xu · 2009 · Practical assessment, research & evaluation
- A framework to capture the dependency between prerequisite and advanced courses in higher educationRaghda Hriez, Ghazi Al‐Naymat · 2021 · Journal of Computing in Higher Education
- Performance Appraisal and DevelopmentJeffrey R. Spence, Patricia L. Baratta · 2014 · Wiley eBooks
- What Guides Subjective Performance Evaluation: Incentive Provision or Norm Enforcement?Robert M. Gillenkirch, Heike Kreienbaum · 2015 · Review of Managerial Science
- Stochastic error and biases remain in blind wine ratingsJeffrey C. Bodington · 2022 · Journal of Wine Economics
- Gleichgestelltenbeurteilung: Eine Erweiterung traditioneller Personalbeurteilungsansätze in UnternehmenTorsten J. Gerpott · 1992 · Gabler Verlag eBooks
- The effects of rater training, job analysis format and congruence of training on job evaluation ratingsDouglas F. Cellar, John R. Curtis, Kim Kohlepp, Patricia Poczapski, Sameena Mohiuddin · 1989 · Journal of Business and Psychology
- An individual differences approach to the halo-accuracy paradoxChris J. Jackson · 1996 · Personality and Individual Differences
- Rater Fatigue in Job Analysis SurveysEdmond W. Israelski, Jill S. Lenoble · 1982 · Proceedings of the Human Factors and Ergonomics Society Annual Meeting
- Systematic Rater Training Model: An Aid to Counselors in Collecting Observational DataF. Robert Wilson · 1982 · Measurement and Evaluation in Guidance
- INTERNAL HOMOGENEITY, DESCRIPTIVENESS, AND HALO: RESURRECTING SOME ANSWERS AND QUESTIONS ABOUT THE STRUCTURE OF JOB PERFORMANCE RATING CATEGORIESWILLIAM H. COOPER · 1983 · Personnel Psychology
- Color harmony : experimental and computational modelingChristel Chamaret · 2016 · theses.fr (ABES)
- Scoring Stability in a Large‐Scale Assessment Program: A Longitudinal Analysis of Leniency/Severity EffectsCorey Palermo, Michael B. Bunch, Kirk Ridge · 2019 · Journal of Educational Measurement
- Development of an Evaluation Capacity-Building Program for Nurse Teachers in Students’ PracticumNetrachanee Kamonratananun, Siridej Sujiva, Kamonwan Tangdhanakanond · 2016 · Procedia - Social and Behavioral Sciences
- Modeling random and non-random decision uncertainty in ratings data: a fuzzy beta modelAntonio Calcagnì, Luigi Lombardi · 2021 · AStA Advances in Statistical Analysis
- Relating Cultural Distance to Self-Other Agreement of Leader–Observer Dyads: The Role of Hierarchical PositionTim Vriend, Caroline Rook, Harry Garretsen, Janka Ireen Stoker, Manfred Kets De Vries · 2021 · Frontiers in Psychology
- Reassigning sources of misophonic trigger sounds to change their unpleasantness: Testing alternative mechanisms with a new set of movies, paintings, and wordsLaurie M. Heller, Urszula Oszczapinska, Jessica M. Smith, Megan M. Julien · 2025 · PLoS ONE
- CKH: Causal Knowledge Hierarchy for Estimating Structural Causal Models from Data and PriorsRiddhiman Adib, Md Mobasshir Arshed Naved, Chih-Hao Fang, Md Osman Gani, Ananth Y. Grama, Paul M. Griffin, Uzma Hasan, Sheikh Iqbal Ahamed, Mohammad Adibuzzaman · 2025 · IEEE Annual International Computer Software and Applications Conference (COMPSAC)
- VALIDATING THE GRE ANALYTICAL ABILITY MEASURE AGAINST FACULTY RATINGS OF ANALYTICAL REASONING SKILLSMary K. Enright, Donald E. Powers · 1990 · ETS Research Report Series
- Direct Behavior Rating Instrumentation: Evaluating the Impact of Scale FormatsFaith G. Miller, T. Chris Riley‐Tillman, Sandra M. Chafouleas, Alyssa A. Schardt · 2016 · Assessment for Effective Intervention
- Harmanlanmış Öğrenme Ortamlarında Bilgisayar Cebiri Sistemlerinin Akademik Başarıya EtkisiKemal ŞİMŞEK, Jale İpek · 2019 · Necatibey Eğitim Fakültesi Elektronik Fen ve Matematik Eğitimi Dergisi
- Does Social Content Influence the Subjective Evaluation of Affective Pictures?Vladimir Kosonogov, José M. Martínez‐Selva, Ginesa Torrente, Eduvigis Carrillo, Juan P. Sánchez‐Navarro · 2020 · The Spanish Journal of Psychology
- Developing Reliable Lab Rubrics Using Only Two ColumnsJoshua Enszer · 2020 · ASEE Annual Conference & Exposition
- A quantitative analysis of accuracy, reliability and bias in judgements of functional analysesAllie E. Rader, Michael E. Young, Justin B. Leaf · 2021 · Journal of the Experimental Analysis of Behavior
- Flexible Endoscopic Evaluation of Swallowing: A Proposed ChecklistRyan J. Burdick, Justine Dallal-York, Yael Shapira‐Galitz · 2024 · American Journal of Speech-Language Pathology
- Employee Selection and Performance Evaluation Biases and Organizational Efficiency: A Mathematical Modeling AttemptArie Reichel, Abraham Mehrez · 1994 · Journal of Management Inquiry
- Category‐Based and Feature‐Based Cognitive Processes: The Role of Unfavorable Information1Carol T. Kulik, Sue Campbell Clark · 1994 · Journal of Applied Social Psychology
- THE EMPLOYEES’ PERCEPTION OF THE PERFORMANCE APPRAISAL SYSTEM OF THE LOCAL GOVERNMENT OF ILOILO CITY, PHILIPPINESPhillip Bernard Capadosa · 2013 · Institutional Repositories DataBase (IRDB)
- A mixed methods investigation of leadership and performance in practice-based research networksBrandon James Patterson · 2013
- The dynamics of place ratings: platforms, effects, and their discontentsAndrea Ballatore · 2025 · GeoJournal
- Measuring the Accuracy of True Score Predictions for AI Scoring EvaluationDaniel F. McCaffrey, Jodi M. Casabianca, Matthew S. Johnson · 2025 · Journal of Educational Measurement
- How Subjective Performance Evaluations of Management Accountants Can be Biased by the News that They ReportSascha Matanovic, Maximilian Schmidt, Arnt Wöhrmann · 2022 · Behavioral Research in Accounting
- Effects of raters’ professional backgrounds on assessing interpreting quality: An exploratory mixed-methods investigation into rater behaviorYang Li, Xini Liao, Jia Jia · 2025 · System
- Three Research Essays on the Effects of Charity Website Design on Online DonationsDong-Heon Kwak · 2014 · UWM Digital Commons (University of Wisconsin–Milwaukee)
- Does the Time Between Scoring Sessions Impact Scoring Accuracy? An Evaluation of Constructed‐Response Essay Responses on theGRE® General TestBridgid Finn, Cathy L. W. Wendler, Kathryn L. Ricker‐Pedley, Burcu Arslan · 2018 · ETS Research Report Series
- A Latent Class Signal Detection Model for Rater Scoring with Ordered Perceptual DistributionsLawrence T. DeCarlo, Xiaoliang Zhou · 2020 · Journal of Educational Measurement
- Can local staff reliably assess their own programs? A confirmatory test-retest study of Lot Quality Assurance Sampling data collectors in UgandaColin Beckworth, Robert Anguyo, Francis Kyakulaga, Stephen K. Lwanga, Joseph James Valadez · 2016 · BMC Health Services Research
- Profiling children's emotion regulation behavioursAngela Callear, Shane T. Harvey, DAVID L. BIMLER, Nicholas Catto · 2018 · British Journal of Developmental Psychology
- Visualizations in High School Chemistry Textbooks Used in TurkeySevil Akaygün · 2018 · ACS symposium series
- Classification Consistency and Accuracy With Atypical Score DistributionsStella Yun Kim, Won‐Chan Lee · 2019 · Journal of Educational Measurement
- Relationship Between Student-Perceived Reading Strategy Instruction and Students’ Reading Comprehension: A Serial Multiple Mediation ModelQuan Qian, Guomin Zheng, Xianhan Huang, Xian Liao · 2023 · Reading & Writing Quarterly
- Raters and ExaminationsSteven Barrett · 2005 · Springer eBooks
- The Relevance of Leadership Variables for Performance AppraisalAmira Galin · 1989 · Personnel Review
- MEASURING CHARACTER STRENGTHS: A METHODOLOGICAL STUDY OF MILITARY CADETS DURING A FIELD EXERCISEOle Christian Boe, Bengt Andre Heiskel, Øyvind Moholdt Grande, Fredrik Nilsen, Henning Bang · 2016 · ICERI proceedings
- Journalistic Learning: Rethinking and Redefining Language Arts CurriculaEd Madison · 2012 · Scholars' Bank (University of Oregon)
- Detecting Rater Centrality Effect Using Simulation Methods and Rasch Measurement AnalysisXiaohui Yue · 2011 · VTechWorks (Virginia Tech)
- OperationalisierungNicola M. Döring · 2023 · Springer eBooks
- On the applicability of time series anomaly detection methods to real-world traffic volume dataIman Taheri Sarteshnizi, Majid Sarvi, Saeed Asadi Bagloee, Neema Nassir · 2026 · Transportation Research Part C Emerging Technologies
- Towards an operational definition of pharmacy clinical competencyCharles Allen Douglas · 2011 · PhDT
- Objectivity of International Aerobics Referee decisionHyungdon Kim, 우동일, EungJoon Kim · 2011 · The Korean Journal of Measurement and Evaluation in Physical Education and Sports Science
- The Science and Best Practices of Behavioral Safety: The Source for Reducing Injuries on the Front LineTimothy D. Ludwig, Matthew M. Laske · 2023 · Routledge eBooks
- The Second Database of Emotional Videos from Ottawa (DEVO-2): Over 1300 brief video clips rated on valence, arousal, impact, and familiarityPatrick S. R. Davidson, Alex W. Castro, Steven Carton, Vanessa Conceicao Cunha, Charles A. Collin · 2025 · Behavior Research Methods
- Geographically Weighted Cronbach's Alpha (GWalpha): An Exploratory Local Measure of Reliability for Scale ConstructionSui Zhang, Ziqi Li · 2025 · Geographical Analysis
- Standard-Setting bei C-Tests: Bestimmung von Kompetenzniveaus mit der PrototypgruppenmethodeThomas Eckes · 2010 · Diagnostica
- A Pilot Test of the CM-GAF among Offenders with Mental DisordersDeborah Shelton, Sara T. Wakai · 2014 · Issues in Mental Health Nursing
- HR Practices in Selected RMG Factories in DhakaSilvia Akter, Raju Mohammad Kamrul Alam · 2016 · Journal of Business
- Raters Knowledge of Students Proficiency Levels as a Source of Measurement Error in Oral AssessmentsFatma TANRIVERDİ-KÖKSAL · 2017 · Hacettepe University Journal of Education
- RecSys'17 Joint Workshop on Interfaces and Human Decision Making for Recommender SystemsPeter L. Brusilovsky, Marco de Gemmis, Alexander Felfernig, Pasquale Lops, John O’Donovan, Nava Tintarev, Martijn C. Willemsen · 2017 · ACM Conference on Recommender Systems (RecSys)
- Exploring difficult-to-score essays with a hyperbolic cosine accuracy model and Coh-Metrix indicesJue Wang, George Engelhard, Trenton Combs · 2021 · The Journal of Experimental Education
- Exploring Rater Accuracy Using Unfolding Models Combined with Topic Models: Incorporating Supervised Latent Dirichlet AllocationJordan M. Wheeler, George Engelhard, Jue Wang · 2022 · Measurement Interdisciplinary Research and Perspectives
- CONSIDERATIONS FOR DEVELOPING MEASURES OF SPEAKING AND LISTENINGDonald E. Powers · 1984 · ETS Research Report Series
- Rater Severity in Large-Scale Assessment: Is It Invariant?.Joy McQueen, P J Congdon · 1997
- THE EFFECT OF POSITIVE CORE SELF AND EXTERNAL EVALUATIONS ON PERFORMANCE APPRAISALSLale Güven · 2007
- How smart does your profile image look? Estimating intelligence from social network profile imagesXingjie Wei, David J. Stillwell · 2016 · White Rose Research Online (University of Leeds, The University of Sheffield, University of York)
- Format and scale effects on leniency error and halo effect in 360° feedbackMyoungSo Kim, 이광진 · 2008 · Korean Journal of Industrial and Organizational Psychology
- Metrics for estimating validity, reliability and bias in peer assessmentRafael Molina-Carmona, Rosana Satorre Cuerda, Patricia Compañ, Faraón Llorens Largo · 2018 · Repositorio Institucional de la Universidad de Alicante (Universidad de Alicante)
- Analyzing the Judges’ rating in Modern Dance Competitors of Dong-A Concours through Many-Faceted Rasch Model최윤선 · 2011 · The Korean Journal of Measurement and Evaluation in Physical Education and Sports Science
- An Empirical Study for the Statistical Adjustment of Rater BiasMustafa İlhan · 2019 · International Journal of Assessment Tools in Education
- Evaluating Differential Rater Functioning in Performance Ratings: Using a Goal-Based ApproachKevin B. Tamanini · 2008 · OhioLink ETD Center (Ohio Library and Information Network)
- A teacher-judgment measure of social competence: Validity data.Nishat A. Khan, Robert D. Hoge · 1983 · Journal of Consulting and Clinical Psychology
- Reliability and Accuracy of Surgical Resident Peer RatingsLarry Lutsky, Donald A. Risucci, Anthony J. Tortólani · 1993 · Evaluation Review
- An Empirical Analysis of Rating Effectiveness for a State Quality AwardRonald Theodore Sienknecht · 1999 · VTechWorks (Virginia Tech)
- Evaluating the Evaluation of Child Care AccreditationSally Murray · 1996 · Australasian Journal of Early Childhood
- Psychometric Properties of the Indonesian Version of Religious Orientation Scale in Muslim Adolescents SampleMuthia Rahmah, Dewi Maulina, Rena Latifa, Indy Hurun Ein · 2025 · Tazkiya Journal of Psychology
- Efectos del corrector en las evaluaciones educativas de alto impacto./ Rater effects in high-impact educational assessments.Pamela Woitschach, Carlota Díaz-Pérez, Daniel Fernández Argüelles, Jaime Fernández-Castañón, Alba Fernández-Castillo, Lara Fernández Rodríguez, María Cristina González Canal, Iris López Marqués, David Martín Espinosa, Rubén Navarro Cabrero et al. · 2018 · R E M A Revista electrónica de metodología aplicada
- Analysis of Multiple Error Source in results by Judges of Artitstic Gymnastics Women’s Uneven Bars Events조은형, 한연숙, Eom Han Joo · 2017 · The Korean Journal of Measurement and Evaluation in Physical Education and Sports Science
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.