Rating the ratings: Assessing the psychometric quality of rating data.

Saal, Frank E., Downey, Ronald G., Lahey, Mary A.·1980·Psychological Bulletin

Cited by (567)

Items 401–500 of 567

  1. Beyond 2000
    Kenneth J. Berry, Janis E. Johnston, Paul W. Mielke · 2014 · Springer eBooks
  2. Longitudinal Impacts of Religious Profiles on Substance Abuse Among Emerging Adults: A Fusion of Unsupervised and Supervised Learning Approach
    Siying Guo, Jianxuan Liu, Chen Meng, Hyejoon Park · 2023 · Deviant Behavior
  3. Açık Uçlu Maddelerin Puanlanmasında Dereceli Puanlama Anahtarı Türünün Puanlayıcı Davranışlarına Etkisi
    Umur Öç, Esra Onkun Özgür, İsmail Karakaya · 2024 · Türk Eğitim Bilimleri Dergisi
  4. Evaluating Job Performance Measures: Criteria for Criteria
    Angelo S. DeNisi, Kevin R. Murphy · 2020 · Emerald Group Publishing Limited eBooks
  5. Using generative AI for formative feedback on student writing drafts
    Randall S. Davies · 2026 · Educational Technology Research and Development
  6. Improving Performance Assessment Score Validation Practices: An Instructional Module on Generalizability Theory
    Оксана Науменко · 2015
  7. Giving Multisource Feedback a Facelift
    Darren Jason Good, Duncan Coombe · 2009 · Journal of Change Management
  8. Ensuring Validity Using Coworker Samples: A Situationally Driven Approach
    Michael O. Calloway, Michael J. Belyea · 1988 · Evaluation Review
  9. Comparing Current and Former Student Evaluations of Course and Instructor Quality
    Ryan Scott Kozey, Thomas Hugh Feeley · 2009 · Communication Research Reports
  10. Multifacetten-Rasch-Analyse von Personenbeurteilungen
    Thomas Eckes · 2006 · Zeitschrift für Sozialpsychologie
  11. Impact of Verbal Scale Labels on the Elevation and Spread of Performance Ratings
    Hans Kuhlemeier, Bas T. Hemker, Huub van den Bergh · 2013 · Applied Measurement in Education
  12. Quality assurance of information in performance measurement systems
    Mattias Elg, Anders Fundin · 2012 · International Journal of Productivity and Quality Management
  13. Location image “halo effect” on museum image: an exploratory survey of British Museum visitors
    Alfonso Siano, Mario Siglioccolo, DELLA VOLPE, MADDALENA, Felice Addeo · 2018 · Sinergie Italian Journal of Management
  14. Måling av sensorreliabilitet ved vurdering av norskprøve i skriftlig framstilling
    Tor Midtbø, Arne Rossow, Brikt Sagbakken · 2018 · Acta Didactica Norge
  15. MEASURING SPECIFIC TRADITIONAL CHINESE VALUES IN RELATION TO SATISFACTION OF THE FIVE MASLOW NEEDS
    Robert J. Taormina, Jennifer Hong Gao, Angus C.H. Kuok · 2022 · Psychological Thought
  16. Scale Construction and Halo Effect in Secondary Student Ratings of Teacher Performance
    Eric Paul Rogers · 2005 · ScholarsArchive (Brigham Young University)
  17. An Evaluation of Aviator Training Ability Requirements Scale Ratings
    D. M. McAnulty, Dennis H. Jones · 1984 · Proceedings of the Human Factors and Ergonomics Society Annual Meeting
  18. Reliability and Validity of a Rating Scale for Assessing Career Choice Appropriateness in Adolescence
    Bert W. Westbrook, Eleanor E. Sanford, Sandy Waters · 1999 · Journal of Career Assessment
  19. The Application of Generalizability Theory to the Reliability of Ratings
    G.K. Huysamen · 1990 · South African Journal of Psychology
  20. A Modification of Raju, Burke and Normand's (1990) New Model for Utility Analysis
    Kenneth S. Law, Brett Myors · 1999 · Asia Pacific Journal of Human Resources
  21. A Many-facet RASCH Measurement Analysis to Explore Rater Effects and Rater Training in Medical School Admissions
    Amanda Brijmohan · 2016 · TSpace (University of Toronto)
  22. Rater effects modeling
    Jodi M. Casabianca · 2022 · Elsevier eBooks
  23. The MacTRAUMA TTL Assessment Tool: Developing a Novel Tool for Assessing Performance of Trauma Trainees: Initial Reliability Testing
    Aussama Khalaf Nassar, Angela J. Coates, Faiz Tuma, Forough Farrokhyar, Susan Reid · 2016 · Journal of surgical education
  24. Feedback intervention perceptions: Development and validation of a measure
    Brandon L. Young, Barbara Ann Fritzsche · 2020 · EWOP in Practice
  25. The roles of self-construal in sharpening reputation judgment: an experimental study on earnings management
    Ida Nur Aeni, Supriyadi Supriyadi, Heri Yanto · 2021 · Asian Journal of Business Ethics
  26. Global Transformation of the Roots of Competitive Advantage on the ASEAN Firms
    ‪M. Elfan Kaukab, Ali Akbar Anggara · 2024 · International Journal of Innovative Research in Engineering & Management
  27. Reliability in Industry-Academia Assessment: A Framework for Validating Competencies in IT Education
    Prasara Jakkaew, Pruet Putjorn, Nacha Chondamrongkul · 2026 · Joint International Conference on Digital Arts, Media and Technology with ECTI Northern Section Conference on Electrical, Electronics, Computer and Telecommunications Engineering (ECTI DAMT & NCON)
  28. From Hype to Hand-Off: A Comparative, AI-Assisted Evaluation of Climate Tech Startups Across Scaling Pathways
    Silvio Andrae · 2026 · IGI Global eBooks
  29. Performance Appraisal System and Its Practices in Local Private Business Organizations of Bangladesh
    Taskina Ali, Nargis Akter · 2011 · Information Management and Business Review
  30. What is the Shape of the Distribution of Job Performance (and What Difference Does it Make)?
    Paul M. Muchinsky · 1994 · International Journal of Selection and Assessment
  31. Dealing with Sparse Rater Scoring of Constructed Responses within a Framework of a Latent Class Signal Detection Model
    Sun‐Hee Kim · 2013
  32. Top Leadership and Performance of Quasi Government Organizations in Korea
    Sanghee Park, Yoon Jik Cho · 2011
  33. VIERAAN AKSENTIN ARVIOINTI JA MITTAAMINEN SUOMESSA
    Käyttäytymistieteiden Laitos, Helsingin Yliopisto · 2011
  34. The Development of a Standardized Rater Training Program on Essay Scoring: A Case Study
    So Young Jang · 2011 · English Teaching
  35. Peer To Peer: A New Tool for Student Peer Evaluation
    Christopher M. Scherpereel · 2014 · Developments in Business Simulation and Experiential Learning: Proceedings of the Annual ABSEL conference
  36. Nominal-Level Variables, II
    Kenneth J. Berry, Janis E. Johnston, Paul W. Mielke · 2018 · Springer eBooks
  37. Utilizing instructor practice experience to promote critical thinking for program proposals in an undergraduate public health course
    Deirdre A. Dingman · 2021 · Journal of American College Health
  38. HALO EFFECTS IN CONSUMER SURVEYS
    L.V. Lüttin · 2012
  39. EMC-PK2: An Experimental Observation Tool for Capturing the Instructional Coherence and Quality in Early Math Classrooms
    Luke Rainey, Dale Clark Farran, Kelley L. Durkin · 2024 · Education Sciences
  40. Dereceli Puanlama Anahtarı Türünün Rutin Olmayan Matematik Problemlerinin Puanlanmasında Puanlayıcı Davranışları Üzerine Etkisi
    Esra Onkun Özgür, İsmail Karakaya · 2024 · Uludağ Üniversitesi Eğitim Fakültesi Dergisi
  41. Randomized Designs: Nominal Data
    Kenneth J. Berry, Paul W. Mielke, Janis E. Johnston · 2016 · Springer eBooks
  42. Data analysis of Taekwondo games decision by Intraclass correlation coefficient : Electronic Protector vs Judgement score
    조은형, 정미미, 곽택용, Seoungki Kang, Jung Heon Kim · 2009 · 대한무도학회지
  43. Personality and mental health as predictors of rater bias in observational data
    Mark Richard Becker · 2005 · Iowa State University Digital Repository (Iowa State University)
  44. Personality and Rater Leniency: Comparison of Broad and Narrow Measures of Conscientiousness and Agreeableness
    Myranda Grahek · 2007 · University of North Texas Digital Library (University of North Texas)
  45. Early Identification and Intervention of Psychosocial and Behavioral Effects of Exceptionality
    Tracy K. Wheatcraft, Bruce A. Bracken · 1999 · Plenum series on human exceptionality
  46. An investigation of the validity of the Iowa Early Learning Inventory
    Sigurgrímur Skúlason · 2004
  47. A Developmental Analysis of Performance Ratings
    Karl W. Kuhnert, Frank E. Saal, Ronald G. Downey · 1988 · The Journal of Psychology
  48. Rating Dispersions: Comparing Raters' Spans and Variances
    John R. Hurley, Janet P. Hurley · 1988 · Perceptual and Motor Skills
  49. Success in Higher Education and the Labor Market
    John Witte, Joost de Jonge, Wouter Schoonman · 2014 · SSRN Electronic Journal
  50. The impact of cognitive load on the acquisition of handwriting proficiency
    Cornelia Staats · 2014 · UWA Profiles and Research Repository (UWA)
  51. The Strength of Attractiveness and the Power of Visual Nonverbal Communication When Rating One's Communicative Competence
    Jennifer N. Gill · 2006
  52. How smart does your profile image look? Intelligence estimation from social network profile images.
    Xingjie Wei, David J. Stillwell · 2016 · arXiv (Cornell University)
  53. Measurement of Judgments
    J M Linacre · 1999 · Elsevier eBooks
  54. Co-worker Assessment and Physician Multisource Feedback
    Greggory Trueman · 2013
  55. Efficacy Of A Structured Free Recall Intervention To Improve Rating Quality In Performance Evaluations
    Maximum Mgrdich-Ararat Sirabian · 2017 · Human Biology
  56. Response Styles in Student Evaluation of Teaching
    Valencia Acuna, Edgar Andrés · 2017 · TSpace (University of Toronto)
  57. Problem Behaviors Associated With Sociometric Status in an Adolescent Population.
    Thorne, Glenda C · 1991 · Louisiana State University
  58. Evaluating rater effects in the context of ethical reasoning essay assessment: An application of the many-facets rasch measurement model
    Madison A. Holzman · 2018 · JMU Scholoraly Commons (James Madison University)
  59. How to Mitigate Bias in Performance Evaluations: An Analysis of the Consequences of Supervisors’ Evaluation Behavior
    Isabella Grabner, Judith Künneke, Frank Moers · 2015 · SSRN Electronic Journal
  60. Is the halo effect universal? An investigation of the generalizability and applications of the halo effect
    Giulio Gabrieli · 2021 · DR-NTU (Nanyang Technological University)
  61. ASSESSING ARTS EDUCATORS: HOW THE PERFORMANCES OF PUBLIC AND PRIVATE HIGH SCHOOL ART TEACHERS ARE ASSESSED IN VIRGINIA
    Jill Elaine Palumbo · 2013 · VCU Scholars Compass (Virginia Commonwealth University)
  62. 人事評定者訓練における評定誤差結果のフィードバック効果 : 人事評価における評定誤差分析モデル(第2報)
    貞人 石橋, 広計 椿 · 2006 · 日本経営工学会論文誌
  63. 評定の精度と分布に関する評定誤差の関係 : 人事評価における評定誤差分析モデル(第3報)(理論・技術)
    貞人 石橋 · 2012 · 日本経営工学会論文誌
  64. Social Change and Teacher’s Pay
    Steven Barrett · 2013 · SensePublishers eBooks
  65. Personality and Rating Error
    Eul-Teo Lee · 2005 · eCommons (Cornell University)
  66. Practical Impact of Predictor Reliability for Personnel Selection Decisions
    Jisoo Ock, Frederick Louis Oswald · 2011 · PsycEXTRA Dataset
  67. An Examination of the Effects of Situational Constraints on Appraised Performance
    Kimberly A. Freeman · 2008 · Performance Improvement Quarterly
  68. Adapting Smart Methodology for use with Subjective Rating Data
    William H. Acton, John F. Courtright · 1990 · Proceedings of the Human Factors and Ergonomics Society Annual Meeting
  69. Psychological norms for simple three-line graphic shapes
    William A. Kealy, Albert Dieter Ritzhaupt, Cameron Spears · 2007 · Behavior Research Methods
  70. An Examination of Ability Requirements for Various Rotary Wing Missions
    Dennis H. Jones, D. M. McAnulty · 1984 · Proceedings of the Human Factors and Ergonomics Society Annual Meeting
  71. A-08 参加者の『語り』からみたキャンプの特徴 : スタッフ・保護者の視点から
    龍太 後藤, 英里 中坪, 香奈 長谷川, 智絵 盛合, 隆子 山元, 直己 平野 · 2007
  72. Familiar/interactive raters are not always best: The influence of sampling schedules and class of behavior
    Gail Brothers Braun, Gordon L. Paul, Marco J. Mariotto · 1993 · Journal of Psychopathology and Behavioral Assessment
  73. Military police selection in Canada : an evaluation of the Canadian Forces Military Police Assessment Centre (MPAC)
    Kathryn E. Hodgson · 2006 · Saint Mary's University Institutional Repository (Saint Mary's University)
  74. Utility of Drawings as a Screen for Emotional and Behavioral Concerns in Adolescents: An Exploration of Formal Elements in Drawings and the BASC-2.
    Selby M. Conrad · 2010 · KU ScholarWorks (The University of Kansas)
  75. Effects of purpose of appraisal on leniency errors: An exploration of self-efficacy as a mediating variable
    Adam Nathaniel Prowker · 1999 · VTechWorks (Virginia Tech)
  76. Effect Size; Evaluators; *Item Response Theory; *Rating Scales
    W Edward · 1999
  77. ***Reprinted with permission. No further reproduction is authorized without written permission from Taylor and Francis. This version of the document is not the version of record. Figures and/or pictures may be missing from this format of the document.***
    Weimo Zhu, Catherine D. Ennis, Ang Chen · 1998
  78. On Digital Drumming: Collaborative, Dyadic, Co-Located, Coordinated Interaction
    Robert J. Beaton · 2012 · VTechWorks (Virginia Tech)
  79. Educational level bias and employees' approach under different practices of evaluation
    F. Zampara · 2015
  80. ORIENTAÇÃO PARA O MERCADO, CAPACIDADE DE INOVAÇÃO E DESEMPENHO: UMA ABORDAGEM PARA A AVALIAÇÃO DE ORGANIZAÇÕES PÚBLICAS EDUCACIONAIS DOI - 10.5752/P.1984-6606.2015v15n40p142
    Clóvis Teixeira Filho, Ana Maria Machado Toaldo, Simone Regina Didonet, Renata Mendes Tizzo · 2015 · Revista Economia & Gestão
  81. The economics of family and group decisions
    Jungmin Lee · 2004 · Texas ScholarWorks (Texas Digital Library)
  82. Környezeti alkalmazkodási magatartásminták a magyarországi lakossági gyógyszerellátásban. A Miles és Snow-féle stratégiai tipológia tesztelése szabályozott iparági környezetben
    Ádám Csepeti · 2015 · CUB Ph.D. Dissertations (Corvinus University of Budapest)
  83. The Software Adoption Process Seen Through System Logs
    Áslaug Eiríksdóttir · 2014
  84. An Examination of the Link Between Rater Calibration Performance and Subsequent Scoring Accuracy in Graduate Record Examinations ® (GRE ® ) Writing
    Ets Rr · 2011
  85. DESCRIPTORS *Item Response Theory; Mathematical Models; Norms; *Performance Based Assessment; *Rating Scales; Scaling;
    M. Linacre · 1997
  86. von Leistungsbeurteilungen im "Test Deutsch als Fremdsprache" (TestDaF)
    Thomas Eckes · 2004
  87. Randomized Block Designs: Interval Data
    Kenneth J. Berry, Paul W. Mielke, Janis E. Johnston · 2016 · Springer eBooks
  88. Completely Randomized Data
    Kenneth J. Berry, Paul W. Mielke, Janis E. Johnston · 2016 · Springer eBooks
  89. Randomized Block Designs: Ordinal Data
    Kenneth J. Berry, Paul W. Mielke, Janis E. Johnston · 2016 · Springer eBooks
  90. Regression Analysis of Interval Data
    Kenneth J. Berry, Paul W. Mielke, Janis E. Johnston · 2016 · Springer eBooks
  91. Randomized Designs: Interval Data
    Kenneth J. Berry, Paul W. Mielke, Janis E. Johnston · 2016 · Springer eBooks
  92. Randomized Block Data
    Kenneth J. Berry, Paul W. Mielke, Janis E. Johnston · 2016 · Springer eBooks
  93. Randomized Designs: Ordinal Data, II
    Kenneth J. Berry, Paul W. Mielke, Janis E. Johnston · 2016 · Springer eBooks
  94. AN EXAMINATION OF LMX AND PROCEDURAL JUSTICE ON PERFORMANCE APPRAISAL SATISFACTION WITHIN THE CONTEXT OF A DISTRIBUTED WORKPLACE ARRANGEMENT
    Debra A Herd · 2016 · Scholar Works at UT Tyler (The University of Texas at Tyler)
  95. A Study on the Influence of Perceptual Distortion in the Scoring of Musical Performances by Florida Bandmasters Association Adjudicators
    Raymond Donato · 2016 · Journal of International Crisis and Risk Communication Research
  96. Investigating The Reliability And Validity Of Knowledge Structure Evaluations: The Influence Of Rater Error And Rater Limitation
    Michelle Harper-Sciarini · 2010 · Journal of International Crisis and Risk Communication Research
  97. Developing a measure of student resume quality in student affairs assessment: An application of generalizability theory
    Оксана Науменко · 2013 · JMU Scholoraly Commons (James Madison University)
  98. How Good Are Our Raters? Rater Errors in Clinical Skills Assessment.
    Cherdsak Iramaneerat, Rachel Yudkowsky · 2006
  99. Modeling Inter-item Variance of Item Response Theory: Application to Essay Rating
    Kyosuke Bunji · 2016 · Kodo Keiryogaku (The Japanese Journal of Behaviormetrics)
  100. A preliminary investigation of the psychometric characteristics of transformational bosses' performance evaluations
    Sean Baldwin · 2009

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.