Rating the ratings: Assessing the psychometric quality of rating data.
Cited by (567)
Items 101–200 of 567
- Comparing the Effectiveness of Self‐Paced and Collaborative Frame‐of‐Reference Training on Rater Accuracy in a Large‐Scale Writing AssessmentKevin R. Raczynski, Allan S. Cohen, George Engelhard, Zhenqiu Laura Lu · 2015 · Journal of Educational Measurement
- Measurement and assessment issues in performance appraisal.Theresa J. B. Kline, Lorne M. Sulsky · 2009 · Canadian Psychology/Psychologie canadienne
- THE ROLE OF THE TRADITIONAL RESEARCH DESIGN IN UNDERESTIMATING THE VALIDITY OF THE EMPLOYMENT INTERVIEWGeorge F. Dreher, Ronald A. Ash, PRISCILLA HANCOCK · 1988 · Personnel Psychology
- Comparing Consensus- and Aggregation-Based Methods of Measuring Team-Level Variables: The Role of Relationship Conflict and Conflict Management ProcessesNarda R. Quigley, Amanuel G. Tekleab, Paul E. Tesluk · 2007 · Organizational Research Methods
- Dependability of Measurement in Counseling Psychology: An Introduction to Generalizability TheoryWilliam T. Hoyt, Janet Nieuwsma Melby · 1999 · The Counseling Psychologist
- Detecting differential rater functioning over time (DRIFT) using a Rasch multi-faceted rating scale model.Edward W. Wolfe, Brad Moulder, Carol M. Myford · 2001 · PubMed
- How invariant and accurate are domain ratings in writing assessment?Stefanie A. Wind, George Engelhard · 2013 · Assessing Writing
- How Work Orientation Impacts Objective Career Outcomes via Managerial (Mis)perceptionsYuna Cho, Winnie Yun Jiang · 2021 · Academy of Management Journal
- A Direct Study of Halo EffectSheldon J. Lachman, Alan R. Bass · 1985 · The Journal of Psychology
- Individualized outcome measures of internal change: Methodological considerations.Larry E. Beutler, David Hamblin · 1986 · Journal of Consulting and Clinical Psychology
- ORGANIZATION AND RATER DIFFERENCES IN PERFORMANCE APPRAISALSRaymond F. Zammuto, Manuel London, Kendrith M. Rowland · 1982 · Personnel Psychology
- METHODOLOGICAL ARTICLE: A Brief Taxometrics PrimerTheodore P. Beauchaine · 2007 · Journal of Clinical Child & Adolescent Psychology
- Automated Analysis of Optic Nerve Images for Detection and Staging of PapilledemaSebastian Echegaray, Gilberto Zamora, Honggang Yu, Wenbin Luo, Peter Solíz, Randy H. Kardon · 2011 · Investigative Ophthalmology & Visual Science
- Examining the Impacts of Rater Effects in Performance AssessmentsStefanie A. Wind · 2018 · Applied Psychological Measurement
- Trifactor Models for Multiple-Ratings DataShin, Hyo Jeong, Rabe-Hesketh, Sophia, Wilson, Mark · 2019 · Multivariate Behavioral Research
- Real‐Time Feedback on Rater Drift in Constructed‐Response Items: An Example From the Golden State ExaminationHoskens, Machteld, Wilson, Mark · 2001 · Journal of Educational Measurement
- Teacher candidate performance assessments: Local scoring and implications for teacher preparation program improvementKevin C. Bastian, Gary T. Henry, Yi Pan, Diana B. Lys · 2016 · Teaching and Teacher Education
- Corrections for Criterion Reliability in Validity Generalization: A False Prophet in a Land of Suspended JudgmentJames M. LeBreton, Kelly T. Scherer, Lawrence R. James · 2014 · Industrial and Organizational Psychology
- Student evaluation of teaching and matters of reliabilityDennis E. Clayson · 2017 · Assessment & Evaluation in Higher Education
- Rater fairness in music performance assessment: evaluating model-data fit and differential rater functioningWesolowski, Brian C., Wind, Stefanie A., Engelhard, George · 2015 · Musicae Scientiae
- The Impact of Performance Measure Discriminability on Ratee IncentivesTae Sik Ahn, Iny Hwang, Myung‐In Kim · 2010 · The Accounting Review
- Satisfaction with a performance appraisal system and appraisal discussionMichael K. Mount · 1984 · Journal of Organizational Behavior
- The Student–Teacher Relationship Scale revisited: Testing factorial structure, measurement invariance and validity criteria in German-speaking samplesAnne Milatz, Michael Glüer, Elena Harwardt-Heinecke, Gregor Kappler, Lieselotte Ahnert · 2014 · Early Childhood Research Quarterly
- Many-Faceted Rasch Modeling Expert Judgment in Test DevelopmentWeimo Zhu, Catherine D. Ennis, Ang Chen · 1998 · Measurement in Physical Education and Exercise Science
- Behaviorally anchored rating scales: An application for evaluating teaching practiceMichelle P. Martín‐Raugh, Richard J. Tannenbaum, Cynthia M. Tocci, Clyde M. Reese · 2016 · Teaching and Teacher Education
- Team Dating Leads to Better Online Ad Hoc CollaborationsIoanna Lykourentzou, Robert E. Kraut, Steven P. Dow · 2017 · ACM Conference on Computer Supported Cooperative Work (CSCW)
- Robust Neural Automated Essay Scoring Using Item Response TheoryMasaki Uto, Masashi Okano · 2020 · Lecture notes in computer science
- Interrater reliability and agreement of performance ratings: A methodological comparisonJohn W. Fleenor, Julie Fleenor, William F. Grossnickle · 1996 · Journal of Business and Psychology
- As if sand were stone. New concepts and metrics to probe the ground on which to build trustable AIFederico Cabitza, Andrea Campagner, Luca Maria Sconfienza · 2020 · BMC Medical Informatics and Decision Making
- Cognitive categorization processes in performance evaluation: Confirmatory tests of two modelsCharles E. Lance, David J. Woehr, Sebastiano A. Fisicaro · 1991 · Journal of Organizational Behavior
- Immediate effectiveness of brief psychological training for health professionals dealing with terminally ill cancer patients: A controlled studyDarius Razavi, Nicole Delvaux, Christine Farvacques, Edmond Robaye · 1988 · Social Science & Medicine
- Inter-rater reliability in clinical assessments: do examiner pairings influence candidate ratings?Aileen Faherty, Tim Counihan, Thomas Kropmans, Yvonne Finn · 2020 · BMC Medical Education
- Social Context Disambiguates the Interpretation of LaughterWilliam J. Curran, Gary John McKeown, Magdalena Rychlowska, Elisabeth André, Johannes Wagner, Florian Lingenfelser · 2018 · Frontiers in Psychology
- Empirical comparison of item response theory models with rater's parametersMasaki Uto, Maomi Ueno · 2018 · Heliyon
- Learning Automated Essay Scoring Models Using Item-Response-Theory-Based Scores to Decrease Effects of Rater BiasesMasaki Uto, Masashi Okano · 2021 · IEEE Transactions on Learning Technologies
- Scoring best-worst data in unbalanced many-item designs, with applications to crowdsourcing semantic judgmentsGeoff Hollis · 2017 · Behavior Research Methods
- The impact of training on rater variabilitySteven Barrett · 2001
- Creativity and dementia: Does artistic activity affect well-being beyond the art class?Susan M. Gross, Deana Danilova, Michael A. Vandehey, George M. Diekhoff · 2013 · Dementia
- Rating ability in performance judgments: The joint influence of implicit theories and intelligenceNeil M. A. Hauenstein, Ralph A. Alexander · 1991 · Organizational Behavior and Human Decision Processes
- Examining the relationship between cognitive inflexibility and internalizing and externalizing symptoms in autistic children and adolescents: A systematic review and meta‐analysisJiedi Lei, Tony Charman, Eleanor Leigh, Ailsa Russell, Zameer Mohamed, Matthew J. Hollocks · 2022 · Autism Research
- Purposes of Performance Appraisal System: A Perceptual Study of Civil Servants in District Dera Ismail Khan PakistanMalik Ikramullah, Bahadar Shah, Shadiullah Khan, Faqir Sajjad Ul Hassan, Tariq Zaman · 2012 · International Journal of Business and Management
- A generalized many-facet Rasch model and its Bayesian estimation using Hamiltonian Monte CarloUto, Masaki, Ueno, Maomi · 2020 · Behaviormetrika
- The Influence of Rater Effects in Training Sets on the Psychometric Quality of Automated Scoring for Writing AssessmentsStefanie A. Wind, Edward W. Wolfe, George Engelhard, Peter W. Foltz, Mark Rosenstein · 2017 · International Journal of Testing
- Focusing the international personnel performance appraisal processMichael G. Harvey · 1997 · Human Resource Development Quarterly
- Integration of Prediction Scores From Various Automated Essay Scoring Models Using Item Response TheoryMasaki Uto, Itsuki Aomi, Emiko Tsutsumi, Maomi Ueno · 2023 · IEEE Transactions on Learning Technologies
- Effectiveness of performance feedback from behaviorally anchored rating scales.Peter W. Hom, Angelo S. DeNisi, Angelo J. Kinicki, Brendan D. Bannister · 1982 · Journal of Applied Psychology
- Faculty Evaluation by Residents in an Emergency Medicine Program: A New Evaluation InstrumentIvan P. Steiner, Jeffrey Michael Franc, Karen D. Kelly, Brian Hunter Rowe · 2000 · Academic Emergency Medicine
- Automated Short-Answer Grading Using Deep Neural Networks and Item Response TheoryMasaki Uto, Yuto Uchida · 2020 · Lecture notes in computer science
- Cognitive shifting and externalising problem behaviour in intellectual disability and autism spectrum disorderEelke Visser, H. J. C. Berger, H. M. J. van Schrojenstein Lantman‐de Valk, J. B. Prins, Jan‐Pieter Teunisse · 2015 · Journal of Intellectual Disability Research
- EI competencies as a related but different characteristic than intelligenceRichard Eleftherios Boyatzis, Joan Manuel Batista‐Foguet, Xavier Fernández‐i‐Marín, Margarida Truninger · 2015 · Frontiers in Psychology
- Examining Rater Effects of the TGMD-2 on Children With Intellectual DisabilityYoungdeok Kim, Ilhyeok Park, Minsoo Kang · 2012 · Adapted Physical Activity Quarterly
- Reliability and Accuracy of Resident Evaluations of Surgical FacultyDonald A. Risucci, Larry Lutsky, Robert J. Rosati, Anthony J. Tortólani · 1992 · Evaluation & the Health Professions
- A LONGITUDINAL EXAMINATION OF RATER AND RATEE EFFECTS IN PERFORMANCE RATINGSRobert J. Vance, Peter S. Winne, E. SCOTT WRIGHT · 1983 · Personnel Psychology
- Emotion work as a source of employee well- and ill-being: the moderating role of service interaction typeMarcel Kern, Kai Trumpold, Dieter Zapf · 2021 · European Journal of Work and Organizational Psychology
- A Method for Analyzing Sparse Data Matrices in the Generalizability Theory FrameworkChristopher W. T. Chiu, Edward W. Wolfe · 2002 · Applied Psychological Measurement
- A comparative review of family rating scales: Guidelines for clinicians and researchers.Cindy I. Carlson, Harold D. Grotevant · 1987 · Journal of Family Psychology
- Brief psychological training for health care professionals dealing with cancer patients: A one-year assessmentDarius Razavi, Nicole Delvaux, Christine Farvacques, Edmond Robaye · 1991 · General Hospital Psychiatry
- The Nosology of Attention-deficit Hyperactivity DisorderGerald J. August, Barry D. Garfinkel · 1993 · Journal of the American Academy of Child & Adolescent Psychiatry
- Inflated Reputations: Uncertainty, Leniency, and Moral Wiggle Room in Trader Feedback SystemsGary Eugene Bolton, David J. Kusterer, Johannes Mans · 2019 · Management Science
- Student Engagement and Its Predictors: An Exploratory Study in an Indian Business SchoolBaldev R. Sharma, Pradip K. Bhaumik · 2013 · Global Business Review
- Assessing Self-Appraisal of Job Performance as an Evaluation Device: Are the Poor Results a Function of Method or Methodology?Mark John Somers, Dee Birnbaum · 1991 · Human Relations
- THE BEST AND THE REST: REVISITING THE NORM OF NORMALITY OF INDIVIDUAL PERFORMANCEErnest H. O’Boyle, Herman Aguinis · 2011 · Academy of Management Proceedings
- EFFECTS OF ASSESSORSHIP ON MANAGERs' PROFICIENCY IN ACQUIRING, EVALUATING, AND COMMUNICATING INFORMATION ABOUT PEOPLERobert V. Lorenzo · 1984 · Personnel Psychology
- Teaching Design Freedom: Understanding the Effects of Variations in Design for Additive Manufacturing Education on Students’ CreativityRohan Prabhu, Scarlett R. Miller, Timothy W. Simpson, Nicholas Alexander Meisel · 2020 · Journal of Mechanical Design
- Database of Emotional Videos from Ottawa (DEVO)Kylee T. Ack Baraly, Lydia Muyingo, Christine Beaudoin, Sanaz Karami, Melina Langevin, Patrick S. R. Davidson · 2020 · Collabra Psychology
- Analyzing rater severity in a freshman composition course using many facet Rasch measurementInan Deniz Erguvan, Beyza Aksu Dünya · 2020 · Language Testing in Asia
- Examiner error in curriculum-based measurement of oral readingKelli D. Cummings, Gina Biancarosa, Andrew Schaper, Deborah K. Reed · 2014 · Journal of School Psychology
- Evaluating Teacher Effectiveness Using Classroom Observations: A Rasch Analysis of the Rater Effects of PrincipalsEli A. Jones, Christi Crosby Bergin · 2019 · Educational Assessment
- Statistical analysis of ordinal categorical status after therapies.Robert J. Grissom · 1994 · Journal of Consulting and Clinical Psychology
- Kohut's psychology of the self: Theory and measures of counseling outcome.Michael John Patton, Gary E. Connor, Kathleen J. Scott · 1982 · Journal of Counseling Psychology
- An examination of the presence, magnitude and impact of halo on consumer satisfaction measuresJochen Wirtz · 2000 · Journal of Retailing and Consumer Services
- Evidence for the Effectiveness of an Alternative Multisource Performance Rating MethodologyBrian James Hoffman, Charles Allen Gorman, Carrie A. Blair, John Patrick Meriac, Benjamin L. Overstreet, E. Kate Atchley · 2012 · Personnel Psychology
- Prediction of global ratings of fluency and delivery in narrative discourse by linguistic and phonetic measures- oral performances of students aged 11-12 yearsAmos J. S. van Gelderen · 1994 · Language Testing
- Performance Appraisers as Test DevelopersCristina G. Banks, Loriann Roberson · 1985 · Academy of Management Review
- Intersection of the Web-Based Vaping Narrative With COVID-19: Topic Modeling StudyKamila Janmohamed, Abdul‐Nasah Soale, Laura Forastiere, Weiming Tang, Yongjie Sha, Jakob Demant, Edoardo M. Airoldi, Navin Kumar · 2020 · Journal of Medical Internet Research
- A Trustworthy Human–Machine framework for collective decision making in Food–Energy–Water management: The role of trust sensitivitySüleyman Uslu, Davinder Kaur, Samuel J. Rivera, Arjan Durresi A, Meghna Babbar‐Sebens, Jenna H. Tilt · 2020 · Knowledge-Based Systems
- Improving Rater Calibration in Aviation: A Case StudyRobert W. Holt, Jeffrey T. Hansberger, Deborah A. Boehm‐Davis · 2002 · International Journal of Aviation Psychology
- The Kestenberg Movement Profile: Performance of Novice RatersSabine C. Koch, Robyn Flaum Cruz, Sherry W. Goodill · 2001 · American Journal of Dance Therapy
- How Network Embeddedness Affects Real-Time Performance Feedback: An Empirical InvestigationMariia Petryk, Michael Rivera, Siddharth Bhattacharya, Liangfei Qiu, Subodha Kumar · 2022 · Information Systems Research
- Taxometric Methods: Enhancing Early Detection and Prevention of Psychopathology by Identifying Latent Vulnerability TraitsTheodore P. Beauchaine, Penny Marsh · 2015 · Wiley eBooks
- Interobserver relational agreement.Wm Wren Stine · 1989 · Psychological Bulletin
- Psychometric Characteristics of Behavior Rating Scales: Definitions, Problems, and SolutionsMichael J. Wilson, Lyndal M. Bullock · 1989 · Behavioral Disorders
- Cross-sectional and longitudinal observations of activity level and sustained attention in a normative sampleRichard S. Milich · 1984 · Research on Child and Adolescent Psychopathology
- Unravelling Vietnamese Students' Critical Thinking and Its Relationship with Argumentative WritingTuyen Son Nguyen, Huan Buu Nguyen · 2020 · Universal Journal of Educational Research
- A model of volitional rating behaviorJeffrey S. Kane · 1994 · Human Resource Management Review
- Outlier Aversion in Subjective Evaluation: Evidence From World Figure Skating ChampionshipsJungmin Lee · 2007 · Journal of Sports Economics
- How Smart Does Your Profile Image Look? Estimating Intelligence from Social Network Profile ImagesXingjie Wei, David J. Stillwell · 2017 · ACM International Conference on Web Search and Data Mining (WSDM)
- The Critical Role of Anchor Paper Selection in Writing AssessmentSharon E. Osborn Popp, Joseph M. Ryan, Marilyn S. Thompson · 2009 · Applied Measurement in Education
- Development and validation of the Bush-Francis Catatonia Rating Scale – Brazilian versionAna Letícia Santos Nunes, Alberto Filgueiras, Rodrigo Nicolato, Jussara Mendonça Alvarenga, Luciana Angélica Silva Silveira, Rafael de Assis da Silva, Elie Cheniaux · 2017 · Arquivos de Neuro-Psiquiatria
- But Will It Build? Assessing Student Engineering Designers’ Use of Design for Additive Manufacturing Considerations in Design OutcomesRohan Prabhu, Scarlett R. Miller, Timothy W. Simpson, Nicholas Alexander Meisel · 2020 · Journal of Mechanical Design
- Beurteilereffekte bei der Messung von Unterrichtsqualität: Das Multifacetten-Rasch-Modell und die Generalisierbarkeitstheorie als Methoden der Qualitätssicherung in der externen Evaluation von SchulenMarcus Pietsch, Simone Tosana · 2008 · Zeitschrift für Erziehungswissenschaft
- Resident evaluation of surgical facultyAnthony J. Tortólani, Donald A. Risucci, Robert J. Rosati · 1991 · Journal of Surgical Research
- Evaluation of students' clinical competence.Evelyn R. Dienst, Patricia M. Armstrong · 1988 · Professional Psychology Research and Practice
- Effects of rating criteria order on the halo effect in L2 writing assessment: a many-facet Rasch measurement analysisHyun-Woo Kim · 2020 · Language Testing in Asia
- Don't Just Judge the Spelling! The Influence of Spelling on Assessing Second-Language Student EssaysThorben Jansen, Cristina Vögelin, Nils Machts, Stefan Daniel Keller, Jens Møller · 2021 · Frontline Learning Research
- Need-solution pair recognition by household sector individuals: Evidence, and a cognitive mechanism explanationRuth Stock‐Homburg, Shannon L. M. Heald, Christian Holthaus, Nils Lennart Gillert, Eric von Hippel · 2020 · Research Policy
- Dynamic Fuzzy Rating Tracker (DYFRAT): a novel methodology for modeling real-time dynamic cognitive processes in rating scalesAntonio Calcagnì, Luigi Lombardi · 2014 · Applied Soft Computing
- Comments on the Measurement of HaloSebastiano A. Fisicaro, Robert J. Vance · 1994 · Educational and Psychological Measurement
- Hawks and doves: The influence of nurse assessor stringency and leniency on pass grades in clinical skills assessmentsMiranda Daly, Yenna Salamonson, Paul J. Glew, Bronwyn Everett · 2016 · Collegian Journal of the Royal College of Nursing Australia
- On the design and validation of a rubric for the evaluation of performance in a musical contestMarcos Álvarez-Díaz, Luis Magín Muñiz-Bascón, Antonio Soria-Alemany, Alberto Veintimilla-Bonet, Rubén Fernández-Alonso · 2020 · International Journal of Music Education
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.