CoChat

An Expanded Decision-Making Procedure for Examining Cross-Level Interaction Effects With Multilevel Modeling

Aguinis, Herman, Culpepper, Steven Andrew · 2015 · Organizational Research Methods
Cited by 60

The DOI matches its Crossref record; 9 of the 9 references it cites were found in a registry or an index.

Abstract

Cross-level interaction effects lay at the heart of multilevel contingency and interactionism theories. Also, practitioners are particularly interested in such effects because they provide information on the contextual conditions and processes under which interventions focused on individuals (e.g., selection, leadership training, performance appraisal, and management) result in more or less positive outcomes. We derive a new intraclass correlation, ρ β, to assess the degree of lower-level outcome variance that is attributed to higher-level differences in slope coefficients. We provide analytical and empirical evidence that ρ β is an index of variance that differs from the traditional intraclass correlation ρ α and use data from recently published articles to illustrate that ρ α assesses differences across collectives and higher-level processes (e.g., teams, leadership styles, reward systems) but ignores the variance attributed to differences in lower-level relationships (e.g., individual level job satisfaction and individual level performance). Because ρ α and ρ β provide information on two different sources of variability in the data structure (i.e., differences in means and differences in relationships, respectively), our results suggest that researchers contemplating the use of multilevel modeling, as well those who suspect nonindependence in their data structure, should expand the decision criteria for using multilevel approaches to include both types of intraclass correlations. To facilitate this process, we offer an illustrative data set and the icc beta R package for computing ρ β in single- and multiple-predictor situations and make them available through the Comprehensive R Archive Network (i.e., CRAN).

Overview

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.1177/1094428114563618

Cites

9 of 9 references verified0 citation errors · 0 not checkable

Statistics

Verification

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Citations

Cites

Show all 9 references

Cited by

See all 60

Metadata

Authors
Aguinis, H., & Culpepper, S. A.
Venue
Organizational Research Methods
Published
2015-01-19
Volume
18
Issue
2
Pages
155-176
ISSN
  • 1094-4281 (ISSN-L)
  • 1552-7425
OpenAlex
W2143657917
Cited by
60
References
9
FWCI
6.42
Type
journal article
Language
en
Open access
closed

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

How to cite

Cite CoChat for the checks on this page, and the paper for its own findings.

This page
CoChat. (2026). Citation check: An Expanded Decision-Making Procedure for Examining Cross-Level Interaction Effects With Multilevel Modeling. https://app.cochat.ai/papers/10.1177/1094428114563618
The paper
Aguinis, H., & Culpepper, S. A. (2015). An Expanded Decision-Making Procedure for Examining Cross-Level Interaction Effects With Multilevel Modeling. Organizational Research Methods. https://doi.org/10.1177/1094428114563618

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.