Cited by 1Engineering Education and Curriculum DevelopmentOnline Learning and AnalyticsHigher Education Research Studies

Preliminary Results from a High-Resolution Analysis of Accreditation Data to Assess Indicators, Identify Predictors and Assess Equitability of Teaching Practices

Open access
Hosseini, Mohammad, Vaez Ghaemi, Roza, Potvin, Gabriel·2022·Proceedings of the Canadian Engineering Education Association (CEEA)

Abstract

The Department of Chemical and Biological Engineering (CHBE) at UBC has undertaken a high-resolution analysis of its accreditation data with the aim to identify any correlations between students’ declared gender, visa status (international or domestic), performance in individual indicators, course grades, and/or overall program GPAs. The hope is to extract meaningful information about the value of the indicators used in collecting information about our programs, increase the reliability of the data collected by reviewing those indicators that do not yield actionable data, identify predictors of student performance, and identify biases, if any, in the success rates of our students. This paper presents the results of the first steps of this analysis, using four core courses spanning CHBE’s programs. Correlations between performance in different indicators is represented by interaction heat maps and scatterplots, and performance by gender or student status are represented as violin plots. This paper serves as a proof of concept for this type of analysis, highlighting the value of this high-resolution look at accreditation data.

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.24908/pceea.vi.15872

Cites

Statistics

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

  • While programs collect large amounts of accreditation data, the lack of systematic analysis limits the ability to detect trends and identify potential issues with validity and reliability.

    “While programs collect large amounts of accreditation data, the lack of systematic analysis limits the ability to detect trends and identify potential issues with validity and reliability.”
  • Learning outcome data is aggregated to yield trends for accreditation and program decisions, but it is seldom examined for targeted program improvement and to assess the reliability of indicators.

    “The learning outcome data is aggregated to yield trends for the purposes of accreditation process and to inform program decisions, but it is seldom examined for targeted program improvement and to assess the reliability of indicators [6].”

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Cites

No references could be resolved yet.

Research works printed but not linked: 3

  1. A.M. Parker, E. Watson, M. Ivey, J.P. Carey, Approaches to Graduate Attributes and Continual Improvement Processes in Faculties of Engineering Across Canada: A Narrative Review of The Literature, in: Can. Eng. Educ. Assoc. Conf., 2019.
  2. G. Potvin, J. Verrett, Curriculum Renewal for Better Design-Related Student Outcomes in Second-Year Chemical and Biological Engineering, in: Can. Eng. Educ. Assoc. Conf., 2021.
  3. R. Vaez Ghaemi, G. Potvin, Experimenting with labs: Practical and pedagogical considerations for the integration of problem-based lab instruction in chemical engineering, Can. J. Chem. Eng. (2021). https://doi.org/10.1002/cjce.24136. · DOI

Cited by

Sorted by citations

Authors
Hosseini, M., Vaez Ghaemi, R., & Potvin, G.
Affiliations
University of British Columbia (CA)
Venue
Proceedings of the Canadian Engineering Education Association (CEEA)
Published
2022-11-01
ISSN
2371-5243 (ISSN-L)
OpenAlex
W4308912381
Cited by
1
References
0
Citations by year
2024: 1
FWCI
0.10
Type
journal article
Language
en
Open access
Locations
Proceedings of the Canadian Engineering Education Association (CEEA) (publishedVersion, cc-by-nc-sa)
Topics
  • Physical Sciences › Engineering › Media Technology › Engineering Education and Curriculum Development
  • Physical Sciences › Computer Science › Computer Science Applications › Online Learning and Analytics
  • Social Sciences › Education › Higher Education Research Studies
Keywords
engineering accreditation, student performance indicators, gender disparities, international students, visa status, data reliability

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review