Thx 4 the msg: Assessing the Impact of Texting on Student Engagement and Persistence
Open accessAbstract
As colleges and universities strive to increase persistence and aid students in reaching graduation, they are utilizing alternative communication strategies like text messaging. Behavioral economics researchers suggest personalized, regular nudges can help college students make decisions that positively impact their college career and keep them on track for graduation. The current study presents the results of a randomized field experiment where a text messaging program was implemented in a large college at a public university. The intervention utilized a mixture of automated and personalized text messages from academic advisors and allowed for two-way communication between individual students and their major advisor. Mulitvariate analyses revealed the intervention had no impact on university persistence, but it did increase the odds of persisting in the college to the end of the semester, moving the average, overall college persistence rate from 93 to 95%. Effects were concentrated on underclass students, whose persistence rate moved from 87 to 93% at the college level. Underclass students also showed statistically significant university persistence effects, moving from 90 to 95%. Students who received texts but never engaged with the texting program were significantly less likely to request an advising appointment or to apply to be a student ambassador than were students in the control group. More research is needed to understand what motivates a student to engage with the texting software and to identify what the longer-term consequences of using text messaging to communicate with students might be.Supplementary information The online version contains supplementary material available at 10.1007/s11162-022-09678-8.
AI snapshot
Written from the paper’s full text.
TL;DR
In a randomized field experiment in a large public-university college, a semi-automated advisor texting program did not improve university persistence for the full sample but increased college persistence, with effects concentrated among students with fewer than 60 completed credits. Students who never engaged with the texts showed lower odds of some college engagement behaviors than controls.
Key findings
- Full-sample multivariate logistic regression: treatment students had 1.48 times higher odds of persisting under the college definition (predicted 95% vs. 93% for controls); there was no statistically significant full-sample effect on university persistence.
- For students with fewer than 60 completed credits, treatment students were 2.13 times more likely to persist at the university and 2.09 times more likely to persist within the college; the abstract reports underclass persistence moving from 90% to 95% at the university and from 87% to 93% at the college. No significant persistence differences appeared for students with 60–99 completed credits.
- Treatment students who responded to at least one text were 1.27 times more likely to meet with an advisor than controls overall, and 1.82 times more likely if they had fewer than 60 credits.
- Treatment students who never responded to a text had 25% lower odds of meeting with an advisor and 64% lower odds of applying to be an ambassador than controls; non-engaged students with 60–99 credits were 31% less likely to meet with an advisor and 60% less likely to apply to be an ambassador.
Methods
- Randomized field experiment (ASCENT) in one large college at a public university during spring 2020; eligible students had at least one major in the college and fewer than 100 earned credits. Of 2,225 eligible students, 286 were text-ineligible; final analytic groups were treatment N = 1,451 and control N = 488 after COVID-related changes collapsed two treatment arms.
- Treatment students received approximately weekly automated and personalized texts from major advisors and could opt out; controls received standard advising emails and Canvas communications. Outcomes included university persistence (not withdrawing, taking leave, or dropping all classes) and college persistence (also not changing major out of the college), plus advising appointments, scholarship applications, and ambassador applications.
- Analyses used bivariate comparisons and multivariate logistic regression with covariates (sex, age, race/ethnicity, state residency, entered as freshman, honors, GPA, academic level); career-stage splits compared students with <60 vs. 60–99 completed credits, and engagement with the texting platform was included as a covariate in some models.
Limitations
- The paper states limited generalizability to other college settings; only one semester of follow-up, so longer-term engagement and persistence to graduation could not be assessed; limited engagement measures because the platform provided only categorical low/medium/high engagement and no club, event, or faculty-interaction data; text-ineligible phone numbers created a self-selection issue; and the COVID-19 pandemic disrupted spring 2020 with unknown impact on persistence.
- The paper states that students who opted out differed somewhat from those who remained (e.g., state residency and persistence outcomes; Appendix Table 5), though they remained in the treatment group under intent-to-treat.
- The text makes evident that randomization produced marginal differences (treatment group marginally younger and less likely to be upperclass), which were controlled in multivariate models, and that COVID forced the collapse of two treatment arms and moved the planned in-person registration event to a virtual format, changing the intervention.
Model-written summary. Check it against the paper before relying on it.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
1 of 19 cited sources checked · 1 supported · 0 flagged
- Findingown data§ Abstract · p. 1
Students who received texts but never engaged with the texting program were significantly less likely to apply to be a student ambassador than were students in the control group.
“Students who received texts but never engaged with the texting program were significantly less likely to request an advising appointment or to apply to be a student ambassador than were students in the control group.”
Quote in the paperSubstantial claim - Findingown data§ Abstract · p. 1
Underclass students showed statistically significant university persistence effects, moving from 90% to 95%.
“Underclass students also showed statistically significant university persistence effects, moving from 90 to 95%.”
Quote in the paperSubstantial claim - Findingown data§ Abstract · p. 1
The intervention had no impact on university persistence.
“Mulitvariate analyses revealed the intervention had no impact on university persistence, but it did increase the odds of persisting in the college to the end of the semester, moving the average, overall college persistence rate from 93 to 95%.”
Quote in the paperSubstantial claim - Findingown data§ Abstract · p. 1
Effects were concentrated on underclass students, whose college persistence rate moved from 87% to 93%.
“Effects were concentrated on underclass students, whose persistence rate moved from 87 to 93% at the college level.”
Quote in the paperSubstantial claim - Findingown data§ Abstract · p. 1
Students who received texts but never engaged with the texting program were significantly less likely to request an advising appointment than were students in the control group.
“Students who received texts but never engaged with the texting program were significantly less likely to request an advising appointment or to apply to be a student ambassador than were students in the control group.”
Quote in the paperSubstantial claim
- Findingown data§ Discussion and Conclusions · p. 15
286 students did not have text-capable phone numbers and therefore could not be included in the research design.
“While the majority of students in the college had text-capable phone numbers, 286 students did not, and therefore could not be included in the research design.”
Quote in the paperNot a substantial claim - Findingown data§ Multivariate Results · p. 15
Students who did not engage and had 60-99 credit hours were 60% less likely to submit an application to be an ambassador for the college than otherwise similar control students.
“Students who did not engage and have 60-99 credit hours were 31% less likely to meet with and advisor and 60% less likely to submit an application to be an ambassador for the college than otherwise similar students in the control groups.”
Quote in the paperSubstantial claim- Rests on an assumption: The COVID-19 pandemic and the shift to online instruction did not differentially affect the treatment and control groups' persistence and engagement outcomes.
- Findingown data§ Multivariate Results · p. 15
Students who did not engage and had 60-99 credit hours were 31% less likely to meet with an advisor than otherwise similar control students.
“Students who did not engage and have 60-99 credit hours were 31% less likely to meet with and advisor and 60% less likely to submit an application to be an ambassador for the college than otherwise similar students in the control groups.”
Quote in the paperSubstantial claim- Rests on an assumption: The COVID-19 pandemic and the shift to online instruction did not differentially affect the treatment and control groups' persistence and engagement outcomes.
- Findingown data§ Bivariate Results · p. 12
Students in the control group were marginally more likely to apply for an ambassador position than were students in the treatment group.
“Students in the control group were marginally more likely to apply for an ambassador position than were students in the treatment group”
Quote in the paperNot a substantial claim- Rests on an assumption: The COVID-19 pandemic and the shift to online instruction did not differentially affect the treatment and control groups' persistence and engagement outcomes.
- Findingown data§ Discussion and Conclusions · p. 16
Across all outcomes, the coefficient associated with lambda in the Heckman correction was statistically insignificant.
“Across all outcomes, correction for such sample selection (i.e., the coefficient associated with lambda) was statistically insignificant.”
Quote in the paperNot a substantial claim - Findingown data§ Discussion and Conclusions · p. 16
Students who responded to zero text messages and those who responded to at least one text message differed in their persistence probabilities.
“they were often strikingly different in terms of their persistence probabilities and intermediate college engagement probabilities.”
Quote in the paperSubstantial claim0 of 1 sources checked- cites Appendix Table 6
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
- Findingown data§ Discussion and Conclusions · p. 16
Students who responded to zero text messages and those who responded to at least one text message did not differ in socio-demographic characteristics other than gender.
“While these groups did not differ in terms of their socio-demographic characteristics other than gender (see Appendix Table 6)”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites Appendix Table 6
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
- Findingown data§ Discussion and Conclusions · p. 15
The texting intervention significantly increased the likelihood of persistence to the end of the semester in both the college and the university for students who were freshmen or sophomores.
“The results of the RFE suggest the texting intervention significantly increased the likelihood of persistence to the end of the semester in both the college and the university for students who were freshmen or sophomores.”
Quote in the paperSubstantial claim - Findingown data§ Discussion and Conclusions · p. 16
The texting intervention did not improve persistence outcomes for students with 60 or more credit hours.
“Our study reveals texting can be used to improve persistence outcomes for students early in their academic careers, but did not improve persistence outcomes for students with 60 or more credit hours.”
Quote in the paperSubstantial claim - Findingown data§ Multivariate Results · p. 12
Students who had completed 60 to 99 credit hours showed no significantly different persistence outcomes using either the university or the college measure.
“Students who had completed 60 to 99 credit hours showed no significantly different persistence outcomes using either the university or the college measure.”
Quote in the paperSubstantial claim- Rests on an assumption: The COVID-19 pandemic and the shift to online instruction did not differentially affect the treatment and control groups' persistence and engagement outcomes.
- Findingown data§ Multivariate Results · p. 15
In the full sample, treatment group students who never responded to a text message had 25% lower odds of meeting with an advisor compared to control group students.
“Interestingly, students in the treatment group in the full sample who never responded to a text message had 25% lower odds of meeting with an advisor compared to students in the control group.”
Quote in the paperSubstantial claim- Rests on an assumption: The COVID-19 pandemic and the shift to online instruction did not differentially affect the treatment and control groups' persistence and engagement outcomes.
- Findingown data§ Discussion and Conclusions · p. 16
Students who responded to zero text messages and those who responded to at least one text message differed in their intermediate college engagement probabilities.
“they were often strikingly different in terms of their persistence probabilities and intermediate college engagement probabilities.”
Quote in the paperSubstantial claim0 of 1 sources checked- cites Appendix Table 6
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
- Findingown data§ Bivariate Results · p. 12
Gender was the only socio-demographic characteristic with statistically significant differences between treatment group students who responded to at least one text message and those who did not.
“we found that gender was the only socio-demographic characteristic with statistically significant differences between treatment group students who responded to at least one text message and those who did not.”
Quote in the paperNot a substantial claim - Findingown data§ Multivariate Results · p. 15
In the full sample, treatment group students who responded to one or more message were 1.27 times more likely to meet with an advisor than otherwise similar control students.
“Students in the treatment group who responded to one or more message in the full sample were 1.27 times more likely to meet with an advisor than were otherwise similar students in the control group.”
Quote in the paperSubstantial claim- Rests on an assumption: The COVID-19 pandemic and the shift to online instruction did not differentially affect the treatment and control groups' persistence and engagement outcomes.
- Findingown data§ Bivariate Results · p. 12
Approximately 61% (851 students) of treatment group students responded to at least one text message at some point during the semester.
“Approximately 61% (i.e., 851 students) of treatment group students responded to at least one text message at some point during the semester.”
Quote in the paperNot a substantial claim - Findingown data§ Multivariate Results · p. 15
Treatment group students with fewer than 60 credit hours who responded to one or more message were 1.82 times more likely to meet with an advisor than otherwise similar control students.
“This is also true for students with less than 60 credit hours, who were 1.82 times more likely to meet with an advisor.”
Quote in the paperSubstantial claim- Rests on an assumption: The COVID-19 pandemic and the shift to online instruction did not differentially affect the treatment and control groups' persistence and engagement outcomes.
- Findingown data§ Multivariate Results · p. 15
Students who did not reply to a message had 64% lower odds of applying to be an ambassador compared to control group students.
“In addition, students who did not reply to a message had 64% lower odds of applying to be an ambassador compared to students in the control group.”
Quote in the paperSubstantial claim- Rests on an assumption: The COVID-19 pandemic and the shift to online instruction did not differentially affect the treatment and control groups' persistence and engagement outcomes.
- Findingown data§ Bivariate Results · p. 11
There were no statistically significant bivariate differences in persistence between treatment and control group students who had completed 60-99 credit hours.
“There were no statistically significant bivariate differences in persistence between treatment and control group students who had completed 60-99 credit hours.”
Quote in the paperNot a substantial claim- Rests on an assumption: The COVID-19 pandemic and the shift to online instruction did not differentially affect the treatment and control groups' persistence and engagement outcomes.
- Findingown data§ Discussion and Conclusions · p. 15
There was no significant difference between students with and without text-capable phones on the socio-demographic and academic measures available.
“In reference to the socio-demographics and academic measures we had access to, there was no significant difference between those who had a texting capable phone and those who did not.”
Quote in the paperNot a substantial claim - Findingown data§ Discussion and Conclusions · p. 15
From the pilot program in fall 2019 and spring 2020, engagement with text messages increased, particularly in response to the introduction text at the beginning of each semester.
“From the pilot program in fall 2019 and spring 2020 we have seen an increase in engagement with the text messages, particularly in response to the introduction text at the beginning of each semester.”
Quote in the paperNot a substantial claim - Study design and conductown data§ The Intervention · p. 8
Students were randomly assigned to one of three groups before the start of the spring 2020 semester.
“The remaining students were randomly assigned to one of three groups before the start of the spring 2020 semester:”
Quote in the paperSubstantial claim - Study design and conductcitation§ The Intervention · p. 8
The estimated power of the study was 0.77.
“The resulting power was estimated to be 0.77 (Hintz, 2013).”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites Hintz, 2013
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
- Study design and conductown data§ Abstract · p. 1
The study was a randomized field experiment.
“The current study presents the results of a randomized field experiment where a text messaging program was implemented in a large college at a public university.”
Quote in the paperSubstantial claim - Premisecitation§ Introduction · p. 2
When nudges come from a trusted source, decision-makers are more likely to consider the impact of the decision and the intention of the source.
“Additionally, when nudges come from a trusted source, decision-makers are more likely to consider the impact of the decision and the intention of the source (Krijnen et al., 2017).”
Quote in the paperSubstantial claim0 of 1 sources checked- cites Krijnen et al., 2017 source
- Study design and conductown data§ The Intervention · p. 8
A prospective power analysis for logistic regression was done prior to the study.
“Prior to undertaking the study, a prospective power analysis for logistic regression was done where (1) the impact of the treatment was hypothesized to move the probability of persistence from .80 to .85, (2) the pseudo R-squared was assumed to be .20, and (3) the sample size was 2100.”
Quote in the paperNot a substantial claim - Premisecitation§ Discussion and Conclusions · p. 16
Behavioral economics suggests students often make decisions that provide immediate gratification over those that will positively impact their futures.
“behavioral economics suggests students often make decisions that provide immediate gratification over those that will positively impact their futures (Hanushek et al., 2016).”
Quote in the paperSubstantial claim0 of 1 sources checked- cites Hanushek et al., 2016 source
- Study design and conductown data§ Bivariate Results · p. 10
Students in the treatment group were less likely to be juniors or seniors than those in the control group.
“Students in the treatment group were also less likely to be juniors or seniors than those in the control group.”
Quote in the paperNot a substantial claim - Interpretationown data§ Discussion and Conclusions · p. 16
The findings that texting improves persistence for early-career students are consistent with Tinto's (2015) hypothesis that early intervention is important for student persistence.
“These findings are consistent with Tinto's (2015) hypothesis that early intervention is important for student persistence.”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites Tinto's (2015) source
- Study design and conductown data§ Discussion and Conclusions · p. 15
The study's measures of engagement were limited to academic records and the texting platform's categorical low, medium, and high engagement, not the number of messages a student responded to.
“Third, the study has limited measures of engagement. Our data were limited to what could be obtained through academic records and by the level of engagement measured by the texting platform. For example, the platform did not provide the number of messages a student responded to, rather we only had access to categorical measures of low, medium, and high engagement.”
Quote in the paperNot a substantial claim - Interpretationreasoning§ Discussion and Conclusions · p. 15
The study is limited in its generalizability because the student population is from a large college within a public university and may differ from other college settings.
“First, the study is limited in its generalizability. As a large college within a public university, our student population may differ in important ways from those in other college settings.”
Quote in the paperNot a substantial claim - Interpretationnone given§ Discussion and Conclusions · p. 17
Initial research suggests that students who have text-capable phones but never engage with an advisor through texting may be at a somewhat greater risk of engaging in behaviors that do not promote persistence in the long run.
“Our initial research suggests that this latter group may be at a somewhat greater risk of engaging in behaviors that do not promote persistence in the long run.”
Quote in the paperSubstantial claim - Interpretationreasoning§ Discussion and Conclusions · p. 15
The study cannot exclude the possibility of unmeasured differences between students with and without text-capable phones.
“However, this does not exclude the chance there are unmeasured differences between the two groups.”
Quote in the paperNot a substantial claim
- Classified as probably not a substantial claim. 15
- May combine two claims. 18
- The quote only partly states this claim. 1
Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.
Premisecitation§ Literature Review · p. 4Students who participated in advising via text reported that, overall, they enjoyed text messaging, noting it kept them on track toward success in their academic careers.
“Arnold et al. (2020) asked students who participated in advising via text about their experience. Using focus groups and text message queries, they reported that, overall, students enjoyed text messaging, noting it kept them on track toward success in their academic careers.”
Quote in the paperNot a substantial claim1 of 1 sources checked- cites Arnold et al. (2020)
May combine two claims.
Findingown data§ Abstract · p. 1The intervention increased the odds of persisting in the college to the end of the semester, moving the average overall college persistence rate from 93% to 95%.
“Mulitvariate analyses revealed the intervention had no impact on university persistence, but it did increase the odds of persisting in the college to the end of the semester, moving the average, overall college persistence rate from 93 to 95%.”
Quote in the paperSubstantial claimThe quote only partly states this claim.
Findingown data§ Multivariate Results · p. 12No statistically significant results were found when comparing the treatment to the control group in the full sample for advising appointments, scholarship applications, and ambassador applications.
“No statistically significant results were found when comparing the treatment to the control group in the full sample”
Quote in the paperSubstantial claim- Rests on an assumption: The COVID-19 pandemic and the shift to online instruction did not differentially affect the treatment and control groups' persistence and engagement outcomes.
May combine two claims.
Findingown data§ Multivariate Results · p. 12Treatment group students with fewer than 60 credit hours were 2.13 times more likely to persist at the university than otherwise similar control students, equating to a 5 percentage point gain.
“These treatment group students, those who have fewer than 60 credit hours, were 2.13 times more likely to persist at the university and 2.09 times more likely to persist within the college than otherwise similar students in the control group.”
- Also stated in: § Multivariate Results · p. 12 · plain
“These odds ratios equate to 5% point gain in persistence at the university and a 6% point gain for persistence in the college, respectively, for those in the freshman/sophomore treatment group.”
Quote in the paperSubstantial claim- Rests on an assumption: The COVID-19 pandemic and the shift to online instruction did not differentially affect the treatment and control groups' persistence and engagement outcomes.
- Also stated in: § Multivariate Results · p. 12 · plain
May combine two claims.
Findingown data§ Bivariate Results · p. 11Using the university's definition of persistence, 94.47% of the control group and 96.07% of the treatment group persisted, but these bivariate differences did not reach conventional levels of statistical significance.
“Using the university's definition of persistence, 94.47% of the control group and 96.07% of the treatment group persisted, but these bivariate differences did not reach conventional levels of statistical significance.”
Quote in the paperNot a substantial claim- Rests on an assumption: The COVID-19 pandemic and the shift to online instruction did not differentially affect the treatment and control groups' persistence and engagement outcomes.
May combine two claims.
Findingown data§ Multivariate Results · p. 12In the full sample, treatment group students were 1.48 times more likely to persist using the college's definition of persistence than control group students, equating to a 95% probability of persistence for treatment vs 93% for control.
“Students who were in the treatment group in the full sample were 1.48 times more likely to persist when using the college's definition of persistence, which equates to a 95% probability that a student in the treatment group will persist compared to a 93% probability that a student will persist in the control group.”
Quote in the paperSubstantial claim- Rests on an assumption: The COVID-19 pandemic and the shift to online instruction did not differentially affect the treatment and control groups' persistence and engagement outcomes.
May combine two claims.
Findingreasoning§ Discussion and Conclusions · p. 16The difference-in-difference results were not statistically significant, perhaps in part because of reduced sample size.
“Again, the results were not statistically significant, perhaps in part, because of the reduction in sample size.”
Quote in the paperNot a substantial claimMay combine two claims.
Findingown data§ Bivariate Results · p. 11There was evidence of statistically significant differences in engagement with the college by students in the treatment and control groups with (1) student ambassador applications and (2) meeting with an academic advisor.
“Turning to our measures of engagement, there was evidence of statistically significant differences in engagement with the college by students in the treatment and control groups with (1) student ambassador applications and (2) meeting with an academic advisor.”
Quote in the paperNot a substantial claim- Rests on an assumption: The COVID-19 pandemic and the shift to online instruction did not differentially affect the treatment and control groups' persistence and engagement outcomes.
May combine two claims.
Findingown data§ Multivariate Results · p. 12Treatment group students with fewer than 60 credit hours were 2.09 times more likely to persist within the college than otherwise similar control students, equating to a 6 percentage point gain.
“These treatment group students, those who have fewer than 60 credit hours, were 2.13 times more likely to persist at the university and 2.09 times more likely to persist within the college than otherwise similar students in the control group.”
- Also stated in: § Multivariate Results · p. 12 · plain
“These odds ratios equate to 5% point gain in persistence at the university and a 6% point gain for persistence in the college, respectively, for those in the freshman/sophomore treatment group.”
Quote in the paperSubstantial claim- Rests on an assumption: The COVID-19 pandemic and the shift to online instruction did not differentially affect the treatment and control groups' persistence and engagement outcomes.
- Also stated in: § Multivariate Results · p. 12 · plain
May combine two claims.
Findingown data§ Discussion and Conclusions · p. 15In fall 2019 the engagement rate after the first text was 9.1%, while it was 28.3% in spring 2020.
“In fall 2019 the engagement rate after the first text was 9.1%, while it was 28.3% in spring 2020.”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.
Premisecitation§ Literature Review · p. 4Advisors were initially hesitant to add another form of communication to their already growing caseloads, but they eventually became supportive of the program after seeing its impact on students.
“Tippetts, et al. (2021) finds advisors were initially hesitant to add another form of communication to their already growing caseloads, but they eventually became supportive of the program after seeing its impact on students.”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites Tippetts, et al. (2021) source
May combine two claims.
Premisecitation§ Introduction · p. 2Student time constraints coupled with high advisor-to-advisee ratios means students may struggle to find open appointments to address time sensitive matters.
“Student time constraints coupled with high advisor-to-advisee ratios means students may struggle to find open appointments to address time sensitive matters (Tuttle, 2000).”
Quote in the paperSubstantial claim0 of 1 sources checked- cites Tuttle, 2000 source
Probably not a substantial claim: may not pass S3 (load-bearing).
Premisecitation§ Literature Review · p. 4The most significant impact of a text messaging campaign to reduce summer melt in newly graduated high school students was seen when they and/or their parents engaged with the counselor by responding to one or more texts throughout the summer.
“Castleman and Page (2015, 2017) discovered the most significant impact of a text messaging campaign to reduce summer melt in newly graduated high school students was seen when they and/or their parents engaged with the counselor by responding to one or more texts throughout the summer.”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites Castleman and Page (2015, 2017)
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
Probably not a substantial claim: may not pass S3 (load-bearing).
Premisecitation§ Literature Review · p. 4Text messaging may aid advisors in time management by reducing the need for one-on-one appointments, as advisor-to-advisee ratios continue to rise.
“Additionally, text messaging may aid advisors in time management by reducing the need for one-on-one appointments, as advisor-to-advisee ratios continue to rise (Tippetts, et al., 2021; Tuttle, 2000).”
Quote in the paperNot a substantial claim0 of 2 sources checkedProbably not a substantial claim: may not pass S3 (load-bearing).
Premisecitation§ Introduction · p. 2Theory suggests one key to persistence and student success is the student's ability to navigate their new environment and integrate themselves into campus and academic life.
“Theory suggests one key to persistence and student success is the student's ability to navigate their new environment and integrate themselves into campus and academic life (Tinto 2015, 2017).”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites Tinto 2015, 2017
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
Probably not a substantial claim: may not pass S3 (load-bearing).
Interpretationreasoning§ Literature Review · p. 4In the case of nudging students, recommendations from academic advisors would typically be viewed positively by students because advisors are viewed as promoting what is in the best interest of students.
“This suggests in the case of nudging students, recommendations from academic advisors would typically be viewed positively by students because advisors are viewed as promoting what is in the best interest of students.”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S3 (load-bearing).
Study design and conductown data§ Discussion and Conclusions · p. 16A difference-in-difference analysis using spring 2019 data for majors registered both terms was conducted to adjust for unmeasured, unchanging predispositions.
“We also reached back to the spring 2019 semester to get data on the subset of students who were majors in the college and registered both terms to undertake a difference-in-difference analysis that adjusts for unmeasured, unchanging predispositions.”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S3 (load-bearing).
Study design and conductown data§ Bivariate Results · p. 12Tests for multicollinearity among the covariates in the logistic regressions revealed no causes of concern.
“Tests for multicollinearity among the covariates in our logistic regressions revealed no causes of concern.”
Quote in the paperNot a substantial claimMay combine two claims.
Premisecitation§ Discussion and Conclusions · p. 16Opt-out approaches are preferred to opt-in approaches if one is to reach a representative sample, because students who do not see an immediate benefit may differ in their approach to college.
“Fishbane and Fletcher (2019), argue the former approach is preferred if one is to reach a representative sample, as students who do not see an immediate benefit may be different in their approach to college than those who do.”
Quote in the paperSubstantial claim0 of 1 sources checked- cites Fishbane and Fletcher (2019)
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
Probably not a substantial claim: may not pass S3 (load-bearing).
Study design and conductown data§ Bivariate Results · p. 10Students in the treatment group were marginally younger than students in the control group.
“Students in the treatment group were marginally younger than students in the control group.”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S3 (load-bearing).
Study design and conductown data§ Discussion and Conclusions · p. 16The Heckman correction for self-selection was used to account for possible differences between students with and without text-capable phone numbers.
“In one set of analyses, the Heckman correction for self-selection was used to account for possible difference between those in the study who had a text-capable phone number and those who did not.”
Quote in the paperNot a substantial claimClassified as probably not a substantial claim.
Study design and conductreasoning§ The Intervention · p. 9Students who opted out were retained in the treatment group for the analyses under an intent-to-treat approach.
“The students who opted out remain in the treatment group for the purposes of the analyses that follow because there was an intent to treat them.”
Quote in the paperSubstantial claimMay combine two claims.
Study design and conductown data§ Bivariate Results · p. 10Randomization was successful, with only two marginally significant differences between the control and treatment groups.
“Randomization was successful with only two marginally significant differences between the control and treatment groups.”
Quote in the paperSubstantial claimMay combine two claims.
Study design and conductcitation§ Discussion and Conclusions · p. 16The study design required students to opt out rather than opt in to the intervention, which heightened confidence in the results by reducing self-selection.
“Confidence in our results is heightened by the fact that the study design required students to opt out, rather than requiring them to opt in, to the intervention.”
- Also stated in: § Discussion and Conclusions · p. 16 · plain
“Requiring students to opt-out rather than opt-in reduced the opportunity for such self-selection.”
Quote in the paperSubstantial claim0 of 2 sources checked- cites Fishbane and Fletcher (2019)
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
- cites Hanushek et al., 2016 source
- Also stated in: § Discussion and Conclusions · p. 16 · plain
Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.
Study design and conductown data§ The Intervention · p. 9Only 51 students opted out of the texting program over the course of the semester, with the vast majority opting out within the first week or two.
“Only 51 students opted out over the course of the semester with the vast majority of those opting out within the first week or two.”
Quote in the paperNot a substantial claimMay combine two claims.
Study design and conductown data§ Discussion and Conclusions · p. 15The study followed students for only one semester, so it could not assess the impact of texting on engagement over an extended period or persistence to graduation.
“Second, the study only followed students for one semester. As such, we were unable to assess the impact of texting on (1) engagement over an extended period of time, or (2) persistence to graduation.”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S2 (checkable), S3 (load-bearing), S4 (based).
Study design and conductnone given§ Discussion and Conclusions · p. 17The research design utilized best practices in constructing regular, proactive, and personalized messages.
“Our research design utilized best practices in constructing regular, proactive, and personalized messages.”
Quote in the paperNot a substantial claimClassified as probably not a substantial claim. May combine two claims.
Study design and conductnone given§ Discussion and Conclusions · p. 16The study was conducted during the spring semester of 2020, when approximately halfway through the semester students, faculty, and staff transitioned to remote learning.
“This study was conducted during the spring semester of 2020. Appromixately half-way through the semester, students, faculty, and staff transistioned to remote learning.”
Quote in the paperSubstantial claimClassified as probably not a substantial claim.
Premisecitation§ Discussion and Conclusions · p. 17Recent research shows students who change majors multiple times in their academic careers are more likely to take longer to graduate.
“Recent research shows students who change majors multiple times in their academic careers are more likely to take longer to graduate (Abdou, 2019; Bullock, 2017).”
Quote in the paperSubstantial claim0 of 2 sources checked- cites Abdou, 2019
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
- cites Bullock, 2017
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
May combine two claims.
Interpretationreasoning§ Discussion and Conclusions · p. 17The results suggest an added benefit of texting may be that it reduces a student's likelihood of switching majors, which in turn may promote more timely graduation.
“Our results suggest an added benefit of texting may be that it reduces a student's likelihood of switching majors which in turn may promote more timely graduation.”
Quote in the paperSubstantial claim
The paper relies on this without support.
Little is known about the effectiveness of randomized field experiment texting interventions in the general student population.
“While a number of randomized field experiment (RFE) texting interventions have been undertaken with targeted populations (e.g., entering freshmen who have been identified as being at high risk for non-persistence), little is known about the effectiveness of such interventions in the general student population.”
The paper relies on this without support.
Little attention has been paid to the advisor's experience with text messaging interventions.
“However, little attention has been paid to the advisor's experience.”
The paper relies on this without support.
Only a few studies assess the impact of text messaging interventions on student persistence.
“Only a few studies assess the impact of text messaging interventions on student persistence.”
The paper relies on this without support.
Texting has the potential to deliver key information from advisors in a manner that is more likely to be read by students.
“In this context, texting has been identified as a communication mode that has the potential to deliver key information from advisors in a manner that is more likely to be read by students.”
The paper relies on this without support.
The COVID-19 pandemic and the shift to online instruction did not differentially affect the treatment and control groups' persistence and engagement outcomes.
“The RFE during spring semester 2020 coincided with the beginning of the COVID-19 pandemic. In the middle of March, the university moved all classes to an online delivery mode.”
The paper relies on this without support.
Building a relationship between students and their major advisor early has clear benefits for helping students navigate their major requirements and persist to the following semester.
“Building a relationship between students and their major advisor early has clear benefits to helping students navigate their major requirements to ensure they make it to the following semester.”
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
Each contradiction between two passages listed here was confirmed by an independent check.
Bivariate college-persistence significance is overstated
MajorThe prose claims p < 0.05 for the overall treatment-control difference. Table 1 marks that comparison with a single asterisk, which its legend defines as p < 0.10, and reports a chi-square value of 3.25.
“Students in the treatment group were significantly more likely to persist to the end of the semester and stay in a major with the college (p < 0.05)”
“| College persistence | 92.63 | 90.78 | 93.25 | 3.25* |”
Treatment-group college persistence differs from Table 1
MajorThe bivariate results report 93.86% for the treatment group, whereas Table 1 reports 93.25%.
“93.86% of the treatment group persisting to the end of the semester using the college's definition of persistence.”
“| College persistence | 92.63 | 90.78 | 93.25 | 3.25* |”
Treatment-group university persistence differs from Table 1
MajorThe bivariate results report 96.07% for the treatment group, whereas Table 1 reports 95.86%.
“94.47% of the control group and 96.07% of the treatment group persisted”
“| University persistence | 95.51 | 94.47 | 95.86 | 1.66 |”
University graduation rate is reported as both 70% and 62%
MinorThe setting section gives two different six-year graduation rates for the university without distinguishing the populations or periods they cover.
“The university has a 67% acceptance rate and a 6-year graduation rate of 70%”
“the university's 6-year graduation rate of 62%”
Number of treatment students who responded to texts differs
MinorThe narrative reports 851 treatment students responding to at least one text, while both the treatment-group footnote and Table 6 report 902.
“Approximately 61% (i.e., 851 students) of treatment group students responded to at least one text message at some point during the semester.”
“| Variable | Responded to zero text messages (N = 549) | Responded to ≥ 1 text message (N = 902) | u1D712 2 |”
Underclass control-group college persistence is misstated
MinorThe discussion of Table 2 says 87% of underclass control students persisted within the college, but the table reports 84.74%. This changes the stated size of the treatment-control gap.
“91% of students in the treatment group and 87% of students in the control group persisted to the end of the semester (p < 0.05).”
“| College persistence | 91.54 | 84.74 | 7.50** | 94.59 | 94.63 | 0.00 |”
Cites
Nudge: improving decisions about health, wealth, and happiness
(2008) · Choice Reviews Online · doi:10.5860/choice.46-0977 · Cited by 11,614 · see citing works
Unmasking the Effects of Student Engagement on First-Year College Grades and Persistence
Kuh, G. D., Cruce, T. M., Shoup, R., Kinzie, J., & Gonyea, R. M. (2008) · The Journal of Higher Education · doi:10.1080/00221546.2008.11772116 · Cited by 1,840 · see citing works
A national experiment reveals where a growth mindset improves achievement
Yeager, D. S., Hanselman, P., Walton, G. M., Murray, J. S., Crosnoe, R., Muller, C., Tipton, E., Schneider, B., Hulleman, C. S., Hinojosa, C. P., et al. (2019) · Nature · doi:10.1038/s41586-019-1466-y · Cited by 1,513 · cited 1× · see citing works
“However, more recent research also identifies non-socioeconomic factors, such as, self-efficacy and a sense of belonging, as significant persistence indicators (Fishbane & Fletcher, 2016; Page et al., 2020; Stewart et al., 2015; Stiles & Wilcox, 2016; Tinto, 2015; Yeager et al., 2019).”
BackgroundPreventing students from dropping out
Astin, A. W. (1975) · Bibliothèque et Archives nationales du Québec (Québec government) · Cited by 1,244 · see citing works
Tinto, V. (2017) · Journal of College Student Retention: Research, Theory & Practice · doi:10.1177/1521025115621917 · Cited by 673 · see citing works
Braking and accelerating of the adolescent brain
Casey, B. J., Jones, R. M., & Somerville, L. H. (2011) · Journal of Research on Adolescence · doi:10.1111/j.1532-7795.2010.00712.x · Cited by 621 · see citing works
Challenges and Opportunities for Improving Community College Student Success
Goldrick‐Rab, S. (2010) · Review of Educational Research · doi:10.3102/0034654310370163 · Cited by 467 · see citing works
Allen, J., Robbins, S. B., Casillas, A., & Oh, I.-S. (2008) · Research in Higher Education · doi:10.1007/s11162-008-9098-3 · Cited by 430 · see citing works
Castleman, B. L., & Page, L. C. (2015) · Journal of Economic Behavior & Organization · doi:10.1016/j.jebo.2014.12.008 · Cited by 403 · see citing works
Reflections on Student Persistence
Tinto, V. (2017) · Student Success · doi:10.5204/ssj.v8i2.376 · Cited by 315 · see citing works
The Effects of Student Coaching
Bettinger, E., & Baker, R. B. (2013) · Educational Evaluation and Policy Analysis · doi:10.3102/0162373713500523 · Cited by 307 · see citing works
Aljohani, O. (2016) · Higher Education Studies · doi:10.5539/hes.v6n2p1 · Cited by 274 · see citing works
Freshman Year Financial Aid Nudges: An Experiment to Increase FAFSA Renewal and College Persistence
Castleman, B., & Page, L. C. (2015) · The Journal of Human Resources · doi:10.3368/jhr.51.2.0614-6458r · Cited by 222 · see citing works
Davidson, W. B., Beck, H. P., & Milligan, M. (2009) · Journal of college student development · doi:10.1353/csd.0.0079 · Cited by 219 · see citing works
Wang, X. (2009) · Research in Higher Education · doi:10.1007/s11162-009-9133-z · Cited by 212 · see citing works
Theorising student engagement in higher education
Kahn, P. E. (2014) · British Educational Research Journal · doi:10.1002/berj.3121 · Cited by 197 · see citing works
The Social Prerequisites of Success: Can College Structure Reduce the Need for Social Know-How?
Deil‐Amen, R., & Rosenbaum, J. E. (2003) · The Annals of the American Academy of Political and Social Science · doi:10.1177/0002716202250216 · Cited by 164 · see citing works
Left to Their Own Devices: College Students’ “Guilty Pleasure” Media Use and Time Management
Panek, E. (2014) · Communication Research · doi:10.1177/0093650213499657 · Cited by 144 · see citing works
How an Artificially Intelligent Virtual Assistant Helps Students Navigate the Road to College
Page, L. C., & Gehlbach, H. (2017) · AERA Open · doi:10.1177/2332858417749220 · Cited by 143 · see citing works
Factors Influencing College Persistence for First-Time Students.
Stewart, S., Lim, D. H., & Kim, J. (2015) · Journal of developmental education · Cited by 131 · see citing works
A Practitioner's Guide to NudgingPreprint
Ly, K., Mažar, N., Zhao, M., et al. (2015) · SSRN Electronic Journal · doi:10.2139/ssrn.2609347 · Cited by 122 · see citing works
Correlates of Retention for African-American Males in Community Colleges
Hagedorn, L. S., Maxwell, W. E., & Hampton, P. (2001) · Journal of College Student Retention Research Theory & Practice · doi:10.2190/mj6a-tfac-mrpg-xdkl · Cited by 122 · see citing works
Student Characteristics Related to Persistence for First-Year Community College Students
Hawley, T. H., & Harris, T. A. (2005) · Journal of College Student Retention Research Theory & Practice · doi:10.2190/e99d-v4nt-71vf-83dc · Cited by 103 · see citing works
Student Coaching: How Far Can Technology Go?
Oreopoulos, P., & Petronijevic, U. (2017) · The Journal of Human Resources · doi:10.3368/jhr.53.2.1216-8439r · Cited by 90 · see citing works
College Connectedness: The Student Perspective
Farrell, L. C., Jorgenson, D., Fudge, J., et al. (2018) · Journal of the Scholarship of Teaching and Learning · doi:10.14434/josotl.v18i1.22371 · Cited by 88 · see citing works
Parental Influences on Postsecondary Decision Making: Evidence From a Text Messaging Experiment
Castleman, B., & Page, L. C. (2016) · Educational Evaluation and Policy Analysis · doi:10.3102/0162373716687393 · Cited by 70 · see citing works
A Multilevel Approach to Assessing the Interaction Effects on College Student Retention
Bai, H., & Pan, W. (2009) · Journal of College Student Retention Research Theory & Practice · doi:10.2190/cs.11.2.g · Cited by 58 · see citing works
Stone, A. (2004) · IEEE International Conference on Advanced Learning Technologies (ICALT) · doi:10.1109/icalt.2004.1357446 · Cited by 53 · see citing works
Castleman, B., & Meyer, K. E. (2020) · Review of higher education/The review of higher education · doi:10.1353/rhe.2020.0015 · Cited by 52 · see citing works
Boyd, N. M., Liu, X., & Horissian, K. (2020) · Journal of College Student Retention Research Theory & Practice · doi:10.1177/1521025120916433 · Cited by 49 · see citing works
Choice architecture 2.0: Behavioral policy as an implicit social interaction
Krijnen, J. M. T., Tannenbaum, D., & Fox, C. R. (2017) · Behavioral Science & Policy · doi:10.1353/bsp.2017.0010 · Cited by 46 · see citing works
Whitten, D., James, A., & Roberts, C. S. (2017) · Journal of College Student Retention Research Theory & Practice · doi:10.1177/1521025117726520 · Cited by 41 · see citing works
Tuttle, K. N. (2000) · New Directions for Higher Education · doi:10.1002/he.11102 · Cited by 40 · see citing works
Low-Touch Attempts to Improve Time Management among Traditional and Online College Students
Oreopoulos, P., Patterson, R. W., Petronijevic, U., et al. (2019) · The Journal of Human Resources · doi:10.3368/jhr.57.1.0919-10426r1 · Cited by 39 · see citing works
Schwebel, D. C., Walburn, N. C., Jacobsen, S. H., et al. (2008) · NACADA Journal · doi:10.12930/0271-9517-28.2.28 · Cited by 38 · see citing works
Choice Architecture 2.0: Behavioral Policy as an Implicit Social Interaction
Krijnen, J. M. T., Tannenbaum, D., & Fox, C. R. (2017) · Behavioral Science & Policy · doi:10.1177/237946151700300202 · Cited by 37 · see citing works
How an Artificially Intelligent Virtual Assistant Helps Students Navigate the Road to CollegePreprint
Page, L. C., & Gehlbach, H. (2017) · SSRN Electronic Journal · doi:10.2139/ssrn.2940297 · Cited by 30 · see citing works
Promoting Persistence: The Role of Academic Advisors
Tippetts, M. M., Brandley, A. T., Metro, J., King, M., Ogren, C., & Zick, C. D. (2022) · Journal of College Student Retention: Research, Theory & Practice · doi:10.1177/1521025120924804 · Cited by 28 · see citing works
Self-citationInstitutional Characteristics and Student Retention in Public 4-Year Colleges and Universities
Marsh, G. B. (2014) · Journal of College Student Retention Research Theory & Practice · doi:10.2190/cs.16.1.g · Cited by 25 · see citing works
Don't go with the ‘FLO’ – a student mobile texting service to enhance nursing student retention
Boath, E., Jinks, A., Thomas, N., Thompson, R., Evans, J., O’Connell, P., & Taylor, L. (2016) · Nurse Education Today · doi:10.1016/j.nedt.2016.06.019 · Cited by 20 · see citing works
Conditions under which college students can be responsive to nudging
Page, L. C., Lee, J. J., & Gehlbach, H. (2020) · Brown Digital Repository · doi:10.26300/vjfs-kv29 · Cited by 14 · see citing works
Goal Setting, Academic Reminders, and College Success: A Large-Scale Field Experiment
Dobronyi, C., Oreopoulos, P., & Petronijevic, U. (2017) · National Bureau of Economic Research · doi:10.3386/w23738 · Cited by 11 · see citing works
Castleman, B. (2015) · Johns Hopkins University Press eBooks · doi:10.1353/book.72248 · Cited by 11 · see citing works
Texting as an Advising Communication Tool: A Case Study of Receptivity and Resistance
Tippetts, M. M., Davis, B., & Zick, C. D. (2021) · Journal of College Student Retention Research Theory & Practice · doi:10.1177/15210251211033549 · Cited by 5 · see citing works
Self-citation(2020) · ScholarWorks - WMU (Western Michigan University) · Cited by 2 · see citing works
(2008) · doi:10.15695/hmltc.v33i2.3307 · Cited by 1
Hanushek, E. A., Machin, S., & Woessmann, L. (2016) · Handbook of the Economics of Education · doi:10.1016/b978-0-444-63459-7.10000-4 · Cited by 1
Kot, F. C. (2014) · Research in Higher Education · doi:10.1007/s11162-013-9325-4
Parental Influences on Postsecondary Decision-Making: Evidence from a Text Messaging Experiment
Castleman, B. (2016) · SSRN Electronic Journal · doi:10.2139/ssrn.2778080
Flagged first, then by citations
1 of the 50 references couldn’t be matched to a known paper.
Research works printed but not linked: 9
- Abdou, N. W. (2019) Predictors of four-year graduation rates: A quantitative study on the impact of enrollment in major related course, student engagement, and student-faculty interactions on graduation rates of first-time student. Dissertation, California State Univerity, Fullteron.
- Bullock, C. D. (2017) Factors that influence graduation efficiency of baccalaureate recipients at Weber State University. Doctoral dissertation. University of Utah.
- Castleman, B. L., & Page, L. C. (2015). Summer nudging: Can personalized text messages and peer mentor outreach increase college going among low-income high school graduates? Journal of Economic Behavior & Organization, 115, 114–160. https://doi.org/10.1016/j.jebo.2014.12.008 · DOI · Paper page
- Castleman, B. L., & Page, L. C. (2016a). Can text messages mitigate summer melt? New England Journal of Higher Education.
- Corbett, C., Hill, C., & Rose, A. S. (2008). Where the girls are: The facts about gender equality in education. American Association of University Women Education Foundation.
- Selingo, J. J. (2018). The new generation of students: How colleges can recruit, teach, and serve Gen Z. The Chronicle of Higher Education.
- Snyder, T. D., Brey, C. D., & Dillow, S. A. (2019). Digest of education statistics 2018 (NCES 2020-009). National Center for Education Statistics, Institute of Education Services, U.S. Department of Education.
- Stiles, R. J., & Wilcox, K. (2016). Blending human intelligence and analytics for student success. Journal of Educause Learning Initiative.
- Tough, P. (2019). The years that matter most: How college makes or breaks us. Houghton Mifflin Harcourt.
Cited by
Sorted by citations
Data-driven digital nudging: a systematic literature review and future agenda
Sadeghian, A. H., & Otarkhani, A. (2023) · Behaviour and Information Technology · doi:10.1080/0144929x.2023.2286535 · Cited by 56 · see citing works
Texting as an Advising Communication Tool: A Case Study of Receptivity and Resistance
Tippetts, M. M., Davis, B., & Zick, C. D. (2021) · Journal of College Student Retention Research Theory & Practice · doi:10.1177/15210251211033549 · Cited by 5 · see citing works
Self-citationMoney Well Spent? The Cost-Effectiveness of a Texting Intervention Targeting College Persistence
Zick, C. D., Tippetts, M. M., & Davis, B. (2022) · Journal of Research on Educational Effectiveness · doi:10.1080/19345747.2021.1992813 · Cited by 2 · see citing works
Self-citationParents’ utilisation of the literacy-based text message program Kindytxt
Binns, A. V. (2025) · Journal of Early Childhood Literacy · doi:10.1177/14687984251370974 · Cited by 1 · see citing works
“Text (Castleman and Meyer, 2020; Tippetts et al., 2022).”
Cain, J. J., Behal, M. L., & Richter, L. M. (2024) · American Journal of Pharmaceutical Education · doi:10.1016/j.ajpe.2024.100732 · Cited by 1 · see citing works
Texting: A Meaningful Option to Connect with Nursing Students
Yocom, D. (2025) · Teaching and learning in nursing · doi:10.1016/j.teln.2025.06.011
Improving Medical Student Engagement Using Text Messaging: An Applied Improvement Project
Youngs, M. (2025) · Creative Education · doi:10.4236/ce.2025.169089
Left unread: how message orientation shapes engagement in adaptive nudging systems
Boitcov, M., Васильевна, К. А., Al-Safi, H., & Vinogradov, N. (2026) · Interactive Learning Environments · doi:10.1080/10494820.2026.2628260
LANSE-MIRA: Módulo de Intervenções para Retenção Acadêmica
Ramos, V. F. C., Cechinel, C., Targino, R., et al. (2025) · doi:10.5753/wapla.2025.15927
“Nessa mesma linha de investigac¸˜oes em larga escala, o estudo de [Tippetts et al. 2022] avaliou a intervenc¸˜ao de mensagens de texto em larga escala, vi-sando `a retenc¸˜ao de alunos de graduac¸˜ao por meio de mensagens personalizadas e condu-zidas por orientadores.”
Email Overload: Rethinking University Communication with At-Promise Students
Corwin, Z. B., Nagbe, M., Goodburn, A. M., et al. (2026) · NASPA Journal · doi:10.1080/19496591.2026.2639502
Moss, B. G. (2026) · Evaluation Review · doi:10.1177/0193841x261472564
- Authors
- Tippetts, M. M., Davis, B., Nalbone, S., & Zick, C. D.
- Affiliations
- University of Utah (US)
- Corresponding author
- Tippetts, Megan M.
- Venue
- Research in Higher Education
- Published
- 2022-02-16
- Volume
- 63
- Issue
- 6
- Pages
- 1073-1093
- ISSN
- 0361-0365 (ISSN-L)
- 1573-188X
- PMC
- PMC8853065
- OpenAlex
- W4213426234
- Semantic Scholar
- aa2e3dce86072b332f0cc8dfca5e675514266dc8
- Cited by
- 11
- References
- 50
- Citations by year
- 2026: 3 · 2025: 4 · 2024: 1 · 2023: 1 · 2022: 1 · 2021: 1
- FWCI
- 3.70
- Type
- journal article
- Language
- en
- Open access
- bronze
- doi.org
- Licence
- Locations
- Research in Higher Education (publishedVersion)
- PubMed (publishedVersion)
- PubMed Central (submittedVersion)
- RePEc: Research Papers in Economics (submittedVersion)
- Topics
- Social Sciences › Education › Higher Education Research Studies
- Social Sciences › Demography › Evasion and Academic Success Factors
- Physical Sciences › Computer Science › Information Systems › Mobile Learning in Education
- Keywords
- text messaging, student persistence, student engagement, academic advising, nudging, behavioral economics, personalized communication, student ambassadors, college completion
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Claims read by deepseek-v4.1-flash under definition version 3 (extract-v3) on 2026-10-12.
Classified by jev-1.13-20260917 (gold-guideline-v0.2) on 2026-10-12.
Cited sources are checked by gpt-6-sol.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review