Generative AI: reconfiguring supervision and doctoral research

May combine two claims.

Academic discussion around the use of GenAI centres largely around concerns of plagiarism and poor academic practice, with some debate around considerations of bias and reliability and accuracy of outputs, although its use and impacts in higher education are gaining traction for pedagogic research agendas.

“Academic discussion around the use of GenAI centres largely around concerns of plagiarism and poor academic practice (Huallpa 2023), with some debate around considerations of bias and reliability and accuracy of outputs (Rane et al. 2023), although its use and impacts in higher education are gaining traction for pedagogic research agendas.”

• cites Huallpa 2023 sourcePartly supported

  Split into 2 atoms — 0 confirmed, 2 partially supported, 0 disputed, 0 misattributed, 0 unverifiable. Expand the claim to see per-atom verdicts.

  Experimental — accuracy not yet measured
• cites Rane et al. 2023Not matched

  Couldn’t be matched to a paper in Crossref, so it can’t be checked.

May combine two claims.

There is evidence from the research that doctoral researchers are filling this gap with GenAI-particularly ChatGPT and that the enrolment of this surrogate mentor is largely covert.

“There is evidence from the research that doctoral researchers are filling this gap with GenAI-particularly ChatGPTand that the enrolment of this surrogate mentor is largely covert.”

• AssumptionRests on an assumption: Before the advent of GenAI, it was not unusual for doctoral researchers to enlist external coaching and mentoring support to spare embarrassment and translate supervisors' technical demands-either informally (social networks) or formally (paid coaches).

Probably not a substantial claim: may not pass S3 (load-bearing).

Supervisors could see the value in using GenAI to develop student reflexive knowledge.

“Supervisors could see the value in using GenAI to develop student reflexive knowledge:”

Probably not a substantial claim: may not pass S3 (load-bearing).

Concerns around supervisors' ability to give feedback and comment at the right level arose.

“This gave rise to concerns around their ability to give feedback and comment at the right level:”

Probably not a substantial claim: may not pass S2 (checkable).

The findings reflect an understanding by participants of the changing landscape of academic practices in the age of GenAI.

“The findings reflect an understanding by participants of the changing landscape of academic practices in the age of GenAI.”

May combine two claims.

Unspoken rules around the use of GenAI led to confusion and its covert use.

“Unspoken rules around the use of GenAI led to confusion and its covert use:”

Probably not a substantial claim: may not pass S3 (load-bearing).

In the diarised study the researcher interrogated ChatGPT relentlessly and systematically to understand concepts and terms and to internalise their understanding.

“In the diarised study the researcher interrogated ChatGPT relentlessly and systematically to understand concepts and terms and to internalise their understanding.”

May combine two claims.

Academics generally understood how GenAI could help students communicate their work, and so benefit more from input during supervision sessions.

“Academics generally understood how GenAI could help students communicate their work, and so benefit more from input during supervision sessions, but were cautious in knowing how to understand the true level of their student's understanding:”

May combine two claims.

Researchers were very concerned about breaching trust and being caught.

“Researchers were very concerned about breaching trust and being caught.”

Classified as probably not a substantial claim. May combine two claims.

Doctoral researchers and their supervisors express apprehension about an overreliance on GenAI, fearing it may risk data security and academic integrity, with a concern about the effect of GenAI on developing the authentic voice of the researcher.

“Doctoral researchers and their supervisors express apprehension about an overreliance on GenAI, fearing it may risk data security and academic integrity, with a concern about the effect of GenAI on developing the authentic voice of the researcher.”

Probably not a substantial claim: may not pass S3 (load-bearing).

Supervisors were secure in believing in their researchers' integrity (which usually meant not using GenAI).

“Supervisors were secure in believing in their researchers' integrity (which usually meant not using GenAI), although one academic was clear about dealing with breaches in integrity:”

Probably not a substantial claim: may not pass S3 (load-bearing).

The diarised case's interaction with ChatGPT alleviated the isolation experienced in PhD studies.

“This interaction also alleviated the isolation I experienced in PhD studies.”

Probably not a substantial claim: may not pass S3 (load-bearing), S4 (based).

Reported adoption of GenAI tools is surprisingly patchy.

“GenAI tools can be used to streamline literature reviews, refine drafts, synthesise data, and correct grammar and syntax, but reported adoption of these tools is surprisingly patchy.”

Probably not a substantial claim: may not pass S3 (load-bearing).

Academics recognised the need for different styles of supervision dependant on their student's needs.

“Academics recognised the need for different styles of supervision dependant on their student's needs:”

May combine two claims.

Trust was often spoken about-both personal trust in the integrity of the relationship and mistrust of the data generated by GenAI.

“Trust was often spoken about-both personal trust in the integrity of the relationship and mistrust of the data generated by GenAI.”

Probably not a substantial claim: may not pass S3 (load-bearing).

Participants raised the need for clear policies and guidelines to ensure the responsible use of GenAI in research.

“Participants raised the need for clear policies and guidelines to ensure the responsible use of GenAI in research.”

May combine two claims.

Most participants tended to refer to GenAI in a dismissive and negative context and had not encouraged its use.

“Most participants tended to refer to GenAI in a dismissive and negative context and had not encouraged its use, but admitted to being under-informed about GenAI and its capabilities.”

May combine two claims.

Doctoral researchers relied on supervisors to lead the development for their reflexive knowledge, but were also committed to developing their own fund of knowledge through traditional research methods.

“Doctoral researchers relied on supervisors to lead the development for their reflexive knowledge, but were also committed to developing their own fund of knowledge through traditional research methods.”

Probably not a substantial claim: may not pass S3 (load-bearing).

Some doctoral researchers acknowledged that GenAI might play a role in pushing work further and faster by improving the quality of researcher-supervisor interactions.

“Some doctoral researchers acknowledged that GenAI might play a role in pushing work further and faster by improving the quality of researcher-supervisor interactions.”

Classified as probably not a substantial claim. May combine two claims.

Three key themes emerged from the research: the influence of GenAI tools on relationships; the influence of GenAI on practices and processes; and ethical considerations and challenges.

“Three key themes emerged from the research: the influence of GenAI tools on relationships; the influence of GenAI on practices and processes; and ethical considerations and challenges:”

Probably not a substantial claim: may not pass S4 (based).

The starting point for this research was that the use of GenAI in research is at present largely hidden.

“The starting point for this research was that the use of generative artificial intelligence (GenAI) in research is at present largely hidden-and this rather covert situation feeds confusion and mistrust, rather than bringing into the open the many concerns felt by institutions, academics and doctoral researchers.”

Classified as probably not a substantial claim. May combine two claims.

Institutions are rolling out guidance and procedures to cover their teaching practices and requirements, but there remains little guidance on this technology.

“Institutions are rolling out guidance and procedures to cover their teaching practices and requirements, but there remains little guidance on this technology.”

May combine two claims.

The data-collection process revealed cases in which GenAI was actively integrated into workflows, enhancing collaboration and transparency.

“Conversely, it revealed cases in which GenAI was actively integrated into workflows, enhancing collaboration and transparency.”

Probably not a substantial claim: may not pass S3 (load-bearing).

Doctoral researchers generally found the ability to communicate their knowledge as a hurdle in their supervisory relationships.

“Doctoral researchers generally found the ability to communicate their knowledge as a hurdle in their supervisory relationships.”

May combine two claims.

All except two of the student respondents reported that they used GenAI tools, with most using two or three of the classification types, with the majority using ChatGPT-type tools.

“All except two of the student respondents reported that they used GenAI tools, with most using two or three of the classification types, with the majority using ChatGPT Boyd and Harding Buildings and Cities DOI: 10.5334/bc.560type tools.”

May combine two claims.

Doctoral researchers ascribed clear meanings to supervision relationships and to some extent were comfortable (or at least resigned) with the time-pressured nature of these relationships.

“Doctoral researchers ascribed clear meanings to supervision relationships and to some extent were comfortable (or at least resigned) with the time-pressured nature of these relationships.”

Probably not a substantial claim: may not pass S2 (checkable).

Its uses in this study do show where doctoral researchers need those human qualities the most.

“However, its uses in this study do show where doctoral researchers need those human qualities the most.”

May combine two claims.

Students perceived power relationships within the supervision process as significant-with supervisors setting standards, asking difficult questions and having a knowledge base far exceeding that of the student.

“Students perceived power relationships within the supervision process as significant-with supervisors setting standards, asking difficult questions and having a knowledge base far exceeding that of the student.”

Probably not a substantial claim: may not pass S3 (load-bearing).

There was a cautious acceptance and recognition that GenAI may be a tool that can improve the process.

“There was a cautious acceptance and recognition that GenAI may be a tool that can improve the process:”

Probably not a substantial claim: may not pass S3 (load-bearing).

Supervisors acknowledged that students found it difficult to become independent thinkers in unfamiliar areas.

“Supervisors acknowledged their role in developing doctoral researchers' reflexive knowledge, but acknowledged too that students found it difficult to become independent thinkers in unfamiliar areas.”

Probably not a substantial claim: may not pass S3 (load-bearing).

Academics pointed to a broader hesitation within the academic community about discussing or leveraging GenAI for more complex tasks due to stigma associated with its use.

“Academics also pointed to a broader hesitation within the academic community about discussing or leveraging GenAI for more complex tasks due to stigma associated with its use.”

Probably not a substantial claim: may not pass S3 (load-bearing).

There was some recognition that the use of GenAI tools might affect both the relationship and the supervisory relationship.

“There was some recognition that the use of GenAI tools might affect both the relationship and the supervisory relationship:”

May combine two claims.

The research exposes an unacknowledged proliferation of GenAI use in doctoral research and its underlying role in providing surrogate emotional support to doctoral students.

“The research exposes an unacknowledged proliferation of GenAI use in doctoral research and its underlying role in providing surrogate emotional support to doctoral students.”

• AssumptionThe authors state this as an assumption: The use of GenAI in research is at present largely hidden, and this covert situation feeds confusion and mistrust, rather than bringing into the open the issues and challenges arising from the adoption of this technology.

Probably not a substantial claim: may not pass S3 (load-bearing).

There were clear advocates of students using GenAI tools to help develop their discursive knowledge.

“There were clear advocates of students using GenAI tools to help develop their discursive knowledge:”

Classified as probably not a substantial claim.

Academics were concerned that the use of GenAI might break the existing internalised norms and rules surrounding research and relationships.

“Academics were concerned that the use of GenAI might break the existing internalised norms and rules surrounding research and relationships.”

Probably not a substantial claim: may not pass S3 (load-bearing).

Supervisors articulated the view that GenAI could take away the researcher's voice and so affect their student's future publication potential.

“Supervisors articulated the view that GenAI could take away the researcher's voice and so affect their student's future publication potential.”

May combine two claims.

In most cases, GenAI was not seen to fit within this meaning, and it was cast as an untrustworthy interloper.

“In most cases, GenAI was not seen to fit within this meaning, and it was cast as an untrustworthy interloper.”

May combine two claims.

The data-collection process captured instances where GenAI's contributions were unacknowledged, subtly shifting relational dynamics and processes.

“The data-collection process captured instances where GenAI's contributions were unacknowledged, subtly shifting relational dynamics and processes.”

Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

Fear and trust were mentioned as part of the power dynamic, with trust forming a key part of the dynamic.

“Fear and trust were also mentioned as part of this power dynamic, with trust forming a key part of the dynamic:”

Probably not a substantial claim: may not pass S3 (load-bearing).

Academics acknowledged how guiding students to using GenAI could save time in transmitting often repetitive terms and basic knowledge and terms.

“Academics also acknowledged how guiding students to using GenAI could save time in transmitting often repetitive terms and basic knowledge and terms:”

Probably not a substantial claim: may not pass S3 (load-bearing).

ChatGPT served as a digital interlocutor, aiding in the conceptualisation and refinement of the diarised case's research focus.

“ChatGPT served as a digital interlocutor, aiding in the conceptualisation and refinement of my research focus.”

May combine two claims.

All responding supervisors responded that they used multiple GenAI classification types, with the majority using ChatGPT-type tools.

“All responding supervisors responded that they used multiple GenAI classification types, with the majority using ChatGPT-type tools.”

May combine two claims.

Participants voiced their general trust in their doctoral researchers' integrity and judgement regarding self-policing in the use of GenAI, although there were some more cautious voices.

“Interestingly, participants voiced their general trust in their doctoral researchers' integrity and judgement regarding self-policing in the use of GenAI, although there were some more cautious voices:”

Classified as probably not a substantial claim. May combine two claims.

Students can be afraid to ask, unsure how to begin or unable to interpret what they have been told.

“It shows that students can be afraid to ask, unsure how to begin or unable to interpret what they have been told.”

Probably not a substantial claim: may not pass S3 (load-bearing).

Academic supervisors emphasised the importance of facilitating growth rather than merely transferring knowledge.

“They emphasised the importance of facilitating growth rather than merely transferring knowledge and were sceptical about GenAI's depth and reliability for facilitating academically rigorous work and critical thinking.”

Classified as probably not a substantial claim. May combine two claims.

These tools can simultaneously enable autonomy and challenge institutional norms, with participants reflecting on the lack of institutional encouragement or regulation of GenAI use.

“These tools can simultaneously enable autonomy and challenge institutional norms, with participants reflecting on the lack of institutional encouragement or regulation of GenAI use.”

Probably not a substantial claim: may not pass S3 (load-bearing), S4 (based). May combine two claims.

Interview participants were much less prepared to discuss their use of GenAI and in general reported to have kept it at a distance.

“Interview participants were much less prepared to discuss their use of GenAI and in general reported to have kept it at a distance.”

May combine two claims.

Fear from academics centred on two aspects: their lack of understanding of the technology and the stigma associated with the use of GenAI from other academics.

“Fear from academics centred on two aspects: their lack of understanding of the technology and the stigma associated with the use of GenAI from other academics.”

Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

GenAI has not been used in this paper-neither in the synthesis of data nor in the development of text. The authors' use of AI was restricted to standard search engines and checks for spelling and grammar.

“GenAI has not been used in this paper-neither in the synthesis of data nor in the development of text.The authors' use of AI was restricted to standard search engines and checks for spelling and grammar.”

Probably not a substantial claim: may not pass S2 (checkable).

If GenAI is shaping academic practice so thoroughly, failing to acknowledge its presence may represent an oversight and an institutional blind spot.

“If GenAI is shaping academic practice so thoroughly, failing to acknowledge its presence may represent an oversight and an institutional blind spot.”

Probably not a substantial claim: may not pass S4 (based). May combine two claims.

Researchers can gain greater independence through using GenAI tools, and this can challenge existing hierarchies.

“Researchers can gain greater independence through using GenAI tools, and this can challenge existing hierarchies.”

Classified as probably not a substantial claim.

The use of GenAI tools has the potential to reshape relationships and power dynamics in doctoral research.

“The use of GenAI tools has the potential to reshape relationships and power dynamics in doctoral research.”

May combine two claims.

When the use of GenAI is unacknowledged, its impact on the student and supervisor relationship becomes very powerful, fostering autonomy but risking the sidelining of relational depth and developmental aspects of supervisory relationships.

“When the use of GenAI is unacknowledged, its impact on the student and supervisor relationship becomes very powerful, fostering autonomy but risking the sidelining of relational depth and developmental aspects of supervisory relationships.”

Classified as probably not a substantial claim. May combine two claims.

They point towards a future where GenAI tools could play a significant role in shaping these practices, but also raise important questions about its effect on relationships and the openness of its use.

“They point towards a future where GenAI tools could play a significant role in shaping these practices, but also raise important questions about its effect on relationships and the openness of its use.”

May combine two claims.

This risks blurring the boundaries between supervisory knowledge and surrogate machine-learning support and could lead to presumed knowledge and imperfect understandings.

“This risks blurring the boundaries between supervisory knowledge and surrogate machine-learning support and could lead to presumed knowledge and imperfect understandings.”

Probably not a substantial claim: may not pass S2 (checkable).

These are signals that GenAI may have a legitimate role to play in supporting supervision practices and doctoral researcher development within the context of a clear, ethical and well-thought-out institutional guidance.

“These are signals that GenAI may have a legitimate role to play in supporting supervision practices and doctoral researcher development within the context of a clear, ethical and well-thought-out institutional guidance.”

• AssumptionRests on an assumption: GenAI cannot offer the mentorship, critical perspective or human warmth of a good supervisor.

Probably not a substantial claim: may not pass S2 (checkable). May combine two claims.

Although this study has a small dataset, and is limited in its scope, it does bring into the open the many concerns felt by academics and doctoral researchers.

“Although this study has a small dataset, and is limited in its scope, it does bring into the open the many concerns felt by academics and doctoral researchers.”

Classified as probably not a substantial claim. May combine two claims.

The research points to key areas of concern in the concealment of GenAI in academia, and shows how doctoral researchers and their supervisors could benefit by collaboration in the open enrolment of GenAI into practice.

“The research points to key areas of concern in the concealment of GenAI in academia, and shows how doctoral researchers and their supervisors could benefit by collaboration in the open enrolment of GenAI into practice.”

Probably not a substantial claim: may not pass S3 (load-bearing), S4 (based).

GenAI tools have the potential to significantly enhance productivity by automating repetitive tasks, allowing users to allocate more time to advanced intellectual or strategic activities.

“GenAI tools have the potential to significantly enhance productivity by automating repetitive tasks, allowing users to allocate more time to advanced intellectual or strategic activities.”

• AssumptionRests on an assumption: GenAI tools can be used to streamline literature reviews, refine drafts, synthesise data, and correct grammar and syntax.

Probably not a substantial claim: may not pass S2 (checkable), S4 (based).

Given that GenAI tools are increasingly targeted to service particular skill sets required by researchers, and that the doctoral supervisory relationship is intricately bound up in developing these skill sets, it seems inevitable that GenAI tools will have an impact on the doctoral research journey and the supervisory relationship.

“Given that these tools are increasingly targeted to service particular skill sets required by researchers, and that the doctoral supervisory relationship is intricately bound up in developing these skill sets, it seems inevitable that GenAI tools will have an impact on the doctoral research journey and the supervisory relationship.”

Classified as probably not a substantial claim.

To balance the single source of data from the diarised case, semi-structured interviews gave a greater range and experiences of the use of GenAI.

“To balance this single source of data, semi-structured interviews gave a greater range and experiences of the use of GenAI.”

Probably not a substantial claim: may not pass S4 (based).

Ethical concerns surrounding originality, accountability and data security underscore the normative structures that guide GenAI's integration.

“Ethical concerns surrounding originality, accountability and data security underscore the normative structures that guide GenAI's integration.”

Probably not a substantial claim: may not pass S4 (based).

This focus omits consideration of its significance to doctoral students in terms of student-supervisor relationships, the development and exchange of knowledge, and its effect on future academic aspects of research publication.

“This focus omits consideration of its significance to doctoral students in terms of student-supervisor relationships, the development and exchange of knowledge, and its effect on future academic aspects of research publication.”

Probably not a substantial claim: may not pass S3 (load-bearing).

The research was granted ethical consent by the University of the Built Environment (number 240307).

“The research was granted ethical consent by the University of the Built Environment (number 240307).”

Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

Both datasets were analysed using the same elements of structuration theory, which gives coherence and structure to both phases of the research.

“Both datasets were analysed using the same elements of structuration theory.This continued use of one theory gives coherence and structure to both phases of the research.”