Keeping the organization in the loop: a socio-technical extension of human-centered artificial intelligence

Probably not a substantial claim: may not pass S2 (checkable).

The idea of keeping society in the loop could apply also to the meso level, i.e., the organization in which AI is applied.

“There is no reason this idea could not apply also to the meso level, i.e., to the organization in which AI is applied.”

• cites Rahwan (2018) sourcePartly supported

  Section 3 (p. 3) introduces society-in-the-loop as a way to embed society’s values in oversight of AI with broad societal implications. It does not propose applying the framework at the meso level of an organization; that extension is the citing author’s inference. (LLM, conf=0.84)

  Experimental — accuracy not yet measured

Probably not a substantial claim: may not pass S3 (load-bearing).

Maintenance workers' knowledge and experience is of widely underappreciated value for the successful introduction of ML-based maintenance systems.

“Furthermore, maintenance workers' knowledge and experience is of widely underappreciated value for the successful introduction of ML-based maintenance systems (Pfeiffer 2020).”

• cites Pfeiffer 2020 sourceSupported

May combine two claims.

There is as yet hardly any reliable data on the use of AI from an organizational perspective; even quantitative data with regard to AI at the firm level is still a clear research lacuna.

“There as yet hardly any reliable data on the use of AI from an organizational perspective; even quantitative data with regard to AI at the”

• cites Seamans and Raj 2018 sourceSupported

May combine two claims.

Performance legitimacy, task legitimacy, and value legitimacy are of particular importance for the successful adaptation of new technologies, and they have to be established and negotiated in organizational practices.

“Performance legitimacy, task legitimacy, and value legitimacy are of particular importance for the successful adaptation of new technologies, they have to be established and negotiated in organizational practices (Ren 2019).”

• cites Ren 2019 sourceSupported

Classified as probably not a substantial claim.

The evaluation of the performance legitimacy of employing AI has to be organized with respect to the effects on O-tasks.

“But again, this evaluation has to be organized with respect to the effects on O-tasks.”

• cites Ren 2019 sourceSupported

Probably not a substantial claim: may not pass S2 (checkable).

To develop an interaction between 4.1 and 4.2, a complementary combination of human and AI strengths is to be pursued.

“To develop an interaction between 4.1 and 4.2, a complementary combination of human and AI strengths is to be pursued (Dellermann et al. 2019;Jarrahi 2018).”

• cites Dellermann et al. 2019 sourceSupported
• cites Jarrahi 2018 sourceNot checked — no full text of the source

May combine two claims.

Some changes result from external factors that include the societal context; others include aspects of inter-organizational collaboration with an ecology of external partners.

“Some changes result from external factors (4a) that include the societal context (Rahwan 2018), others usually include aspects of inter-organizational collaboration (Campion et al. 2020) with an ecology of external partners.”

• cites Rahwan 2018 sourcePartly supported

  Rahwan says broad societal values should guide the monitoring of AI systems (Section 6.1, p. 6), and that public-shaped norms should influence how their performance is measured (Section 7.5, p. 8). This supports societal context as an influence on changes to AI governance, but does not establish the broader claim that changes generally result from external factors. The inter-organizational collaboration clause is attributed to another citation, not Rahwan. (LLM, conf=0.78)

  Experimental — accuracy not yet measured
• cites Campion et al. 2020 sourceSupported

Probably not a substantial claim: may not pass S3 (load-bearing).

The survey method and selection of interviewees in Case B were based on approaches from the German sociology of work tradition.

“The survey method and the selection of the interviewees were based on approaches from the German sociology of work tradition (Pfeiffer et al. 2019).”

• cites Pfeiffer et al. 2019 sourceSupported

May combine two claims.

Organizational practices are needed and shape the use of AI/ML.

“We support this argument with evidence of two case studies in the area of predictive maintenance, by which we show how organizational practices are needed and shape the use of AI/ML.”

• AssumptionThe authors state this as an assumption: For every domain of AI application, activities and the strengths needed to accomplish them have to be analyzed in the context of organizational practices.

May combine two claims.

In Case A, the plant operator was the main addressee of PM notifications, discussions and evaluations of warnings, malfunctions, and false alarms by the PM system, and corresponding reactions were object of team meetings on the shopfloor.

“In this case, the plant operator was the main addressee of PM notifications, discussions and evaluations of warnings, malfunctions, and false alarms by the PM system and according reactions were object of team meetings on the shopfloor.”

Probably not a substantial claim: may not pass S3 (load-bearing).

From the interviews in Case A, 77 specific challenges for PM integration were derived.

“From the interviews 77 specific challenges for PM integration were derived (Herrmann 2020).”

• cites Herrmann 2020 sourceNot checked — no full text of the source

Probably not a substantial claim: may not pass S4 (based). May combine two claims.

At the moment when the PM system issues a notification, an employee has to decide what to do about it and how to integrate the response into routine maintenance tasks.

“At the moment when the PM system issues a notification, an employee has to decide what to do about it and how to integrate the response into routine maintenance tasks.”

Probably not a substantial claim: may not pass S4 (based).

PM systems can make bad recommendations.

“PM systems can make bad recommendations.”

Probably not a substantial claim: may not pass S3 (load-bearing).

In case A, a plant operator authorized to accept a notification is responsible for coordinating its complete handling.

“In case A, a plant operator who is authorized to accept a notification is responsible for the coordination of its complete handling.”

Classified as probably not a substantial claim.

The study compiled a detailed schematic of tasks, actors, and interacting organizational practices.

“In this study, we identified four intertwined loops of interacting organizational practices of collaborative task handling and compiled a detailed schematic of tasks, actors, and interacting organizational practices that we expect to find in most AI-using organizations.”

Probably not a substantial claim: may not pass S3 (load-bearing).

Not every PM notification initiates a separate workflow, because coupling with other maintenance steps also takes place.

“That means that not every PM notification initiates a separate workflow, because coupling with other maintenance steps also takes place.”

Probably not a substantial claim: may not pass S3 (load-bearing), S4 (based).

Maintenance processes are integrated into a network of actors from outside the company, with whom constant coordination must occur.

“Maintenance processes are integrated into a network of actors from outside the company, with whom constant coordination must occur.”

Probably not a substantial claim: may not pass S3 (load-bearing), S4 (based).

One of the first things that happens is that the PM message is forwarded to others who should know about it.

“One of the first things that happens is that the PM message is forwarded to others who should know about it.”

Probably not a substantial claim: may not pass S4 (based). May combine two claims.

Doing repair work is usually not a job for one individual, and the plant operator has to check availability of others, capabilities, replacement parts, and tools.

“Doing the repair work is usually not a job for one individual, and the plant operator has to check the availability of the others involved, their capabilities, the availability of replacement parts, the availability of tools, etc.”

Probably not a substantial claim: may not pass S4 (based).

Even practitioners in leadership positions within organizations tend to involve the organization and its experts from the various organizational contexts too little or too late when implementing AI systems.

“Even practitioners in leadership positions within organizations tend to involve the organization and its experts from the various organizational contexts too little or too late when implementing AI systems.”

Probably not a substantial claim: may not pass S3 (load-bearing).

Even if the plant operator solves the problem indicated by the PM system directly, additional specialists may have to get involved.

“Even if the plant operator solves the problem indicated by the PM system directly, additional specialists may have to get involved.”

Probably not a substantial claim: may not pass S3 (load-bearing).

Coordination of maintenance can include complex negotiations, for example involving a works council for weekend work or unplanned overtime.

“All in all, this coordination can possibly include complex negotiations, for example if a works council has to be involved because the repair work needs to be scheduled for a weekend or requires unplanned overtime.”

Classified as probably not a substantial claim.

Even already-implemented PM systems are in continuous need of intervening action of varying urgency and consequences.

“Even already-implemented PM systems are in continuous need of intervening action of varying degrees of urgency and with varyingly serious consequences (planned production downtimes, ordering expensive spare parts, etc.).”

May combine two claims.

AI/ML use within PM requires or affects specific organizational practices, which can be grouped into six categories.

“When analyzing the data of both case studies from the perspective of embedding ML/AI within complex business organizations, we grouped the challenges and problems found into six categories where AI/ML use within PM requires or affects specific organizational practices.”

Probably not a substantial claim: may not pass S3 (load-bearing).

A basic kind of coordination takes place between internal maintenance and external providers of plant and equipment.

“A basic kind of coordination, which has to be clarified both generally and in particular situations, takes place between internal maintenance and the external providers of plant and equipment.”

Classified as probably not a substantial claim.

Employees may have good reasons for not following the PM system's recommendation in certain situations.

“Employees may also have good reasons for not following the PM system's recommendation in certain situations, e.g., for an experimental handling of assumed false positive PM notifications.”

Probably not a substantial claim: may not pass S3 (load-bearing).

Predictive maintenance is considered to be one of the most important AI applications for Industry 4.0.

“Predictive maintenance (PM) is considered to be one of the most important AI applications for Industry 4.0 (Garcia et al. 2020).”

• cites Garcia et al. 2020 sourceNot checked — no full text of the source

May combine two claims.

Engineering disciplines tend to leave organizational factors out of their equations, but also social sciences and management studies focus strongly on distributed agency between human and machine, addressing the organization often just as a static environmental condition than as a dynamic set of actors and rules.

“It may not be surprising that engineering disciplines tend to leave organizational factors out of their equations, but also social sciences and management studies focus strongly on the”

• cites Latour 1988 sourceNot checked — no full text of the source
• cites Rammert 2008 sourceNot checked — no full text of the source

Probably not a substantial claim: may not pass S4 (based).

Previous studies on the application of machine learning in maintenance are predominantly focused on concepts for a future application or on the prediction of possible effects on the level of work.

“Previous studies on the application of machine learning in the field of maintenance are predominantly focused on concepts for a future application or on the prediction of possible effects on the level of work.”

Probably not a substantial claim: may not pass S4 (based). May combine two claims.

The automotive industry is highly automated and has been very active in Industry 4.0 since the beginning, so there is already a lot of digital data with relevance for maintenance.

“In addition, the industry is highly automated and has been very active in the field of Industry 4.0 since the beginning, so there is already a lot of digital data with relevance for maintenance here.”

Probably not a substantial claim: may not pass S3 (load-bearing).

A McKinsey study valued predictive maintenance as one of the most economically lucrative use cases for AI and ML at 0.5-0.7 trillion USD.

“A McKinsey study pointed to predictive maintenance as one of the most economically lucrative use cases for AI and ML, valuing it at 0.5-0.7 trillion USD (Chui et al. 2018, p. 21).”

• cites Chui et al. 2018Not matched

  Couldn’t be matched to a paper in Crossref, so it can’t be checked.

Probably not a substantial claim: may not pass S2 (checkable), S4 (based). May combine two claims.

Both studies impressively demonstrate the consequences for the organization and its members, but they leave open to a large extent which organizational embedding would be the prerequisite for satisfactorily functioning and error-robust applications in this context and how they should be organized.

“Both studies impressively demonstrate the consequences for the organization and its members, but they leave open to a large extent which organizational embedding would be the prerequisite for satisfactorily functioning and error-robust applications in this context and how they should be organized.”

Probably not a substantial claim: may not pass S2 (checkable), S4 (based).

Predictive maintenance is largely understood as an application of AI and machine learning, with organizational approaches slipping into the background in favor of data-driven, technical measures.

“Predictive maintenance is largely understood as an application of AI and machine learning, with organizational approaches slipping into the background in favor of datadriven, technical measures.”

Classified as probably not a substantial claim.

The concept of keeping the organization in the loop integrates four different kinds of loops: AI use, AI customization, AI-supported original tasks, and taking contextual changes into account.

“From the empirical cases, we extrapolate a concept of”

Probably not a substantial claim: may not pass S4 (based).

The integration of dynamically changing technology into the complex organizational structures around all processes of maintenance plays a marginal role in previous studies.

“In contrast, the integration of this new, dynamically changing technology into the complex organizational structures around all processes of maintenance play a marginal role.”

Classified as probably not a substantial claim.

Even when the organization is seen as more than just another context, the focus lies on the initial integration of AI and not on organizing AI and human development over long periods of time.

“Also, even when the organization is seen as more than just another context, the focus lies on the initial integration of AI and not on organizing AI and human development over long periods of time (RQ2).”

Classified as probably not a substantial claim.

The organizational practices required to realize benefits from these solutions are not extensively discussed within these approaches.

“However, the organizational practices required to realize benefits from these solutions are not extensively discussed within these approaches.”

Classified as probably not a substantial claim. May combine two claims.

Socio-technical design emphasizes the relevance of the organization and argues that the dimensions of human individuals, technology, and organization should be integrated.

“Socio-technical design emphasizes the relevance of the organization and argues that the dimensions of human individuals, technology, and organization should be integrated (Baxter and Sommerville 2011;Eason 1989;Kirsch et al. 1995;Mumford 2006).”

• cites Baxter and Sommerville 2011 sourceNot checked — no full text of the source
• cites Eason 1989 sourceNot checked — no full text of the source
• cites Kirsch et al. 1995Not matched

  Couldn’t be matched to a paper in Crossref, so it can’t be checked.

Probably not a substantial claim: may not pass S2 (checkable).

The intertwinement between the social and technical dimensions and its evolution are the most crucial challenges of sociotechnical design.

“We suggest that the intertwinement between both and its evolution are the most crucial challenges of sociotechnical design (Fischer and Herrmann 2015;Herrmann et al. 2021).”

• cites Fischer and Herrmann 2015 sourceNot checked — no full text of the source
• cites Herrmann et al. 2021 sourceNot checked — no full text of the source

Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

Originally, AI design includes aspects of replacing humans with machines, and there is a still-growing literature that identifies tasks that can be or will likely be automated.

“Originally, AI design includes aspects of replacing humans with machines, and there is a still-growing literature that identifies tasks that can be or will likely be automated (Brynjolfsson and Mitchell 2017).”

• cites Brynjolfsson and Mitchell 2017 sourceNot checked — no full text of the source

May combine two claims.

Both case studies took place in a similar data collection period and in the same industry, but deliberately contrast in the size of the plants studied and in the disciplinary access.

“Both case studies took place in a similar data collection period and in the same industry, but deliberately contrast in two respects: (a) in the size of the plants studied and (b) in the disciplinary access as originally, case study A was researched from the perspective and with the methods of business informatics and case study B from the perspective and with the methods of sociology.”

May combine two claims.

There is also a dearth of qualitative case studies, which are necessary to reveal how organizations integrate AI in practice.

“There is also a dearth of qualitative case studies, which are necessary to reveal how organizations integrate AI in practice.”

Probably not a substantial claim: may not pass S2 (checkable), S4 (based).

Overlooked are the multiple layers between micro and macro views: the meso level of organizations, institutions, networks, communities, processes, and agreements in which any use of technology is decided, realized, concretized, micromanaged, and processed as well as changed and developed on a daily basis.

“Overlooked are the multiple layers between these micro and macro views: the meso level of organizations, institutions, networks, communities, processes, and agreements in which (any) use of technology is (and must be) decided, realized, concretized, micromanaged, and processed as well as changed and developed on a daily basis:”

May combine two claims.

The relationship between management and employees is particularly relevant but rarely addressed in AI research.

“Also, the relationship between management and employees is particularly relevant but rarely addressed in AI research.”

Probably not a substantial claim: may not pass S4 (based).

These authors do not consider that humans are involved not only in human-machine loops but are also simultaneously engaged in organizational loops like managerial decisions, coordination, and negotiation of agreements.

“However, these authors do not consider the fact that humans are involved not only in human-machine loops but are also simultaneously engaged in organizational”

May combine two claims.

Explanations of the background of decisions proposed by AI contribute to an overall understanding of the functioning of AI and its potentials and limits, and thus promote the development of users' competences when dealing with AI and related tasks.

“We suggest that explanations of the background of decisions proposed by AI do not only help improve a single instance of task handling but contributes to an overall understanding of the functioning of AI and its potentials and limits, and thus promote the development of users' competences when dealing with AI and the related tasks.”

Probably not a substantial claim: may not pass S2 (checkable).

AI in its current and prospective stages of development represents one of the clearest challenges to be met by the concept of keeping the organization in the loop.

“While all kinds of complex technologies (such as ERP-systems, telecommunication infrastructure etc.) might benefit from the concept of keeping the organization in the loop, AI in its current and prospective stages of development represents one of the clearest challenges to be met by this concept.”

Probably not a substantial claim: may not pass S2 (checkable).

A large set of organizational measures is needed to deal with AI-related shortcomings and to engage in quality assurance and continuous improvement.

“Rather, a large set of organizational measures is needed to deal with AI-related shortcomings and to engage in quality assurance and continuous improvement.”

Probably not a substantial claim: may not pass S2 (checkable), S4 (based).

The interplay between handling an AI outcome and the carrying out of original tasks to be supported or triggered by this outcome has to be coordinated.

“Most important, the interplay (1c) between handling an AI outcome and the carrying out of original tasks to be supported or triggered by this outcome has to be coordinated.”

Probably not a substantial claim: may not pass S3 (load-bearing), S4 (based). May combine two claims.

Experiments and interventions can be risky and have to be authorized by the organization.

“Experiments and interventions can be risky and have to be authorized by the organization (2b).”

Classified as probably not a substantial claim. May combine two claims.

Since AI is not based on conventional algorithms that could be tested with respect to complete knowledge about its internal structure, the quality of AI outcome has to be checked against its value for repeatedly handling the series of original tasks.

“(2) Since AI is not based on conventional algorithms that could be tested with respect to complete knowledge about its internal structure, the quality of AI outcome has to be checked against its value for repeatedly handling the series of original tasks (maintaining of machinery in the case of PM).”

Classified as probably not a substantial claim.

This is particularly true for ML-based AI that draws on underlying training data and where every usage of AI produces new data potentially relevant for (re-)training.

“This is particularly true for ML-based AI that draws on underlying training data and where every usage of AI produces new data that is potentially relevant for (re-)training.”

Probably not a substantial claim: may not pass S4 (based). May combine two claims.

Human decisions not following PM recommendations can later prove bad or lead to quality losses, high costs, or legal liability problems.

“These human decisions can later prove to be bad or can lead to quality losses, high costs, or even legal liability problems.”

May combine two claims.

Refining AI results is not mainly a question of HCI design; it is a challenge for the entire organization.

“Using and evolving AI of refining AI results is not mainly a question of HCI design (Cai et al. 2019a).It is a challenge for the entire organization.”

• cites Cai et al. 2019aNot matched

  Couldn’t be matched to a paper in Crossref, so it can’t be checked.

Classified as probably not a substantial claim.

The parameters of the PM system at the time a defective part was produced may have to be reconstructed weeks later.

“The parameters of the PM system at the time the defective part was produced may have to be reconstructed weeks later.”

Probably not a substantial claim: may not pass S2 (checkable).

Interactions in the organization should be investigated continuously, not just during AI rollout.

“b) Interactions in the organization should be investigated continuously, not just during AI rollout.”

Probably not a substantial claim: may not pass S2 (checkable), S4 (based). May combine two claims.

The organization has to decide who is in charge of continuous quality assurance for PM and who is responsible for and has permission to modify the PM system.

“The organization has to decide who is in charge of continuous quality assurance for PM and who is responsible for and has the permission to modify the PM system.”

Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

An elaborated handling of PM notifications will include reflection and understanding of their underlying causes and consideration of possible dependencies with other material and technical facts and other maintenance work.

“An elaborated handling of PM notifications and the problem that generated them will include a reflection and understanding of their underlying causes (see Sect. 4.5.2) and a consideration of possible dependencies with other material and technical facts as well as relations to other ongoing or prescheduled maintenance work.”

Probably not a substantial claim: may not pass S4 (based).

Management and workers have to decide which subset of a larger set of original tasks will be supported by AI.

“This interplay supposes management and workers have to decide which subset of a larger set of original tasks will be supported by AI.”

Classified as probably not a substantial claim.

The question of who is allowed to decide, initiate, order, or remedy what AI-provided decision, alone or with others, and at what level, has to be resolved in the context of a PM system time and again.

“The complex question of who is allowed to decide, initiate, order, or remedy what AI-provided decision, whether alone or with others, and at what level has to be resolved in the context of a PM system time and again.”

Probably not a substantial claim: may not pass S2 (checkable), S3 (load-bearing), S4 (based).

A distinction must be made between situational versus general coordination requirements.

“A distinction must be made between situational versus general coordination requirements.”

Probably not a substantial claim: may not pass S2 (checkable).

Processes of socialization into procedures of interacting with AI applications have to instill organizational readiness for ongoing change and learning.

“Instead these have to instill organizational readiness for ongoing change and learning.”

Classified as probably not a substantial claim. May combine two claims.

The four loops refer to task handling that: 1) directly deals with AI (UA-tasks, loop 1) using and assessing the outcome of AI and includes steps of refining the outcome or experimenting with it, 2) directly deals with AI (CA-tasks, loop 2) by contributing to the evolution of the AI system based on its customization and improvement, 3) exist before AI usage as original tasks (O-tasks, loop 3) that

“These four loops, derived from our empirical findings, refer to task handling that: 1) directly deals with AI (UA-tasks, loop 1) using and assessing the outcome of AI and includes steps of refining the outcome or experimenting with it, 2) directly deals with AI (CA-tasks, loop 2) by contributing to the evolution of the AI system based on its customization and improvement, 3) exist before AI usage”

Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

Coordination with external partners is an ongoing task, necessary not only when implementing the PM system but also when external relations change and when ML-based PM itself changes.

“The coordination with external partners is an ongoing task.It is not only necessary when implementing the PM system, but also in the case where external relations change (change of supplier, changed supplier evaluation, etc.) and, if necessary, also in case of the frequent changes in MLbased PM itself.”

May combine two claims.

PM necessitates two types of maintenance, and the second type is surrounded by organizational roles and procedures.

“In this sense, PM necessitates two types of maintenance, and also the second type of maintenance is surrounded by organizational roles and procedures.”

Probably not a substantial claim: may not pass S2 (checkable).

In implementing AI, technically oriented operational departments and HR administrators need to cooperate more than usual.

“In implementing AI, the more technically oriented operational departments and HR administrators (who usually have little technical expertise) need to cooperate more than usual.”

May combine two claims.

Including AI into the realm of original tasks requires changes of the rights and duties of roles to be included and of the workflows to be coordinated.

“Including AI into the realm of original tasks requires changes of the rights and duties of roles to be included (3a) and of the workflows to be coordinated (3b).”

Classified as probably not a substantial claim.

Explainability is just another technical feature, not a quality of ML alone.

“However, explainability is just another technical feature, not a quality of ML alone.”

May combine two claims.

Customization of the AI system is an ongoing endeavor, continuously triggered by the need to deal with changes and by the interplay with the fulfillment of O-Tasks as an indicator of the quality of AI outcome.

“It is an ongoing endeavor, continuously triggered by the need to deal with changes (4.5) and by the interplay (2c) with the fulfillment of O-Tasks as an indicator of the quality of AI outcome.”

Probably not a substantial claim: may not pass S2 (checkable).

Every decision regarding how an anticipated problem has to be dealt with and how upcoming tasks are handled and assigned has to be coordinated with upstream and downstream organizational functions and/or departments.

“Every decision regarding how an anticipated problem has to be dealt with and how the upcoming tasks are handled and assigned has to be coordinated with upstream and downstream organizational functions and/or departments because of possible consequences concerning economic questions, technical issues, questions about the stream of material, productivity or quality, etc.”

Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

Necessary changes can be supported by the internal project team, but external partners can help in understanding the limitations and opportunities of the AI application as well as the potential for further evolution.

“Necessary changes can be supported by the internal project team, but external partners can help in understanding the limitations and opportunities of the AI application as well as the potential for further evolution (4b).”

Probably not a substantial claim: may not pass S3 (load-bearing).

When a PM system is introduced, time management, topic management, prioritization, and documentation work have to be reorganized for maintenance coordination meetings.

“When a PM system is introduced, time management, the management of topics, their prioritization, and the subsequent documentation work have to be reorganized for running these meetings, and it has to be determined how far aspects such as prioritization become a matter of AI when its data-based capacities will increase over time.”

Probably not a substantial claim: may not pass S4 (based).

The customization of the AI system (CA-tasks) is an ongoing challenge.

“We consider the customization of the AI system (CA-tasks) as an ongoing challenge.”

Probably not a substantial claim: may not pass S3 (load-bearing).

The company-case-study method used in Case B is similar to the method more often used in international research.

“These are similar to the company-case-study method more often used in international research (Yin 2008).”

• cites Yin 2008Not matched

  Couldn’t be matched to a paper in Crossref, so it can’t be checked.

Probably not a substantial claim: may not pass S2 (checkable), S3 (load-bearing), S4 (based).

In the event of a malfunction, which kinds of problems can be fixed internally and which require calling in an external service must be clarified.

“In the event of a malfunction, which kinds of problems can be fixed internally and which ones require calling in an external service must be clarified.”

Classified as probably not a substantial claim.

The organization has to decide who is authorized to deal with PM messages.

“First, the organization has to decide who is authorized to deal with the PM messages (see Sect. 4.3).”

May combine two claims.

How the workforce deals with the outcome of an AI system is not only a matter of HCI but of complex, collaborative decisions that need ongoing coordination.

“How the workforce deals with the outcome of an AI system is not only a matter of HCI but of complex, collaborative decisions (Fig. 2, 4.2) that need ongoing coordination (Fig. 2, 4.3).”

May combine two claims.

Not only AI usage produces potential training data for ML but also its context.

“(3) Not only AI usage produces potential training data for ML but also its context.”

Classified as probably not a substantial claim.

Continuous ensuring of the functioning of AI-based socio-technical systems requires dealing with the external world and with changes to understand how the evolution of AI is coordinated with respect to the contextually triggered dynamics of original tasks.

“• RQ2: Continuous ensuring of the functioning of AIbased socio-technical systems requires dealing with the external world (4.4) and with changes (4.5) to understand how the evolution of AI is coordinated (4.3) with respect to the contextually triggered dynamics of original tasks.”

Probably not a substantial claim: may not pass S4 (based).

Under the condition of AI usage, all organizational procedures have to consider that they are triggered by more or less reliable forecasts that can become obsolete after a procedure has been started.

“Under the condition of AI usage, all of these organizational procedures have to set under consideration that they are triggered by more or less reliable forecasts that can become obsolete after a procedure has been started.”

Probably not a substantial claim: may not pass S4 (based).

Collecting examples as a knowledge-management environment is an organizational task involving a variety of people, procedures, responsibilities, and decisions.

“Collecting examples-as a kind of a knowledge-management environmentis an organizational task involving a variety of people, procedures, responsibilities, and decisions.”

Probably not a substantial claim: may not pass S2 (checkable). May combine two claims.

Contextually produced data can permanently be used for new training cycles and it is more about organizational than technical questions about whether, when, and with which data the re-training will take place.

“Contextually produced data can permanently be used for new training cycles and it is more about organizational than technical questions about whether, when, and with which data the re-training will take place.”

Classified as probably not a substantial claim.

The organizational processing and embedding of PM is not a self-starter.

“Thus, the organizational processing and embedding of PM is anything but a self-starter.”

Probably not a substantial claim: may not pass S2 (checkable), S4 (based).

Keeping the human in the loop in any organization that uses AI involves a variety of interactions on many levels, both between humans and machines and among humans in different organizational roles.

“Against this backdrop, it seems clear that “keeping the human in the loop” in any organization that uses AI involves a variety of interactions on many levels, both between humans and machines and among humans in different organizational roles.”

Probably not a substantial claim: may not pass S2 (checkable).

This co-evolution and continuous alignment applies particularly to the realm of AI and machine learning, where organizational practices have to accompany the continuing need and potential for improving AI based on new data that emerge by task-handling and contextual changes.

“This applies particularly to the realm of AI and machine learning, too, where organizational practices have to accompany the continuing need and potential for improving AI based on new data that emerge by taskhandling and contextual changes.”

Probably not a substantial claim: may not pass S2 (checkable), S4 (based).

The organization must ensure that these rules are known and accepted by employees dealing with PM notifications and by all employees in the organizational loops within which this decision-making is embedded.

“Furthermore, the organization has to make sure that these rules are known and accepted by the employees dealing with PM notifications and by all employees in the organizational loops within which this decision-making is embedded.”

Probably not a substantial claim: may not pass S2 (checkable), S4 (based).

A typical phenomenon to be accounted for in socio-technical design is that organizational practices and technology continuously co-evolve and have to be continuously aligned.

“A typical phenomenon to be accounted for in socio-technical design is that organizational practices and technology continuously co-evolve and have to be continuously aligned.”

May combine two claims.

An AI result may not be considered when performing O-tasks, even if it is potentially relevant; this is a broader requirement than implementing the technical ability to veto.

“An AI result may not be considered when performing O-tasks, even if it is potentially relevant-this is a broader requirement than the approach of implementing the technical ability to veto as proposed by Rakova et al. (2020).”

• cites Rakova et al. (2020)Not matched

  Couldn’t be matched to a paper in Crossref, so it can’t be checked.

Probably not a substantial claim: may not pass S3 (load-bearing).

The schema presented in Fig. 2 shows how each of the six categories identified and discussed in Sect. 4 mutually interact.

“The schema presented in Fig. 2 shows how each of the six categories identified and discussed in Sect. 4 mutually interact.”

Probably not a substantial claim: may not pass S2 (checkable).

A systematic framework of keeping the organization in the loop when applying AI has to acknowledge the interplay of organizational practices instead of regarding them as isolated measures.

“• RQ3: A systematic framework of keeping the organization in the loop when applying AI has to acknowledge the interplay of organizational practices instead of regarding them as isolated measures.”

Probably not a substantial claim: may not pass S2 (checkable). May combine two claims.

Promotion of continuously interwoven explanation and exploratory adaptation has to acknowledge the value of developing human competence in dealing with AI and seek to protect the experiential property of workers used and developed during decision-making with and customization of AI.

“This promotion has to acknowledge the value of developing human competence in dealing with AI and seek to protect the experiential property of the workers that is used and developed during decisionmaking with (4.2) and customization of AI (4.6).”

Probably not a substantial claim: may not pass S2 (checkable).

The interplay of organizational practices has to be adjusted in a way that keeps the four loops displayed in Fig. 1 synchronized.

“This interplay has to be adjusted in a way that keeps the four loops displayed in Fig. 1 synchronized.”

Probably not a substantial claim: may not pass S2 (checkable), S3 (load-bearing), S4 (based).

If defective parts produced on equipment are returned later, it must be legally clarified whether the cause lay with the parts manufacturer, equipment manufacturer, or supplier of the PM system.

“If, for example, defective parts produced on the equipment are returned at a later date, it must be legally clarified whether the cause of the defect lay with the parts manufacturer, the equipment manufacturer, or the supplier of the PM system.”

Probably not a substantial claim: may not pass S2 (checkable), S4 (based).

For all successive decision-making after a PM warning and in its context, organizational rules have to be specified and conventions established.

“For all successive decision-making after a PM warning and in its context, organizational rules have to be specified and conventions have to be established.”

May combine two claims.

The necessity of external coordination will not disappear after PM implementation; rather, the way the interplay with the external world is managed will change and face new challenges.

“This necessity will not disappear after PM implementation.Rather, the way the interplay with the external world is managed will change and will face new challenges.”

Classified as probably not a substantial claim.

For continuously interwoven explanation and exploratory adaptation to occur, it must be promoted by the interplay between coordination and HR.

“For this to occur, it must be promoted by the interplay (2a) between coordination and HR.”

May combine two claims.

In the realm of O-tasks, extending the level of AI support simultaneously implies shifting control from management to technology and a redistribution of power because control over repairs is no longer in the hands of management alone but is also relegated in part to PM-driven notifications.

“In the realm of the O-tasks, extending the level of AI support simultaneously implies shifting control from management to technology and a redistribution of power because control over repairs is no longer in the hands of management alone but is also relegated in part to PM-driven notifications.”

Probably not a substantial claim: may not pass S2 (checkable).

In the case of AI, where quality cannot sufficiently be tested before runtime, documentation and initiation of quality improvement is continuously necessary.

“In the case of AI-where its quality cannot sufficiently be tested before runtime-documentation and the initiation of quality improvement is continuously necessary.”

Probably not a substantial claim: may not pass S2 (checkable).

Organizational practices have to provide the channels and procedures that allow negotiation and communication to take place as both can still be seen as superior human strengths.

“Organizational practices (1a) have to provide the channels and procedures that allow negotiation and communication to take place as both can still be seen as superior human strengths (Jarrahi 2018).”

• cites Jarrahi 2018 sourceNot checked — no full text of the source

Probably not a substantial claim: may not pass S2 (checkable), S3 (load-bearing), S4 (based). May combine two claims.

Who has access to which data must first be clarified in general but also checked and adjusted during software updates.

“Who has access to which data must first be clarified in general but also checked and adjusted during software updates (of the embedded system as well as of the AI/PM systems).”

Probably not a substantial claim: may not pass S4 (based). May combine two claims.

Since AI plays the role of a decision-proposer, the persons addressed must have the standing and rights to oppose such a proposal; this must be checked and determined at least once by superiors, process managers, and/or HR.

“Since AI plays the role of a decision-proposer, the persons addressed must have the standing and rights to oppose such a proposal; whether this is the case must be checked and determined at least once by superiors, process managers, and/or HR (see Sect. 4.1).”

Classified as probably not a substantial claim. May combine two claims.

The organization that implemented the PM system must provide rules for decision-making, align them with its strategies, and continuously adapt them to changes in conditions and strategies.

“It is a task of the organization that has implemented the PM system to provide the rules for these instances of decision-making, to align them with its strategies, and to continuously adapt the rules in accordance with changes in conditions and strategies.”

Probably not a substantial claim: may not pass S2 (checkable), S3 (load-bearing).

Specific human strengths have to be taken into account in decisions on the distribution of agency between human and AI.

“Specific human strengths have to be taken into account in these decisions-as described for instance by Jarrahi (2018).”

• cites Jarrahi (2018) sourceNot checked — no full text of the source

Probably not a substantial claim: may not pass S2 (checkable), S3 (load-bearing).

Maintenance contracts must be negotiated that deal with the extent to which external actors are allowed to influence AI-based PM.

“For this purpose, maintenance contracts must be negotiated that also deal with the question of the extent to which external actors are allowed to influence AI-based PM.”

Probably not a substantial claim: may not pass S4 (based). May combine two claims.

Every PM notification or failure to appropriately notify requires two human responses: whether the plant has to be maintained and whether the PM system itself needs to be adjusted.

“Every PM notification (or failure to appropriately notify) requires two human responses: whether the plant has to be maintained and whether the PM system itself needs to be adjusted (see Sect. 4.2).”

Classified as probably not a substantial claim. May combine two claims.

Leadership and HR are decisive factors in shaping organizational processes, supporting change, ensuring employee skill development, and enabling a learning organization, especially for embedding AI technology within organizations.

“Leadership and human resource management (HR) are decisive factors in shaping organizational processes, supporting change, ensuring employee skill development, and enabling a learning organization-this is all the more true for embedding AI technology within organizations.”

Probably not a substantial claim: may not pass S3 (load-bearing), S4 (based).

It is a matter of organizational decision rules to whom and under what circumstances PM notifications can or must be forwarded.

“It is a matter of organizational decision rules to whom and under what circumstances PM notifications can or must be forwarded.”

May combine two claims.

Understanding and reflecting the dynamics of AI and O-Tasks and diagnosing the causes of problems in the performance of O-Tasks may lead to new tasks.

“Understanding and reflecting these dynamics and diagnosing the causes of problems in the performance of the O-Tasks (4.5, tracing causes) may lead to new tasks.”

Probably not a substantial claim: may not pass S2 (checkable).

The study of human-computer interaction has to include the organizational context.

“a) The study of human-computer interaction has to include the organizational context.”

May combine two claims.

To realize benefits from complementary strengths of humans and AI and from fostering their coevolutionary improvement, it is not sufficient to just plug in AI technology; it is necessary to also develop new organizational practices including organizational learning and improvement of human collaboration.

“d) To realize benefits from the complementary strengths of humans and AI and from fostering their coevolutionary improvement, it is not sufficient to just plug in AI technology.By contrast, it is necessary to also develop new organizational practices including organizational learning and improvement of human collaboration.”

Probably not a substantial claim: may not pass S4 (based). May combine two claims.

PM systems based on machine learning and constantly changing learning data sets are dynamic systems, which means that completely new legal and liability challenges arise.

“PM systems based on machine learning and constantly changing learning data sets are dynamic systems, which means that completely new legal and liability challenges arise.”

Probably not a substantial claim: may not pass S4 (based).

The outputs that enable explainability can create more explanations of PM notifications than the organization requires or can even process.

“The outputs that enable explainability can create more explanations of PM notifications than the organization requires or can even process.”

Classified as probably not a substantial claim. May combine two claims.

How to proceed when PM recommendations are not followed and what consequences employees face are questions the organization must answer.

“How to proceed in such cases and what consequences employees will face are questions the organization must answer (see Sect. 4.2).”

Probably not a substantial claim: may not pass S3 (load-bearing), S4 (based).

New coordination requirements will likely only emerge after PM has been in use for a longer period of time.

“Moreover, new coordination requirements will likely only emerge after PM has been in use for a longer period of time.”

Probably not a substantial claim: may not pass S3 (load-bearing).

Beyond involving people, the acquisition of spare parts or special tools also has to be organized.

“Beyond the involvement of people, the acquisition of spare parts or special tools also has to be organized.”

Probably not a substantial claim: may not pass S4 (based).

Designing and improving PM systems, creating new learning queues, and deciding on new training data necessitates having qualified or qualifiable employees.

“Designing and improving PM systems, creating new learning queues, and deciding on new training data necessitates having qualified (or qualifiable) employees.”

Probably not a substantial claim: may not pass S2 (checkable). May combine two claims.

Procedures must be developed to regulate how system states can be continuously documented and what to do if liability has to be clarified.

“Procedures must be developed for this purpose that regulate how system states can be continuously documented and what to do in the event that liability has to be clarified.”

Probably not a substantial claim: may not pass S3 (load-bearing).

If an operator decides that PM messages should trigger further action, the subsequent activities have to be coordinated.

“If an operator decides autonomously or in communication with others that the PM messages should trigger further action, the subsequent activities have to be coordinated.”