CoChat
Sign Up
Cited by 332Health Policy Implementation ScienceEvaluation and Performance AssessmentPublic Policy and Administration Research

Social Network Analysis for Program Implementation

Open access
Valente, Thomas W., Palinkas, Lawrence A., Czaja, Sara, Chu, Kar-Hai, Brown, C. Hendricks·2015·PLOS ONE
DOI 10.1371/journal.pone.0131712PMC PMC4482437
Open this paper in CoChat — free accountOpen PDF

Abstract

This paper introduces the use of social network analysis theory and tools for implementation research. The social network perspective is useful for understanding, monitoring, influencing, or evaluating the implementation process when programs, policies, practices, or principles are designed and scaled up or adapted to different settings. We briefly describe common barriers to implementation success and relate them to the social networks of implementation stakeholders. We introduce a few simple measures commonly used in social network analysis and discuss how these measures can be used in program implementation. Using the four stage model of program implementation (exploration, adoption, implementation, and sustainment) proposed by Aarons and colleagues [1] and our experience in developing multi-sector partnerships involving community leaders, organizations, practitioners, and researchers, we show how network measures can be used at each stage to monitor, intervene, and improve the implementation process. Examples are provided to illustrate these concepts. We conclude with expected benefits and challenges associated with this approach.

AI snapshot

Written from the paper’s full text.

TL;DR

This conceptual paper proposes using social network analysis (SNA) to monitor, intervene in, and evaluate program implementation across four stages: exploration, adoption, implementation, and sustainment. It illustrates network measures and thresholds with examples, arguing that network-informed implementation can improve design, delivery, and sustainability, while noting that evidence remains limited.

Key findings

  • SNA can be applied at each of four implementation stages—exploration/needs assessment, adoption/program design, implementation, and sustainment/monitoring—with Table 1 mapping stage-specific research questions, measures, concepts, and outcomes (e.g., network ethnography, network interventions, network diagnostics, network surveillance).
  • The paper offers illustrative thresholds: density below 0.30 as low, 0.30–0.50 as moderate, and above 0.50 as probably too high in many situations; modularity Q values greater than 0.30 indicate reasonably strong group structure and above 0.50 very strong group structure. In the illustrative 37-member organizational network, Q was 0.40 and the analysis identified 8 groups plus two isolates.
  • For implementation-stage network diagnostics, Gesell et al.’s metrics are cited: include isolates in activities, minimize asymmetry, keep density greater than 15% but less than 50%, avoid distinct subgroups, minimize centralization, and encourage but limit transitivity/cohesion.
  • Examples cited include: counties whose service-system leaders were identified as sources of information and advice showed significantly greater progress implementing Multidimensional Treatment Foster Care; Community Development Teams strengthened the network but led to no improvement in speed or stage of implementation while improving quality and quantity of implementation; and a cancer screening intervention increased community-based organizations’ linkage to themselves and to universities, but not universities’ links to CBOs.

Methods

  • Conceptual/methodological paper introducing SNA theory and tools for implementation research; it does not report a primary empirical study.
  • Uses the four-stage implementation model proposed by Aarons and colleagues and draws on examples from the authors’ work and others, including an illustrative organizational network of 37 members.
  • Main analysis is descriptive: it defines network measures (components, density, centrality, isolates, centralization, reciprocity, transitivity, modularity Q) and maps their use to implementation stages, summarizing procedures in Table 1.

Limitations

  • Stated: the paper is “not comprehensive”; many suggestions are based on limited evidence; there is “no rigorous comprehensive database of network experiences for this applied work”; only one study (Gesell et al.) is noted as having used network data during the implementation stage; and recommendations on metrics/thresholds are based primarily on one pilot study and are tentative/context-specific.
  • Evident: the paper is conceptual and does not empirically test whether the proposed SNA procedures improve implementation outcomes; the proposed thresholds and stage-specific procedures lack validation across diverse settings.

Model-written summary. Check it against the paper before relying on it.

Integrity signals

Registry

Crossref · 10.1371/journal.pone.0131712

Cites

91 of 91 references verified0 citation errors · 0 not checkable

Statistics

Nothing to recompute.

Claims the paper makes

0 of 70 cited sources checked · 0 supported · 0 flagged

  • Premisecitation

    Evidence-based programs that have progressed to implementation and translation stages report that effective partnerships with community-based, school, or implementing agencies are critical to their success.

    “Indeed, evidence-based programs that have progressed to implementation and translation stages report that effective partnerships with community-based, school, or implementing agencies are critical to their success [11, 17, 18].”
    Quote in the paperSubstantial claim0 of 3 sources checked
    • cites [11] CH Brown, 2012, Partnerships for the design, conduct, and analysis of effectiveness, and implementation research: Experiences of the Prevention Science and Methodology Group, Administration and Policy in Mental Health source

      Not checked in the free run.

    • cites [17] LA Palinkas, 2014, Inter-organizational collaboration in the implementation of evidence-based practices among agencies serving abused and neglected youth, Administration and Policy in Mental Health and Mental Health Services Research source

      Not checked in the free run.

    • cites [18] LA Palinkas, 2012, Translation and implementation of evidence-based practice

      Not checked in the free run.

  • Premisecitation

    Many programs use haphazard, invalid, or convenience methods to identify who delivers the program.

    “Many programs use haphazard, invalid, or convenience methods to identify who delivers the program [19].”
    Quote in the paperSubstantial claim0 of 1 sources checked
    • cites [19] TW Valente, 2007, Identifying opinion leaders to promote behavior change, Health Education & Behavior source

      Not checked in the free run.

  • Premisecitation

    Interventions implemented by community-identified leaders are often more effective than those by non-leaders.

    “Yet interventions implemented by community-identified leaders are often more effective than those by non-leaders [20, 21].”
    Quote in the paperSubstantial claim0 of 2 sources checked
    • cites [20] Flodgren G, Deane K, Dickinson HO, Kirk S, Alberti H, Beyer FR, et al. Interventions to change the behaviour of health professionals and the organisation of care to promote weight reduction in overweight and obese adults. Cochrane Collaboration: Systematic Reviews; 2010. source

      Not checked in the free run.

    • cites [21] TW Valente, 2010, Social networks and health: Models, methods, and applications source

      Not checked in the free run.

  • Premisecitation

    In general, interventions delivered by people from the community of the beneficiaries of the program will be more effective than those delivered by outside agencies that are less connected to program recipients.

    “In general, interventions delivered by people from the community of the beneficiaries of the program will be more effective than those delivered by outside agencies that are less connected to program recipients [22, 23].”
    Quote in the paperSubstantial claim0 of 2 sources checked
    • cites [22] T Valente, 2012, Network interventions, Science source

      Not checked in the free run.

    • cites [23] SG Kellam, 2012, Developing and maintaining partnerships as the foundation of implementation and implementation science: Reflections over a half century, Administration and Policy in Mental Health source

      Not checked in the free run.

  • Premisecitation

    There is a considerable lag between an invention or innovation and its routine use in a clinical or applied setting.

    “Research has shown that there is a considerable lag between an invention or innovation and its routine use in a clinical or applied setting [6].”
    Quote in the paperSubstantial claim0 of 1 sources checked
    • cites [6] EA Balas, 2000, Yearbook of medical informatics

      Not checked in the free run.

  • May combine two claims. 26
  • Classified as probably not a substantial claim. 36

  • May combine two claims.

    Premisecitation

    An academic-community intervention to improve cancer screening rates among Asian Pacific Islander communities in southern California was successful at increasing linkage between community based organizations (CBOs) and themselves, and links from CBOs to universities, but not between universities or from universities to CBOs.

    “For example, Valente and colleagues [10] showed that an academic-community intervention to improve cancer screening rates among Asian Pacific Islander communities in southern California was successful at increasing linkage between community based organizations (CBOs) and themselves, and links from CBOs to universities, but not between universities or from universities to CBOs.”
    Quote in the paperSubstantial claim0 of 1 sources checked
    • cites [10] TW Valente, 2010, A network assessment of community-based participatory action: Linking communities and universities to reduce cancer disparities, American Journal of Public Health source

      Not checked in the free run.

  • Probably not a substantial claim: may not pass S2 (checkable). May combine two claims.

    Interpretationreasoning

    If positive, social media actions may increase program participation and effects and can in some cases take on a life of their own.

    “If positive, these actions may increase program participation and effects and can in some cases take on a life of their own.”
    Quote in the paperNot a substantial claim

  • Classified as probably not a substantial claim. May combine two claims.

    Interpretationreasoning

    The discussion question identifies individuals who are trustworthy and good communicators.

    “The discussion question identifies individuals who are trustworthy and who are “people people” and good communicators.”
    Quote in the paperSubstantial claim

  • Probably not a substantial claim: may not pass S2 (checkable), S3 (load-bearing), S4 (based).

    Interpretationnone given

    There are many network tools and statistics that can be used to facilitate program implementation and enable mid-course program adjustments.

    “There are many network tools and statistics that can be used to facilitate program implementation and enable mid-course program adjustments.”
    Quote in the paperNot a substantial claim
    • Rests on an assumption: Most interventions are not one shot but implemented over many months and involve many sessions.

  • May combine two claims.

    Interpretationreasoning

    When barriers to change are technical, advice networks are important; when barriers are cultural, discussion networks are important.

    “When the barriers to change are technical, advice networks are important; when the barriers to change are cultural, then discussion ones are important.”
    • Also stated in: § Program design · plain
      “In other words, when people report they do not know how to do the behavior, advice or expertise is needed, but when people report they do not know what behaviors to do, discussion or trust is needed.”
    Quote in the paperSubstantial claim

  • May combine two claims.

    Premisecitation

    Many interventions are designed to be delivered in group settings in part to increase cost-effectiveness and in part to harness group dynamics to facilitate behavior change.

    “Many interventions are designed to be delivered in group settings in part to increase their cost-effectiveness and in part to harness the power of group dynamics to facilitate behavior change [63].”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites [63] SL Barkin, 2012, Culturally tailored, family-centered, behavioral obesity intervention for Latino-American preschool-aged children, Pediatrics source

      Not checked in the free run.

  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Premisecitation

    The four stages of implementation progress are exploration or needs assessment, adoption or program design, program implementation, and sustainment and monitoring.

    “The four stages are: (1) Exploration or needs assessment; (2) Adoption or program design; (3) Program implementation, and (4) Sustainment and monitoring.”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites [1] GA Aarons, 2011, Advancing a conceptual model of evidence-based practice in implementation in public mental health and child welfare systems, Administration and Policy in Mental Health and Mental Health Services Research source

      Not checked in the free run.

  • May combine two claims.

    Premisecitation

    There is some evidence that identifying leaders and forming groups around them, or forming groups and identifying leaders within them, are effective approaches.

    “There is some evidence that identifying leaders and forming groups around them [58]; or forming groups and identifying leaders within them are also effective approaches [69].”
    Quote in the paperSubstantial claim0 of 2 sources checked
    • cites [58] TW Valente, 2003, The effects of a social network method for group assignment strategies on peer led tobacco prevention programs in schools, American Journal of Public Health source

      Not checked in the free run.

    • cites [69] DB Buller, 1999, Randomized trial testing the effect of a peer education at increasing fruit and vegetable intake, Journal of the National Cancer Institute source

      Not checked in the free run.

  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Interpretationcitation

    Selecting a network intervention from strategic, tactical and operational choices depends on the behavior of study, the goals and objectives of the intervention, the characteristics of the population, and the context in which the intervention will be implemented.

    “Selecting a network intervention from this wide array of strategic, tactical and operational choices depends on the behavior of study, the goals and objectives of the intervention, the characteristics of the population, and the context in which the intervention will be implemented.”
    Quote in the paperNot a substantial claim

  • May combine two claims.

    Premisecitation

    There is strong evidence that opinion leader and RDS interventions are effective behavior change approaches.

    “There is strong evidence that opinion leader and RDS interventions are effective behavior change approaches [20, 68].”
    Quote in the paperNot a substantial claim0 of 2 sources checked
    • cites [20] Flodgren G, Deane K, Dickinson HO, Kirk S, Alberti H, Beyer FR, et al. Interventions to change the behaviour of health professionals and the organisation of care to promote weight reduction in overweight and obese adults. Cochrane Collaboration: Systematic Reviews; 2010. source

      Not checked in the free run.

    • cites [68] DD Heckathorn, 2002, Extensions of respondent-driven sampling: a new approach to the study of injection drug users aged 18–25, AIDS and Behavior source

      Not checked in the free run.

  • Classified as probably not a substantial claim. May combine two claims.

    Interpretationreasoning

    The advice question identifies individuals who are knowledgeable about the issue and have technical know-how to persuade non-users.

    “The advice question identifies individuals who are knowledgeable about the issue at hand and have the necessary technical know-how to persuade non-users.”
    Quote in the paperSubstantial claim

  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Premisecitation

    Valente classified network interventions into four broad strategies, each comprised of several tactical alternatives with each tactic having from one to many operational choices.

    “Many other network interventions are possible, and Valente [22] classified them into four broad strategies, each comprised of several tactical alternatives with each tactic having from one to many operational choices.”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites [22] T Valente, 2012, Network interventions, Science source

      Not checked in the free run.

  • May combine two claims.

    Interpretationreasoning

    Opinion leader interventions are effective because they solicit community input to determine who should implement the program, and because the leaders come from the community they often have considerable trust and social capital.

    “Opinion leader interventions are effective because they solicit community input to determine who should implement the program, and because the leaders come from the community they often have considerable trust and social capital.”
    Quote in the paperSubstantial claim

  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Premisecitation

    Initial coalition participation in a youth violence prevention program was associated with a pre-existing network of inter-organizational relations.

    “Bess and colleagues [38] found that initial coalition participation in a youth violence prevention program was associated with a pre-existing network of inter-organizational relations.”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites [38] KD Bess, 2012, Ecological contexts in the development of coalitions for youth violence prevention: an organizational network analysis, Health Education & Behavior source

      Not checked in the free run.

  • Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

    Premisecitation

    Network density has been posited to be advantageous for spreading new information but deleterious when accepting new information from the outside.

    “Even this suggestion must be tentative however since even the most basic measure, network density, has been posited to be advantageous for spreading new information but deleterious when accepting new information from the outside [11].”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites [11] CH Brown, 2012, Partnerships for the design, conduct, and analysis of effectiveness, and implementation research: Experiences of the Prevention Science and Methodology Group, Administration and Policy in Mental Health source

      Not checked in the free run.

  • Probably not a substantial claim: may not pass S2 (checkable), S3 (load-bearing).

    Interpretationcitation

    The increasing importance of social media use among all populations means public health interventions are likely to be re-imagined and re-interpreted with a social media lens.

    “Finally, the increasing importance of social media use among all populations means that public health interventions are likely to re-imagined and re-interpreted with a social media lens [65].”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites [65] D Capurro, 2014, The use of social networking sites for public health practice and research: A systematic review, Journal of Medical Internet Research source

      Not checked in the free run.

  • May combine two claims.

    Premisecitation

    Community Development Teams improved the quality and quantity of implementation.

    “(3) improved the quality and quantity of implementation [15].”
    Quote in the paperSubstantial claim0 of 1 sources checked
    • cites [15] CH Brown, 2014, Advances in Prevention Science: Defining Prevention Science

      Not checked in the free run.

  • May combine two claims.

    Premisecitation

    Network cohesion is positively associated and network centralization is negatively associated with community readiness to engage in the Communities That Care community-based prevention coalition.

    “Feinberg and colleagues [42] found network cohesion to be positively associated and network centralization to be negatively associated with community readiness to engage in the Communities That Care community-based prevention coalition.”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites [42] ME Feinberg, 2005, Social networks and community prevention coalitions

      Not checked in the free run.

  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Premisecitation

    Gesell et al. worked with a 12-week program designed to improve lifestyle choices for parents in underserved communities.

    “These investigators worked with a 12-week program designed to improve lifestyle choices for parents in underserved communities.”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites [70] S Gessel, 2013, Social network diagnostics: A tool for monitoring group interventions, Implementation Science source

      Not checked in the free run.

  • Probably not a substantial claim: may not pass S4 (based).

    Interpretationreasoning

    Network data will enable us to improve our programs without substantially increasing costs or revising existing interventions.

    “Network data will enable us to improve our programs without substantially increasing costs or revising existing interventions.”
    Quote in the paperNot a substantial claim
    • Rests on an assumption: Existing evidence indicates that network-informed interventions and programs are more effective than non-networked ones.

  • Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

    Premisecitation

    Recommendations regarding appropriate metrics and thresholds for these metrics were based primarily on experiences with one pilot study, and much work remains to be done in this area.

    “The recommendations regarding appropriate metrics and thresholds for these metrics were based primarily on experiences with one pilot study, and much work remains to be done in this area.”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites [70] S Gessel, 2013, Social network diagnostics: A tool for monitoring group interventions, Implementation Science source

      Not checked in the free run.

  • Classified as probably not a substantial claim.

    Premisecitation

    Many studies have deplored the tendency for programs to lose funding, focus, or purpose once initial investments are removed.

    “Many studies have deplored the tendency for programs to lose funding, focus, or purpose once the initial investments are removed [71, 72].”
    Quote in the paperSubstantial claim0 of 2 sources checked
    • cites [71] M O’Connell, 2009, Preventing mental, emotional and behavioral disorders among young people: Progress and possibilities

      Not checked in the free run.

    • cites [72] R Spoth, 2013, Addressing challenges for the next generation of type 2 translation research: the translation science to population impact (TSci2PI) framework, Prevention Science source

      Not checked in the free run.

  • Probably not a substantial claim: may not pass S2 (checkable), S3 (load-bearing), S4 (based). May combine two claims.

    Interpretationreasoning

    Much of the technology that supports online interactions is inherently designed to connect different persons and groups, and thus is ideal for network exploration.

    “Much of the technology that supports online interactions is inherently designed to connect different persons and groups, and thus is ideal for network exploration.”
    Quote in the paperNot a substantial claim

  • Classified as probably not a substantial claim. May combine two claims.

    Premisecitation

    The theory guiding the Gesell intervention was that increased social cohesion during group sessions would improve information seeking and social support among group members, which would translate into better outcomes.

    “The theory guiding the intervention was that increased social cohesion during the group sessions would improve information seeking and social support among group members, which would translate into better outcomes.”
    Quote in the paperSubstantial claim0 of 1 sources checked
    • cites [70] S Gessel, 2013, Social network diagnostics: A tool for monitoring group interventions, Implementation Science source

      Not checked in the free run.

  • Probably not a substantial claim: may not pass S4 (based).

    Interpretationnone given

    Interventionists may often think the program is still being embraced by the community because the people they come into contact with regularly still report that it is important.

    “Interventionists may often think the program is still being embraced by the community because the people they come into contact with regularly still report that it is important.”
    Quote in the paperNot a substantial claim

  • Probably not a substantial claim: may not pass S2 (checkable).

    Interpretationreasoning

    Using network data to inform all stages of program development and implementation offers considerable potential benefits in a number of areas.

    “Using network data to inform all stages of program development and implementation offers considerable potential benefits in a number of areas.”
    Quote in the paperNot a substantial claim

  • Probably not a substantial claim: may not pass S2 (checkable), S4 (based).

    Interpretationreasoning

    Using network data will substantially advance theory about how programs work and how best to design and implement them.

    “First, it will substantially advance theory about how programs work and how best to design and implement them.”
    Quote in the paperNot a substantial claim

  • Probably not a substantial claim: may not pass S2 (checkable), S3 (load-bearing), S4 (based).

    Premisenone given

    Experience indicates that collecting network data via surveys, either electronically or with paper, is easy and efficient.

    “In addition, experience indicates that collecting network data via surveys, either electronically or with paper, is easy and efficient.”
    Quote in the paperNot a substantial claim
    • Rests on an assumption: Everyone knows who they go to for advice or whom they spend time with.

  • Classified as probably not a substantial claim. May combine two claims.

    Interpretationreasoning

    There are at least four metrics/network analytic techniques that can be used to aid in the evaluation of sustainability: documentation of continuation of network; documentation of behavior of leaders; estimation of contagion effects; and strategies to ensure participants hear positive things from peers.

    “There are at least four metrics/network analytic techniques that can be used to aid in the evaluation of sustainability: (1) documentation of the continuation of the network; (2) documentation of the behavior of leaders; (3) estimation of contagion (or learning) effects; and (4) strategies to help ensure that participants hear positive things about the program from their peers.”
    Quote in the paperSubstantial claim

  • Probably not a substantial claim: may not pass S2 (checkable), S4 (based). May combine two claims.

    Premisenone given

    Many of the suggestions provided here are based on limited evidence at this point in time, but the available evidence is promising.

    “Many of the suggestions provided here are based on limited evidence at this point in time, but the available evidence is promising.”
    Quote in the paperNot a substantial claim

  • Probably not a substantial claim: may not pass S3 (load-bearing), S4 (based).

    Interpretationreasoning

    Online data can be used at any point during the different stages of program implementation.

    “Online data can be used at any point during the different stages of program implementation, whether it is from emails for coordination, or fully integrating social media websites into an intervention.”
    Quote in the paperNot a substantial claim

  • Probably not a substantial claim: may not pass S2 (checkable).

    Interpretationreasoning

    This example demonstrates the usefulness of the network analysis approach in the implementation stage of an intervention.

    “However, this example demonstrates the usefulness of the network analysis approach in the implementation stage of an intervention.”
    Quote in the paperNot a substantial claim

  • Probably not a substantial claim: may not pass S2 (checkable), S4 (based).

    Interpretationreasoning

    Social network analyses can be applied to intervention development and implementation to foster and enhance the implementation process.

    “Social network analyses can be applied to intervention development and implementation to foster and enhance the implementation process.”
    Quote in the paperNot a substantial claim
    • Rests on an assumption: There is a wealth of knowledge about how to collect and analyze social network data, and a plethora of measures that can be used to improve the design, delivery, and assessment of public health interventions.

  • May combine two claims.

    Interpretationreasoning

    These individuals may not be central in the network for which the programs are developed, so the surveillance information available to the interventionist is not a valid reflection of what is happening in the community.

    “But these individuals may not be central in the network for which the programs are developed and so the surveillance information available to the interventionist is not a valid reflection of what is happening in the community.”
    Quote in the paperSubstantial claim

  • May combine two claims.

    Interpretationreasoning

    Network analyses can document these perceived normative influences and determine if participants maintain a perception that their interpersonal environment supports and endorses the new behaviors.

    “Network analyses can document these perceived normative influences and determine if participants maintain a perception that their interpersonal environment supports and endorses the new behaviors.”
    Quote in the paperSubstantial claim

  • Probably not a substantial claim: may not pass S3 (load-bearing), S4 (based).

    Interpretationnone given

    Truly successful programs turn program participants into advocates.

    “Moreover, truly successful programs turn program participants into advocates”
    Quote in the paperNot a substantial claim

  • Probably not a substantial claim: may not pass S2 (checkable).

    Interpretationreasoning

    Incorporating network data into program design and intervention may enable us to conceive of new interventions.

    “Finally, incorporating network data into program design and intervention may enable us to conceive of new interventions.”
    Quote in the paperNot a substantial claim

  • May combine two claims.

    Interpretationreasoning

    By monitoring the network of delivery agents and organizations, researchers can more adequately determine how the program is changing and how its effects may vary.

    “By monitoring the network of delivery agents and organizations, researchers can more adequately determine how the program is changing and how its effects may vary.”
    Quote in the paperNot a substantial claim

  • Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

    Premisecitation

    Chambers and others write that assessment of organizational characteristics is seen as an essential component of sustainability, and the fit between context and intervention is at the center of a sustainability phase.

    “Chambers and others [74] write (p. 118) “As a consequence, assessment of organizational characteristics (e.g., structure, climate, culture, resources) is seen as an essential component of sustainability, and indeed, the fit between context and the intervention is at the center of a sustainability phase.””
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites [74] DA Chambers, 2013, The dynamic sustainability framework: addressing the paradox of sustainment amid ongoing change, Implementation Science source

      Not checked in the free run.

  • Probably not a substantial claim: may not pass S4 (based). May combine two claims.

    Interpretationnone given

    Mining and analyzing online networks makes use of accurate data, is cost-effective, and may be less obtrusive than pen-and-paper surveys.

    “Mining and analyzing online networks makes use of accurate data, is cost-effective, and may be less obtrusive than pen-and-paper surveys.”
    Quote in the paperNot a substantial claim

  • May combine two claims.

    Interpretationreasoning

    It is likely that network-based interventions are more cost-effective because of their stronger impacts and because local buy-in and delivery are enhanced.

    “Indeed, it is likely that network-based interventions are more cost-effective because of their stronger impacts and because local buy-in and delivery are enhanced.”
    Quote in the paperNot a substantial claim
    • Rests on an assumption: Existing evidence indicates that network-informed interventions and programs are more effective than non-networked ones.

  • May combine two claims.

    Premisecitation

    Individuals change their behaviors because they perceive themselves to have the personal supports to change, because they see the new behavior as normative, and because they see how it benefits themselves and those around them.

    “Individuals change their behaviors because they perceive themselves to have the personal supports to change, because they see the new behavior as normative, and because they see how it benefits themselves and those around them [21].”
    Quote in the paperSubstantial claim0 of 1 sources checked
    • cites [21] TW Valente, 2010, Social networks and health: Models, methods, and applications source

      Not checked in the free run.

  • Probably not a substantial claim: may not pass S3 (load-bearing), S4 (based).

    Interpretationnone given

    Collecting network data has become easier in today's digital world.

    “Collecting network data has become easier in today’s digital world.”
    Quote in the paperNot a substantial claim

  • Probably not a substantial claim: may not pass S3 (load-bearing), S4 (based).

    Interpretationnone given

    Sustainable programs have created "buzz" that makes people excited about the program and its success, especially within various social media platforms.

    “Finally, related to the last point above, sustainable programs have created “buzz” that makes people excited about the program and its success, especially within various social media platforms.”
    Quote in the paperNot a substantial claim

  • Probably not a substantial claim: may not pass S2 (checkable).

    Interpretationreasoning

    More experience is needed to determine whether networks can be used to assist program implementation.

    “so clearly more experience is needed to determine whether networks can be used to assist program implementation.”
    Quote in the paperNot a substantial claim

  • May combine two claims.

    Premisecitation

    At two intervals during the Gesell intervention, network data were collected and results given to the interventionist with specific advice on activities to increase group cohesiveness.

    “At two intervals during the intervention (weeks 3 and 6), network data were collected and the results of the network analysis were given to the interventionist and provided specific advice on activities to use to increase group cohesiveness.”
    Quote in the paperSubstantial claim0 of 1 sources checked
    • cites [70] S Gessel, 2013, Social network diagnostics: A tool for monitoring group interventions, Implementation Science source

      Not checked in the free run.

  • Classified as probably not a substantial claim.

    Interpretationcitation

    A central tenet of this network paper is that a key organizational characteristic to assess is the network context of program delivery and receipt.

    “A central tenet of this network paper is that a key organizational characteristic to assess is the network context of program delivery and receipt.”
    Quote in the paperSubstantial claim

  • May combine two claims.

    Premisecitation

    Many effective programs are discontinued prematurely and many ineffective ones continued when they should be terminated.

    “And unfortunately many effective programs are discontinued prematurely and many ineffective ones continued when they should be terminated [73].”
    Quote in the paperSubstantial claim0 of 1 sources checked
    • cites [73] RC Brownson, 2015, Understanding mis-implementation in Public Health practice, American Journal of Preventive Medicine source

      Not checked in the free run.

  • Probably not a substantial claim: may not pass S2 (checkable), S4 (based).

    Interpretationreasoning

    Interventions can be conceived as programs that enable people to build and maintain better, health-promoting, and supportive networks in addition to individual changes in cognitions, attitudes, and/or behaviors.

    “Interventions can be conceived as programs that enable people to build and maintain better, health-promoting, and supportive networks in addition to individual changes in cognitions, attitudes, and/or behaviors.”
    Quote in the paperNot a substantial claim

  • Probably not a substantial claim: may not pass S2 (checkable).

    Interpretationreasoning

    Sustainable programs are ones for which these perceptions are maintained among program participants.

    “Sustainable programs are ones for which these perceptions are maintained among program participants.”
    Quote in the paperNot a substantial claim

  • Probably not a substantial claim: may not pass S4 (based).

    Interpretationnone given

    Following the guides provided here using network analysis to aid in needs assessment, program design, and implementation will result in programs that are more sustainable than ones that do not consider the importance of social networks.

    “We expect that following the guides provided here using network analysis to aid in needs assessment, program design, and implementation will result in programs that are more sustainable than ones that do not consider the importance of social networks.”
    Quote in the paperNot a substantial claim
    • Rests on an assumption: Existing evidence indicates that network-informed interventions and programs are more effective than non-networked ones.
51 of 51

  • The authors state this as an assumption.

    Attention to the social networks of implementing agencies, change agents, larger social systems, and intervention recipients will substantially improve the implementation process.

    “The premise of this paper is that attention to the social networks of implementing agencies, change agents, and larger social systems as well as the networks of intervention recipients will substantially improve the implementation process.”

  • The paper relies on this without support.

    Most programs need to be adapted to local settings.

    “Most programs, however, need to be adapted to local settings, which is considered in the exploration phase and developed during the adoption phase.”

  • The paper relies on this without support.

    Program recipients interpret program content within their social and environmental contexts either explicitly or implicitly.

    “Program recipients do not interpret program materials in a vacuum; rather they interpret the content within their social and environmental contexts either explicitly or implicitly.”

  • The paper relies on this without support.

    There is rarely just one network that evolves; rather, there are often multiple networks, at multiple layers, with multiple perspectives that need to be coordinated.

    “In addition, there is rarely just one network that evolves; rather, there are often multiple networks, at multiple layers, with multiple perspectives that need to be coordinated.”

  • The paper relies on this without support.

    Many studies fail to document procedures for recruiting community leaders and partners to participate in health promotion interventions.

    “Unfortunately, many studies fail to document these procedures and so research is needed on how community leaders and partners are recruited to participate in health promotion interventions.”

  • The paper relies on this without support.

    What is lacking is comparison between network intervention methods.

    “What is lacking is comparison between network intervention methods.”

  • The paper relies on this without support.

    Most interventions are not one shot but implemented over many months and involve many sessions.

    “Most interventions are not one shot “single-time, single dose,” but instead are implemented over many months and involve many sessions.”

  • The paper relies on this without support.

    Existing evidence indicates that network-informed interventions and programs are more effective than non-networked ones.

    “Existing evidence indicates that network-informed interventions and programs are more effective than non-networked ones.”

  • The paper relies on this without support.

    All programs think about networks and most probably acknowledge that networks are important components of program design and delivery.

    “All programs think about networks and most probably acknowledge that networks are important components of program design and delivery.”

  • The paper relies on this without support.

    Most programs do not explicitly account for networks in their design, delivery, and evaluation.

    “Yet, most programs do not explicitly account for networks in their design, delivery, and evaluation.”

  • The paper relies on this without support.

    There are many studies showing that networks are important influences on behavior change, but few that directly assess whether intervention agents influence program recipients.

    “There are many studies showing that networks are important influences on behavior change, but few that directly assess whether intervention agents influence program recipients.”

  • The paper relies on this without support.

    There is no rigorous comprehensive database of network experiences for this applied work at the present time.

    “There is no rigorous comprehensive database of network experiences for this applied work at the present time.”

  • The paper relies on this without support.

    There is a wealth of knowledge about how to collect and analyze social network data, and a plethora of measures that can be used to improve the design, delivery, and assessment of public health interventions.

    “There is, however, a wealth of knowledge about how to collect and analyze social network data, and a plethora of measures, both individual- and network-level, that can be used to improve the design, delivery, and assessment of public health interventions.”

  • The paper relies on this without support.

    Everyone knows who they go to for advice or whom they spend time with.

    “Everyone knows who they go to for advice or whom they spend time with.”

  • The paper relies on this without support.

    Students cluster into identifiable cliques and groups.

    “Yet, we know that students cluster into identifiable cliques and groups.”

  • The paper relies on this without support.

    School-based programs are often created with the intention of delivering the same content to all students.

    “For example, school-based programs are often created with the intention of delivering the same content to all students.”

  • The paper relies on this without support.

    Program participants will tweet and post their reactions to intervention materials and activities.

    “Program participants will tweet and post their reactions to intervention materials and activities.”
17 of 17

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

  • Interorganizational networks may contribute to the adoption and utilization of practices that may be with or without an evidence base.

    “For example, interorganizational networks may contribute to the adoption and utilization of practices that may be with or without an evidence base (Greenhalgh et al., 2004; Valente, 2010; Valente et al., 2015).”

    From Implementation-as-Usual in Community-Based Organizations Providing Specialized Services to Individuals with Autism Spectrum Disorder: A Mixed Methods Study (2021) · cites this paper as Valente et al., 2015

    The ‘Frameworks for the Stages of Implementation’ section (page unavailable) says social networks may matter when deciding which interventions to adopt and describes pre-existing inter-organizational relations in a prevention coalition. It discusses evidence-based programs, but does not establish the claim that such networks contribute to the adoption or use of practices without an evidence base. (LLM, conf=0.84)

    Experimental — accuracy not yet measured

  • Dissemination or implementation can involve a single community or organization, with research focused on internal diffusion through network ties.

    “Likewise, dissemination or implementation may involve one single community or organization, with a research focus on understanding the internal diffusion process (110) involving network connections inside this system (108).”

    From An Overview of Research and Evaluation Designs for Dissemination and Implementation (2017) · cites this paper as [108]

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

Each contradiction between two passages listed here was confirmed by an independent check.

  • Citation year for reference 75 differs from the reference list

    Minor

    Table 1 gives reference 75 a publication year of 2010, while the reference list gives 2011.

  • Reference 70 author surname differs from the text

    Minor

    The text identifies the author of reference 70 as Gesell, but the reference list spells the surname Gessel.

2 of 2

Cites

Flagged first, then by citations

4 of the 95 references couldn’t be matched to a known paper.

Research works printed but not linked: 1

  1. A Neaigus, 1998, The network approach and interventions to prevent HIV among injection drug users, Public Health Reports, 113, 140

Cited by

Sorted by citations

Related

Authors
Valente, T. W., Palinkas, L. A., Czaja, S., Chu, K.-H., & Brown, C. H.
Affiliations
  • University of Southern California (US)
  • University of Miami (US)
  • Northwestern University (US)
Corresponding author
Valente, Thomas W.
ORCID
Venue
PLOS ONE
Publisher
Public Library of Science (PLoS)
Published
2015-06-25
Volume
10
Issue
6
Pages
e0131712
ISSN
1932-6203 (ISSN-L)
DOI
10.1371/journal.pone.0131712
PMC
PMC4482437
OpenAlex
W772517852
Semantic Scholar
0e62bf5e19d6c3aa97f3cc5ff33e80f1ed73499d
Cited by
332
References
95
Citations by year
2026: 20 · 2025: 24 · 2024: 33 · 2023: 38 · 2022: 30 · 2021: 41 · 2020: 54 · 2019: 28 · 2018: 25 · 2017: 22 · 2016: 12 · 2015: 3 · 2013: 1
FWCI
37.79
Type
journal article
Language
en
Open access
Licence
Locations
  • PLoS ONE (publishedVersion, cc-by)
  • Europe PMC (PubMed Central) (publishedVersion, cc-by)
  • PubMed Central (publishedVersion, cc-by)
  • PubMed (publishedVersion)
  • DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
Funders
National Institute on Drug Abuse (P30DA027828, DA027828)
Topics
  • Health Sciences › Health Professions › General Health Professions › Health Policy Implementation Science
  • Social Sciences › Decision Sciences › Management Science and Operations Research › Evaluation and Performance Assessment
  • Social Sciences › Public Administration › Public Policy and Administration Research
Keywords
social network analysis, program implementation, implementation research, implementation barriers, network metrics, intersectoral collaboration, community leaders, implementation monitoring, program sustainability
MeSH terms
Algorithms, Behavioral Medicine, Health Education, Health Promotion, Health Services, Social Support, Health Behavior, Program Development, Evidence-Based Medicine, Substance-Related Disorders, Needs Assessment, Social Networking, Social Media

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Claims read by deepseek-v4.1-flash under definition version 3 (extract-v3) on 2026-10-06.

Classified by jev-1.13-20260917 (gold-guideline-v0.2) on 2026-10-06.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review