Practice-Based Research Networks and the Mandate for Real-World Evidence
Open accessThe DOI matches its Crossref record; 61 of the 61 references it cites were found in a registry or an index.
Abstract
The 21 st Century Cures Act encourages the Food and Drug Administration to consider “real-world evidence” in its regulation of the safety and efficacy of drugs and devices. Many have interpreted this mandate to focus on non-randomized observational research. However, we suggest that regulatory science must also move from rarefied academic hospitals to community-based settings, where the vast majority of patients in fact receive care in the fragmented U.S. healthcare system. This move is especially important if innovations are to reach, and be validated in, more diverse populations. A solution can be found in the 183 Practiced-Based Research Networks (“PBRN”), i.e., groups of primary care clinicians and practices in all 50 states working to improve clinical care and translate research findings into practice. This symposium contribution seeks to (1) describe some of the common shortcomings of clinical trials, (2) explore the opportunities and challenges posed by use of real-world evidence as a basis for drug and device regulation, (3) briefly describe the history and evolution of PBRNs, and (4) articulate the challenges and opportunities for using PBRNs to fulfill the 21 st Century Cures Act mandate for real-world evidence.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Citations
Cites
Participation in Cancer Clinical Trials: Race-, Sex-, and Age-Based Disparities
Murthy, V. H., Krumholz, H. M., & Gross, C. P. (2004) · JAMA · doi:10.1001/jama.291.22.2720 · Cited by 2,078
Real-World Evidence — What Is It and What Can It Tell Us?
Sherman, R. E., Anderson, S. A., Dal Pan, G. J., Gray, G. W., Gross, T., Hunter, N. L., LaVange, L., Marinac-Dabic, D., Marks, P. W., Robb, M. A., et al. (2016) · New England Journal of Medicine · doi:10.1056/nejmsb1609216 · Cited by 2,063
The Meaning of Translational Research and Why It Matters
Woolf, S. H. (2008) · JAMA · doi:10.1001/jama.2007.26 · Cited by 1,910
Central challenges facing the national clinical research enterprise
Sung, N. S., Crowley, W. F., Genel, M., Salber, P., Sandy, L., Sherwood, L. M., Johnson, S. B., Catanese, V., Tilson, H., Getz, K., et al. (2003) · JAMA · doi:10.1001/jama.289.10.1278 · Cited by 1,235
Practice-based research--“Blue Highways” on the NIH roadmap
Westfall, J. M., Mold, J., & Fagnan, L. (2007) · JAMA · doi:10.1001/jama.297.4.403 · Cited by 1,209
Attitudes and beliefs of african americans toward participation in medical research
Corbie-Smith, G., Thomas, S. B., Williams, M. V., & Moody-Ayers, S. (1999) · Journal of General Internal Medicine · doi:10.1046/j.1525-1497.1999.07048.x · Cited by 1,021
Clinical Research to Clinical Practice — Lost in Translation?
Lenfant, C. (2003) · New England Journal of Medicine · doi:10.1056/nejmsa035507 · Cited by 898
The Ecology of Medical Care Revisited
Green, L. A., Fryer, G. E., Yawn, B. P., Lanier, D., & Dovey, S. M. (2001) · New England Journal of Medicine · doi:10.1056/nejm200106283442611 · Cited by 856
A pragmatic view on pragmatic trials
Patsopoulos, N. A. (2011) · Dialogues in Clinical Neuroscience · doi:10.31887/dcns.2011.13.2/npatsopoulos · Cited by 844
The Problem of Fragmentation and the Need for Integrative Solutions
Stange, K. C. (2009) · The Annals of Family Medicine · doi:10.1370/afm.971 · Cited by 569
Mills, E. J., Seely, D., Rachlis, B., Griffith, L., Wu, P., Wilson, K., Ellis, P., & Wright, J. R. (2006) · The Lancet Oncology · doi:10.1016/s1470-2045(06)70576-9 · Cited by 536
Godwin, M., Ruhland, L., Casson, I., MacDonald, S., Delva, D., Birtwhistle, R., Lam, M., & Seguin, R. (2003) · BMC Medical Research Methodology · doi:10.1186/1471-2288-3-28 · Cited by 506
Shavers, V. L., Lynch, C. F., & Burmeister, L. F. (2002) · Annals of Epidemiology · doi:10.1016/s1047-2797(01)00265-4 · Cited by 501
Reengineering Translational Science: The Time Is Right
Collins, F. S. (2011) · Science Translational Medicine · doi:10.1126/scitranslmed.3002747 · Cited by 479
Barriers to Clinical Trial Enrollment in Racial and Ethnic Minority Patients with Cancer
Hamel, L. M., Penner, L. A., Albrecht, T. L., Heath, E., Gwede, C. K., & Eggly, S. (2016) · Cancer Control · doi:10.1177/107327481602300404 · Cited by 463
Herrera, A. P., Snipes, S. A., King, D. W., Torres-Vigil, I., Goldberg, D. S., & Weinberg, A. D. (2010) · American Journal of Public Health · doi:10.2105/ajph.2009.162982 · Cited by 392
The Ottawa Statement on the Ethical Design and Conduct of Cluster Randomized Trials
Weijer, C., Grimshaw, J. M., Eccles, M. P., McRae, A. D., White, A., Brehaut, J. C., Taljaard, M., & Ottawa Ethics of Cluster Randomized Trials Consensus Group (2012) · PLoS Medicine · doi:10.1371/journal.pmed.1001346 · Cited by 292
Heller, C., Balls-Berry, J. E., Nery, J. D., Erwin, P. J., Littleton, D., Kim, M., & Kuo, W. P. (2014) · Contemporary Clinical Trials · doi:10.1016/j.cct.2014.08.004 · Cited by 290
Eldridge, S. M., Ashby, D., Feder, G. S., Rudnicka, A. R., & Ukoumunne, O. C. (2004) · Clinical Trials · doi:10.1191/1740774504cn006rr · Cited by 288
Mold, J. W. (2005) · The Annals of Family Medicine · doi:10.1370/afm.303 · Cited by 271
Participation in Research and Access to Experimental Treatments by HIV-Infected Patients
Gifford, A. L., Cunningham, W. E., Heslin, K. C., Andersen, R. M., Nakazono, T., Lieu, D. K., Shapiro, M. F., & Bozzette, S. A. (2002) · New England Journal of Medicine · doi:10.1056/nejmsa011565 · Cited by 242
Trust: The Fragile Foundation of Contemporary Biomedical Research
Kass, N. E., Sugarman, J., Faden, R., & Schoch-Spana, M. (1996) · The Hastings Center Report · doi:10.2307/3528467 · Cited by 240
Altschuler, J., Margolius, D., Bodenheimer, T., & Grumbach, K. (2012) · The Annals of Family Medicine · doi:10.1370/afm.1400 · Cited by 231
Chen, R., Desai, N. R., Ross, J. S., Zhang, W., Chau, K. H., Wayda, B., Murugiah, K., Lu, D. Y., Mittal, A., & Krumholz, H. M. (2016) · BMJ · doi:10.1136/bmj.i637 · Cited by 227
Systematic Review: Antihypertensive Drug Therapy in Black Patients
Brewster, L. M., van Montfrans, G. A., & Kleijnen, J. (2004) · Annals of Internal Medicine · doi:10.7326/0003-4819-141-8-200410190-00009 · Cited by 203
Exploring the ethical and regulatory issues in pragmatic clinical trials
Califf, R. M., & Sugarman, J. (2015) · Clinical Trials · doi:10.1177/1740774515598334 · Cited by 191
Green, L. A., & Hickner, J. (2006) · The Journal of the American Board of Family Medicine · doi:10.3122/jabfm.19.1.1 · Cited by 187
A Randomized Study of How Physicians Interpret Research Funding Disclosures
Kesselheim, A. S., Robertson, C. T., Myers, J. A., Rose, S. L., Gillet, V., Ross, K. M., Glynn, R. J., Joffe, S., & Avorn, J. (2012) · New England Journal of Medicine · doi:10.1056/nejmsa1202397 · Cited by 183
Self-citationGarrison, H. H., & Deschamps, A. M. (2014) · The FASEB Journal · doi:10.1096/fj.13-241687 · Cited by 165
Epidemiology of Type 2 Diabetes: Focus on Ethnic Minorities
Egede, L. E., & Dagogo-Jack, S. E. (2005) · Medical Clinics of North America · doi:10.1016/j.mcna.2005.03.004 · Cited by 154
Perrin, J. M., Charney, E., MacWhinney, J. B., McInerny, T. K., Miller, R. L., & Nazarian, L. F. (1974) · New England Journal of Medicine · doi:10.1056/nejm197409262911307 · Cited by 135
Academic Medical Centers' Standards for Clinical-Trial Agreements with Industry
Mello, M. M., Clarridge, B. R., & Studdert, D. M. (2005) · New England Journal of Medicine · doi:10.1056/nejmsa044115 · Cited by 132
Ethics and Regulatory Complexities for Pragmatic Clinical Trials
Sugarman, J., & Califf, R. M. (2014) · JAMA · doi:10.1001/jama.2014.4164 · Cited by 127
Taveras, E. M., Marshall, R., Kleinman, K., Gillman, M. W., Hacker, K. A., Horan, C. M., Smith, R. L., Price, S. N., Sharifi, M., Rifas‐Shiman, S. L., et al. (2015) · Archives of Pediatrics and Adolescent Medicine · doi:10.1001/jamapediatrics.2015.0182 · Cited by 120
Use of Health Care Databases to Support Supplemental Indications of Approved Medications
Fralick, M., Kesselheim, A. S., Avorn, J., & Schneeweiss, S. (2018) · JAMA Internal Medicine · doi:10.1001/jamainternmed.2017.3919 · Cited by 119
A National Survey of Primary Care Practice-Based Research Networks
Tierney, W. M., Oppenheimer, C. C., Hudson, B. L., Benz, J., Finn, A., Hickner, J. M., Lanier, D., & Gaylin, D. S. (2007) · The Annals of Family Medicine · doi:10.1370/afm.699 · Cited by 110
Medication errors reported by US family physicians and their office staff
Kuo, G. M., Phillips, R. L., Graham, D., & Hickner, J. M. (2008) · BMJ Quality & Safety · doi:10.1136/qshc.2007.024869 · Cited by 108
Racial Disparities Among Clinical Research Investigators
Getz, K. A., & Faden, L. B. (2008) · American Journal of Therapeutics · doi:10.1097/mjt.0b013e31815fa75a · Cited by 89
Azithromycin for Bronchial Asthma in Adults: An Effectiveness Trial
Hahn, D. L., Grasmick, M., Hetzel, S., Yale, S. H., & on behalf of the AZMATICS (AZithroMycin-Asthma Trial In Community Settings) Study Group (2012) · The Journal of the American Board of Family Medicine · doi:10.3122/jabfm.2012.04.110309 · Cited by 75
Adherence reporting in randomized controlled trials
Zhang, Z., Peluso, M. J., Gross, C. P., Viscoli, C. M., & Kernan, W. N. (2014) · Clinical Trials · doi:10.1177/1740774513512565 · Cited by 70
Geographic distribution of clinical trials may lead to inequities in access
Seidler, E. M., Keshaviah, A. P., Brown, C. D., Wood, E. A., Granick, L., & Kimball, A. B. (2014) · Clinical Investigation · doi:10.4155/cli.14.21 · Cited by 65
Gupta, S. K., & Nayak, R. P. (2014) · Journal of Pharmacology and Pharmacotherapeutics · doi:10.4103/0976-500x.130046 · Cited by 63
Sherman, R. E., Davies, K. M., Robb, M. A., Hunter, N. L., & Califf, R. M. (2017) · Nature Reviews Drug Discovery · doi:10.1038/nrd.2017.25 · Cited by 60
Selection of patients for clinical trials: an interactive web-based system
Fink, E., Kokku, P. K., Nikiforou, S., Hall, L., Goldgof, D. B., & Krischer, J. P. (2004) · Artificial Intelligence in Medicine · doi:10.1016/j.artmed.2004.01.017 · Cited by 59
Fagnan, L. J., Davis, M., Deyo, R. A., Werner, J. J., & Stange, K. C. (2010) · Academic Medicine · doi:10.1097/acm.0b013e3181cd2ed3 · Cited by 58
Graham, D. G., Spano, M. S., Stewart, T. V., Staton, E. W., Meers, A., & Pace, W. D. (2007) · The Journal of the American Board of Family Medicine · doi:10.3122/jabfm.2007.02.060103 · Cited by 55
Cohen, D., Keller, DeVoe, & Davis (2012) · Journal of Healthcare Leadership · doi:10.2147/jhl.s16441 · Cited by 54
Getrich, C. M., Sussman, A. L., Campbell‐Voytal, K., Tsoh, J. Y., Williams, R., Brown, A. E., Potter, M. B., Spears, W., Weller, N. F., Pascoe, J. M., et al. (2013) · The Annals of Family Medicine · doi:10.1370/afm.1543 · Cited by 53
Hickner, J. M., Zafar, A., Kuo, G. M., Fagnan, L. J., Forjuoh, S. N., Knox, L. M., Lynch, J. T., Stevens, B. K., Pace, W. D., Hamlin, B. N., et al. (2010) · The Annals of Family Medicine · doi:10.1370/afm.1169 · Cited by 46
Hickner, J., & Green, L. A. (2015) · The Journal of the American Board of Family Medicine · doi:10.3122/jabfm.2015.05.150227 · Cited by 42
Gibson, K., Szilagyi, P., Swanger, C. M., Campbell, T., McInerny, T., Duckett, J., Guido, J. J., & Fiscella, K. (2010) · The Journal of the American Board of Family Medicine · doi:10.3122/jabfm.2010.04.090160 · Cited by 39
Lang, T. A. (2011) · American Journal of Tropical Medicine and Hygiene · doi:10.4269/ajtmh.2011.11-0151 · Cited by 34
Kuo, G. M., Steinbauer, J. R., & Spann, S. J. (2008) · Journal of the American Pharmacists Association · doi:10.1331/japha.2008.07142 · Cited by 23
Role of practice-based research networks in comparative effectiveness research
Hartung, D. M., Guise, J., Fagnan, L. J., Davis, M. M., & Stange, K. C. (2012) · Journal of Comparative Effectiveness Research · doi:10.2217/cer.11.7 · Cited by 22
Sprague, D., Russo, J., LaVallie, D. L., & Buchwald, D. (2013) · The Journal of Rural Health · doi:10.1111/j.1748-0361.2012.00432.x · Cited by 22
Sinclair-Lian, N., Rhyne, R. L., Alexander, S. H., & Williams, R. L. (2008) · The Journal of the American Board of Family Medicine · doi:10.3122/jabfm.2008.04.080022 · Cited by 21
Hames, C. G. (1971) · Archives of Internal Medicine · doi:10.1001/archinte.1971.00310240037002 · Cited by 19
Curtis, G. (2014) · Journal of Clinical Medicine Research · doi:10.14740/jocmr1855w · Cited by 10
Haggerty, T. S., Cole, A., Xiang, J., Mainous, A. G., & Seehusen, D. A. (2017) · Southern Medical Journal · doi:10.14423/smj.0000000000000631 · Cited by 7
Comparison of Observational Data and the ONTARGET Results for Telmisartan Treatment of Hypertension
Califf, R. M. (2017) · JAMA Internal Medicine · doi:10.1001/jamainternmed.2017.5091 · Cited by 5
Pharma-payer partnerships seek to prove effectiveness of care.
Dawson, M. (2014) · PubMed · Cited by 2
Research works printed but not linked: 1
- Hilton, Comparison of CaOH with MTA for Direct Pulp Capping: A PBRN Randomized Clinical Trial, >J. Dental Res, 92>
Cited by
Structure, function, and productivity from the National Dental Practice-Based Research Network.
Gilbert, G. H., Fellows, J. L., Allareddy, V., Cochran, D. L., Cunha-Cruz, J., Gordan, V. V., McBurnie, M. A., Meyerowitz, C., Mungia, R., Rindal, D. B., et al. (2022) · Journal of Clinical and Translational Science · doi:10.1017/cts.2022.421 · Cited by 54
“Practice-based research networks (PBRNs) offer unique advantages to clinical research and quality improvement [1-6], primarily because they bring practice-relevant topics onto the research agenda and are conducted in “real-world,” nonacademic clinical settings where almost all of the population receives its health car…”
BackgroundPragmaticism in Cancer Clinical Trials
Sankar, K. N., Redman, M. W., Dragnev, K. H., Henick, B. S., Iams, W. T., Blanke, C. D., Herbst, R. S., Gray, J. E., & Reckamp, K. L. (2024) · American Society of Clinical Oncology Educational Book · doi:10.1200/edbk_100040 · Cited by 21
Associations between practice patterns and dental education in special care dentistry
Gysling, S. P., Taiclet, L. M., & Polk, D. E. (2020) · Journal of Dental Education · doi:10.1002/jdd.12254 · Cited by 14
21stCentury Cures for the Opioid Crisis: Promise, Impact, and Missed Opportunities
Beletsky, L. A. (2018) · American Journal of Law & Medicine · doi:10.1177/0098858818789417 · Cited by 10
Rognoni, C., Pohlmeier, R., & Tarricone, R. (2025) · Advances in Therapy · doi:10.1007/s12325-025-03186-8 · Cited by 6
“Limited demographic distributions in these trials may exclude certain population segments from safety assurances [102].”
Metadata
- Authors
- Hall-Lipsy, E., Barraza, L., & Robertson, C.
- Affiliations
- University of Arizona (US)
- Venue
- American Journal of Law & Medicine
- Publisher
- Cambridge University Press (CUP)
- Published
- 2018-05
- Volume
- 44
- Issue
- 2-3
- Pages
- 219-236
- ISSN
- 0098-8588 (ISSN-L)
- 2375-835X
- OpenAlex
- W2885949130
- Cited by
- 16
- References
- 61
- Citations by year
- 2026: 1 · 2025: 3 · 2024: 4 · 2023: 2 · 2022: 1 · 2020: 2 · 2019: 2 · 2018: 1
- FWCI
- 1.57
- Type
- journal article
- Language
- en
- Open access
- Licence
- cc-by-nc-sa
- www.cambridge.org/core/terms (unspecified, 981 d)
- journals.sagepub.com/page/policies/text-and-data-mining-license (tdm)
- Locations
- American Journal of Law & Medicine (publishedVersion)
- PubMed (publishedVersion)
- eYLS (Yale Law School) (submittedVersion, cc-by-nc-sa)
- Topics
- Health Sciences › Medicine › Public Health, Environmental and Occupational Health › Healthcare Regulation
- Health Sciences › Nursing › Issues, ethics and legal aspects › Biomedical Ethics and Regulation
- Health Sciences › Nursing › Issues, ethics and legal aspects › Pharmaceutical industry and healthcare
- Keywords
- practice-based research networks, real-world evidence, 21st Century Cures Act, regulatory science, community-based research, primary care providers, clinical trial limitations, clinical translation, health equity, diverse populations
- MeSH terms
- Health Policy, Humans, United States, Drug Approval, Biomedical Research, General Practice, Medical Device Legislation
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.