Validity and Reproducibility of a Food Frequency Interview in a Multi-Cultural Epidemiologic Study
Abstract
Purpose There is limited support for the validity and reproducibility of dietary assessment in culturally diverse populations. The goal of this study was to evaluate the comparative validity and reproducibility of a Food Frequency Questionnaire (FFQ) used in the observational, multi-cultural Insulin Resistance Atherosclerosis Study (IRAS).Methods Women (n = 186) were approximately equally distributed by ethnicity from one urban center (African Americans and non-Hispanic whites) and one rural center (Hispanics and non-Hispanic whites). The IRAS FFQ was modified from the National Cancer Institute Health Habits and History Questionnaire to include ethnic and regional foods. Validity was assessed by comparing dietary values, including supplements, obtained from the FFQ to the average intake estimated from a series of 8 24-hour dietary recalls collected by telephone over the same 1-year period. Reproducibility was assessed among women who reported no change in their usual diet (n = 133) by comparing data from the original IRAS FFQ (in-person) with the FFQ administered for the validity study (two to four years later, by telephone).Results Correlation coefficients for validity were statistically significant for most nutrients (mean r = 0.62 urban non-Hispanic white, 0.61 rural non-Hispanic whites, 0.50 African American, 0.41 Hispanic) and did not differ among subgroups of obesity or diabetes status. The median correlation coefficient for the total sample was 0.49. Correlations were lower for women with less than 12 years of education (mean r = 0.30; median r = 0.25). The lower correlations among Hispanics was largely explained by the lower educational attainment in that sample. For reproducibility, the mean correlation for nutrients evaluated was r = 0.62 (median r = 0.63) and did not differ for subgroups.Conclusions Although educational attainment must be considered, the IRAS FFQ appears to be reasonably valid and reliable in a diverse cohort.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
Physical activity was assessed using two standardized and validated questionnaires, LoPAR and MAQ, completed annually.
“The amount of physical activity was assessed using two standardized and validated questionnaires, the Low-level Physical Activity Recall (LoPAR) and the Modified Activity Questionnaire (MAQ), which were completed annually (14).”
From ]. The Influence of Age on the Effects of Lifestyle Modification and Metformin in Prevention of Diabetes (2006) · cites this paper as [14]
Cites
Total energy intake: implications for epidemiologic analyses.
WILLETT, W., & STAMPFER, M. J. (1986) · American Journal of Epidemiology · doi:10.1093/oxfordjournals.aje.a114366 · Cited by 2,751 · see citing works
RE: “TOTAL ENERGY INTAKE: IMPLICATIONS FOR EPIDEMIOLOGIC ANALYSES”
Palmgren, J., & Kushi, L. H. (1991) · American Journal of Epidemiology · doi:10.1093/oxfordjournals.aje.a115841 · Cited by 2,712 · see citing works
A DATA-BASED APPROACH TO DIET QUESTIONNAIRE DESIGN AND TESTING
Block, G., Hartman, A. M., DRESSER, C. M., Carroll, M. D., Gannon, J. G., & Gardner, L. B. (1986) · American Journal of Epidemiology · doi:10.1093/oxfordjournals.aje.a114416 · Cited by 2,150 · see citing works
Rimm, E. B., Giovannucci, E. L., Stampfer, M. J., Colditz, G. A., Litin, L. B., & Willett, W. C. (1992) · American Journal of Epidemiology · doi:10.1093/oxfordjournals.aje.a116211 · Cited by 2,104 · see citing works
Validation of a self-administered diet history questionnaire using multiple diet records
Block, G., Woods, M., Potosky, A., & Clifford, C. (1990) · Journal of Clinical Epidemiology · doi:10.1016/0895-4356(90)90099-b · Cited by 1,197 · see citing works
A REVIEW OF VALIDATIONS OF DIETARY ASSESSMENT METHODS
BLOCK, G. (1982) · American Journal of Epidemiology · doi:10.1093/oxfordjournals.aje.a113331 · Cited by 823 · see citing works
Liu, K., Stamler, J., Dyer, A. R., McKeever, J., & McKeever, P. D. (1978) · Journal of Chronic Diseases · doi:10.1016/0021-9681(78)90004-8 · Cited by 558 · see citing works
Nelson, M., Black, A. E., Morris, J., & Cole, T. J. (1989) · American Journal of Clinical Nutrition · doi:10.1093/ajcn/50.1.155 · Cited by 530 · see citing works
The Insulin Resistance Atherosclerosis Study (IRAS)
Wagenknecht, L. E., Mayer, E. J., Rewers, M., Haffner, S. M., Selby, J. V., Borok, G. M., Henkin, L. F., Howard, G., Savage, P. J., Saad, M. F., et al. (1995) · Annals of Epidemiology · doi:10.1016/1047-2797(95)00062-3 · Cited by 493 · see citing works
Reproducibility and Validity of Food Frequency Questionnaires
Willett, W. C., & Lenart, E. B. (2012) · Oxford University Press eBooks · doi:10.1093/acprof:oso/9780199754038.003.0006 · Cited by 427 · see citing works
Milner, J., McGuire, V. M., Feather, T., & Little, J. A. (1983) · American Journal of Clinical Nutrition · doi:10.1093/ajcn/37.6.986 · Cited by 395 · see citing works
Kristal, A. R., Feng, Z., Coates, R. J., Oberman, A., & George, V. A. (1997) · American Journal of Epidemiology · doi:10.1093/oxfordjournals.aje.a009203 · Cited by 298 · see citing works
A study of the reliability and comparative validity of the cardia dietary history.
Liu, K., Slattery, M. L., Jacobs, D. R., Cutter, G., McDonald, A., Horn, L. V., Hilner, J. E., Caan, B. J., Bragg, C., & Dyer, A. R. (1994) · PubMed · Cited by 264 · see citing works
Coates, R. J., Eley, J. W., Block, G., Gunter, E. W., Sowell, A. L., Grossman, C., & Greenberg, R. S. (1991) · American Journal of Epidemiology · doi:10.1093/oxfordjournals.aje.a116138 · Cited by 173 · see citing works
Validity of telephoned diet recalls and records for assessment of individual food intake
Krantzler, N. J., Mullen, B. J., Schutz, H., Grivetti, L. E., Holden, C. A., & Meiselman, H. L. (1982) · American Journal of Clinical Nutrition · doi:10.1093/ajcn/36.6.1234 · Cited by 143 · see citing works
Validation of two-dimensional models for estimation of perttion size in nutrition research
Posner, B. M., Smigelski, C., DUGGAL, A., MORGAN, J. L., Cobb, J. L., & Cupples, L. A. (1992) · Journal of the American Dietetic Association · doi:10.1016/s0002-8223(21)00718-5 · Cited by 130 · see citing works
Assessing the nation’s diet: Limitations of the fool frequency questionnaire
BRIEFEL, R. R., Flegal, K. M., Winn, D. M., Loria, C. M., Johnson, C. L., & Sempos, C. T. (1992) · Journal of the American Dietetic Association · doi:10.1016/s0002-8223(21)00834-8 · Cited by 111 · see citing works
The validity of a telephone-administered 24-hour dietary recall methodology
Posner, B. M., Borman, C., Morgan, J., Borden, W., & Ohls, J. C. (1982) · American Journal of Clinical Nutrition · doi:10.1093/ajcn/36.3.546 · Cited by 109 · see citing works
Assessments of food-frequency questionnaires in minority populations
Coates, R., & Monteilh, C. (1997) · American Journal of Clinical Nutrition · doi:10.1093/ajcn/65.4.1108s · Cited by 85 · see citing works
Effect of Measurement Error on Energy-Adjustment Models in Nutritional Epidemiology
Kipnis, V., Freedman, L. S., Brown, C. C., Hartman, A. M., Schatzkin, A. G., & Wacholder, S. (1997) · American Journal of Epidemiology · doi:10.1093/oxfordjournals.aje.a009202 · Cited by 78 · see citing works
COUNTING CALORIES: PARTITIONING ENERGY INTAKE ESTIMATES FROM A FOOD FREQUENCY QUESTIONNAIRE
Flegal, K. M., Larkin, F. A., Metzner, H. L., Thompson, F. E., & Guire, K. E. (1988) · American Journal of Epidemiology · doi:10.1093/oxfordjournals.aje.a115028 · Cited by 61 · see citing works
Coates, R. J., Serdula, M. K., Byers, T., Mokdad, A. H., Jewell, S., Leonard, S. B., Ritenbaugh, C., Newcomb, P. A., Mares‐Perlman, J. A., Chávez, N., et al. (1995) · Journal of Nutrition · doi:10.1093/jn/125.6.1473 · Cited by 48 · see citing works
Development of a food frequency instrument: Ethnic differences in food sources
Borrud, L. G., McPherson, R. S., Nichaman, M. Z., Pillow, P. C., & Newell, G. R. (1989) · Nutrition and Cancer · doi:10.1080/01635588909514020 · Cited by 44 · see citing works
Dietary Methodology Workshop for the Third National Health and Nutrition Examination Survey
BRIEFEL, R. R., & Sempos, C. T. (1992) · Cited by 20 · see citing works
Statistical issues related to the design of dietary survey methodology for NHANES III.
Liu, K. (1992) · PubMed · Cited by 9 · see citing works
Flagged first, then by citations
Cited by
Sorted by citations
Reduction in the incidence of type 2 diabetes with lifestyle intervention or metformin
(2002) · New England Journal of Medicine · doi:10.1056/nejmoa012512 · Cited by 19,011 · see citing works
Effectiveness of brief alcohol interventions in primary care populations
Kaner, E. F., Beyer, F. R., Muirhead, C., Campbell, F., Pienaar, E. D., Bertholet, N., Daeppen, J. B., Saunders, J. B., & Burnand, B. (2018) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd004148.pub4 · Cited by 1,665 · see citing works
Development, validation and utilisation of food-frequency questionnaires – a review
Cade, J., Thompson, R., Burley, V., & Warm, D. (2002) · Public Health Nutrition · doi:10.1079/phn2001318 · Cited by 1,423 · see citing works
Effect of weight loss with lifestyle intervention on risk of diabetes
Hamman, R. F., Wing, R. R., Edelstein, S. L., Lachin, J. M., Bray, G. A., Delahanty, L., Hoskin, M., Kriska, A. M., Mayer-Davis, E. J., Pi-Sunyer, X., et al. (2006) · Diabetes Care · doi:10.2337/dc06-0560 · Cited by 1,344 · see citing works
Self-citationFood-frequency questionnaires: a review of their design, validation and utilisation
Cade, J. E., Burley, V. J., Warm, D. L., Thompson, R. L., & Margetts, B. M. (2004) · Nutrition Research Reviews · doi:10.1079/nrr200370 · Cited by 518 · see citing works
Nettleton, J. A., Steffen, L. M., Mayer-Davis, E. J., Jenny, N. S., Jiang, R., Herrington, D. M., & Jacobs, D. R. (2006) · The American Journal of Clinical Nutrition · doi:10.1093/ajcn/83.6.1369 · Cited by 484 · see citing works
Self-citationFour-year weight losses in the Look AHEAD study: factors associated with long-term success
Wadden, T. A., Neiberg, R. H., Wing, R. R., Clark, J. M., Delahanty, L. M., Hill, J. O., Krakoff, J., Otto, A., Ryan, D. H., Vitolins, M. Z., et al. (2011) · Obesity · doi:10.1038/oby.2011.230 · Cited by 465 · see citing works
Self-citationVillegas, R., Liu, S., Gao, Y.-T., Yang, G., Li, H., Zheng, W., & Shu, X. O. (2007) · Archives of Internal Medicine · doi:10.1001/archinte.167.21.2310 · Cited by 431 · see citing works
de Oliveira Otto, M. C., Mozaffarian, D., Kromhout, D., Bertoni, A. G., Sibley, C. T., Jacobs, D. R., & Nettleton, J. A. (2012) · The American Journal of Clinical Nutrition · doi:10.3945/ajcn.112.037770 · Cited by 364 · see citing works
Mozaffarian, D., de Oliveira Otto, M. C., Lemaitre, R. N., Fretts, A. M., Hotamisligil, G., Tsai, M. Y., Siscovick, D. S., & Nettleton, J. A. (2013) · The American Journal of Clinical Nutrition · doi:10.3945/ajcn.112.045468 · Cited by 270 · see citing works
The Diabetes Prevention Program Research Group [Prepared by Jill Crandall, D. S. (2006) · The Journals of Gerontology Series A: Biological Sciences and Medical Sciences · doi:10.1093/gerona/61.10.1075 · Cited by 254 · see citing works
Hébert, J. R., Peterson, K. E., Hurley, T. G., Stoddard, A. M., Cohen, N., Field, A. E., & Sorensen, G. (2001) · Annals of Epidemiology · doi:10.1016/s1047-2797(01)00212-5 · Cited by 146 · see citing works
Use of dietary indices to control for diet in human gut microbiota studies
Bowyer, R. C. E., Jackson, M. A., Pallister, T., Skinner, J., Spector, T. D., Welch, A. A., & Steves, C. J. (2018) · Microbiome · doi:10.1186/s40168-018-0455-y · Cited by 140 · see citing works
de Oliveira Otto, M. C., Nettleton, J. A., Lemaitre, R. N., M. Steffen, L., Kromhout, D., Rich, S. S., Y. Tsai, M., Jacobs, D. R., & Mozaffarian, D. (2013) · Journal of the American Heart Association · doi:10.1161/jaha.113.000092 · Cited by 135 · see citing works
Whole and Refined Grain Intakes Are Related to Inflammatory Protein Concentrations in Human Plasma
Masters, R. C., Liese, A. D., Haffner, S. M., Wagenknecht, L. E., & Hanley, A. J. (2010) · The Journal of Nutrition · doi:10.3945/jn.109.116640 · Cited by 121 · see citing works
Abiemo, E. E., Alonso, A., Nettleton, J. A., Steffen, L. M., Bertoni, A. G., Jain, A., & Lutsey, P. L. (2013) · British Journal of Nutrition · doi:10.1017/s0007114512003339 · Cited by 112 · see citing works
Lachin, J. M., Christophi, C. A., Edelstein, S. L., Ehrmann, D. A., Hamman, R. F., Kahn, S. E., Knowler, W. C., Nathan, D. M., & on behalf of the DPP Research Group (2007) · Diabetes · doi:10.2337/db06-0918 · Cited by 107 · see citing works
Vitolins, M. Z., Anderson, A. M., Delahanty, L., Raynor, H., Miller, G. D., Mobley, C., Reeves, R., Yamamoto, M., Champagne, C., Wing, R. R., et al. (2009) · Journal of the American Dietetic Association · doi:10.1016/j.jada.2009.05.016 · Cited by 89 · see citing works
Self-citationFrequency and Type of Seafood Consumed Influence Plasma (n-3) Fatty Acid Concentrations
Chung, H., Nettleton, J. A., Lemaitre, R. N., Barr, R. G., Tsai, M. Y., Tracy, R. P., & Siscovick, D. S. (2008) · The Journal of Nutrition · doi:10.3945/jn.108.089631 · Cited by 76 · see citing works
He, K., Liu, K., Daviglus, M. L., Mayer-Davis, E., Jenny, N. S., Jiang, R., Ouyang, P., Steffen, L. M., Siscovick, D., Wu, C., et al. (2008) · The American Journal of Clinical Nutrition · doi:10.1093/ajcn/88.4.1111 · Cited by 79 · see citing works
Self-citationSleep, sedentary behavior, physical activity, and cardiovascular health: MESA
GERMAN, C., MAKAREM, N., FANNING, J., REDLINE, S., ELFASSY, T., MCCLAIN, A., ABDALLA, M., AGGARWAL, B., ALLEN, N., & CARNETHON, M. (2021) · Medicine & Science in Sports & Exercise · doi:10.1249/mss.0000000000002534 · Cited by 58 · see citing works
Kern, D., Auchincloss, A., Stehr, M., Diez Roux, A., Moore, L., Kanter, G., & Robinson, L. (2017) · International Journal of Environmental Research and Public Health · doi:10.3390/ijerph14111394 · Cited by 58 · see citing works
Diabetes Prevention Program (DPP) Research Group, Hamman, R. F., Horton, E., Barrett-Connor, E., Bray, G. A., Christophi, C. A., Crandall, J., Florez, J. C., Fowler, S., Goldberg, R., et al. (2015) · Diabetes · doi:10.2337/db14-0333 · Cited by 46 · see citing works
Jaacks, L. M., Ma, Y., Davis, N., Delahanty, L. M., Mayer‐Davis, E. J., Franks, P. W., Brown‐Friday, J., Isonaga, M., Kriska, A. M., Venditti, E. M., et al. (2014) · Diabetic Medicine · doi:10.1111/dme.12500 · Cited by 40 · see citing works
Goldberg, R. B., Temprosa, M., Mele, L., Orchard, T., Mather, K., Bray, G., Horton, E., Kitabchi, A., Krakoff, J., Marcovina, S., et al. (2016) · Metabolism · doi:10.1016/j.metabol.2015.11.011 · Cited by 22 · see citing works
- Authors
- Mayer-Davis, E. J., Vitolins, M. Z., Carmichael, S. L., Hemphill, S., Tsaroucha, G., Rushing, J., & Levin, S.
- Affiliations
- Wake Forest University Health Sciences (US)
- University of South Carolina (US)
- Venue
- Annals of Epidemiology
- Publisher
- Elsevier BV
- Published
- 1999-07
- Volume
- 9
- Issue
- 5
- Pages
- 314-324
- ISSN
- 1047-2797 (ISSN-L)
- OpenAlex
- W2131404482
- Cited by
- 300
- References
- 25
- Citations by year
- 2026: 5 · 2025: 9 · 2024: 6 · 2023: 6 · 2022: 10 · 2021: 11 · 2020: 14 · 2019: 7 · 2018: 14 · 2017: 12 · 2016: 14 · 2015: 7 · 2014: 13 · 2013: 15 · 2012: 16
- FWCI
- 5.56
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Annals of Epidemiology (publishedVersion)
- PubMed (publishedVersion)
- Funders
- National Institutes of Health (5u01hl047890-09, 5u01hl047887-09, 5u01hl047889-09)
- National Heart, Lung, and Blood Institute (UO1-HL47889, UO1-HL47887, UO1-HL47890)
- Topics
- Health Sciences › Medicine › Public Health, Environmental and Occupational Health › Nutritional Studies and Diet
- Health Sciences › Medicine › Public Health, Environmental and Occupational Health › Nutrition and Health Studies
- Physical Sciences › Mathematics › Statistics and Probability › Statistical Methods in Epidemiology
- Keywords
- food frequency questionnaire, dietary assessment validity, reproducibility, 24-hour dietary recall, Insulin Resistance Atherosclerosis Study, multi-ethnic population, African American women, Hispanic women, educational attainment, ethnic food, dietary supplements, insulin resistance
- MeSH terms
- Adult, Aged, Black or African American, Energy Intake, Diet, Educational Status, Female, Hispanic or Latino, Humans, Male, Middle Aged, Surveys and Questionnaires, Mental Recall, Regression Analysis, United States, Reproducibility of Results, Cohort Studies, White People
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review