This Article Abstract Full Text (PDF) Alert me when this article is cited Alert me if a correction is posted Services Similar articles in this journal Similar articles in PubMed Alert me to new issues of the journal Download to citation manager Citing Articles Citing Articles via HighWire Citing Articles via Google Scholar Google Scholar Articles by Martínez, M. E. Articles by Alberts, D. S. Search for Related Content PubMed PubMed Citation Articles by Martínez, M. E. Articles by Alberts, D. S.

Reliability and Validity of a Self-Administered Food Frequency Questionnaire in a Chemoprevention Trial of Adenoma Recurrence¹

Arizona Cancer Center [M. E. M., J. R. M., E. G., R. C. W., K. W., C. R., D. S. A.], Arizona Prevention Center [M. E. M., J. R. M.], and Department of Medicine, University of Arizona [D. S. A.], Tucson, Arizona 85724, and Center for Health Research, Portland, Oregon 97227 [C. R.]

	Abstract

Top Abstract Introduction Materials and Methods Results Discussion References

 
Various chemoprevention trials have assessed dietary intake by means of food frequency questionnaires. However, it is important to assess the degree to which such questionnaires can measure diet. We conducted reproducibility and validity analyses of our Arizona Food Frequency Questionnaire (AFFQ) in our recently completed, randomized, Phase III chemoprevention trial testing the effects of a wheat bran fiber supplement on colorectal adenoma recurrence. A total of 139 individuals provided a baseline and year 1 AFFQ and a set of 4-day dietary records collected over a period of 1 month. The reproducibility analyses of the AFFQ administered 1 year apart showed a mean intraclass correlation of 0.54 for unadjusted nutrients and 0.48 for energy-adjusted nutrients. The relative validity of the AFFQ, as compared with the average of the 4-day diet records, showed a mean deattenuated correlation of 0.49 (range, 0.22–0.65) for the baseline AFFQ and 0.49 (range, 0.25–0.67) for the year 1 AFFQ. When data from both AFFQs were combined and compared with the diet records, there was a slight improvement in the overall deattenuated correlations (mean, 0.56; range, 0.33–0.71). The correlations we observed for macro- and micronutrient intake were within the overall range of those reported in the literature. Reliability and validity studies of dietary instruments are feasible in the setting of a chemoprevention trial and should be conducted when the instrument’s performance has not been previously assessed in the target population.

	Introduction

Top Abstract Introduction Materials and Methods Results Discussion References

 
WBF³ has been prominently mentioned among the agents proposed for chemoprevention of colorectal cancer (1, 2, 3) . However, it is plausible that the consumption of even a modest WBF supplement could, over the 3–4-year duration of a chemoprevention trial, alter a number of dietary practices and that these alterations could obscure the protective effects of WBF supplementation. Clearly, understanding of any impact of WBF on overall dietary practice depends on adequate dietary assessment.

Several dietary intervention trials have attempted to evaluate dietary intake by means of food frequency questionnaires. Because it is important to consider the degree to which such questionnaires can measure diet, it cannot simply be assumed that the food frequency instrument will adequately capture dietary practice. The interpretation of any study of diet and specific end points can be substantially enhanced by quantitative information on the validity and reproducibility of the method used to measure exposure in the target population. In general, diet records, with a small number of replicate measures per participant, with statistical correction for within-person variation, are used as a standard for this evaluation (4) .

Given that individuals in chemoprevention trials remain active participants for 3 years or longer, reliability and validity studies of food frequency questionnaires are feasible in most of these settings. We conducted reproducibility and validity analyses of our AFFQ in our recently completed, randomized, Phase III chemoprevention trial testing the effects of WBF intervention on adenoma recurrence.

	Materials and Methods

Top Abstract Introduction Materials and Methods Results Discussion References

 
The WBF Trial.
Details of the WBF trial have been described previously (5) . Briefly, the WBF study is a double-blind, high versus low fiber, Phase III trial designed to measure the effects of WBF supplementation for 3 years on adenoma recurrence. Men and women ages 40–80 years, who had removal of one or more colorectal adenoma(s) of 3 mm or larger at colonoscopy within 3 months before study entry, were recruited from three clinical sites in the Phoenix metropolitan area. The AFFQ assessed dietary intake in the previous year and was administered at baseline and annually thereafter.

Study Population.
A total of 190 male and female participants eligible for inclusion in the WBF trial were invited to participate in the reproducibility and validity study by providing a baseline AFFQ and by collecting dietary records for 4 randomly selected days. A second AFFQ was mailed to the trial participants for completion before their annual visit as part of the WBF trial design. A total of 139 individuals had complete data for the 4-day diet records, baseline AFFQ, and year 1 AFFQ and were included in the final analyses.

The AFFQ.
Details of the development of the AFFQ have been described elsewhere (6) ; however, the validation of the current version of the questionnaire has not been reported. We used a modified version of the National Cancer Institute’s Health Habits and History Questionnaire food frequency component and the corresponding database (7) to develop the AFFQ. The modifications included the addition of commonly consumed Southwestern foods and increased detail in fiber-containing foods reflecting the focus of ongoing studies at our institution. The current version is a computer scannable, 113-item, semiquantitative food frequency questionnaire that asks about usual eating habits over the previous year. Frequency of consumption is grouped into seven categories ranging from rarely/never to >3 times/day. Participants were asked to report portion size as small, medium, or large. The questionnaire includes open-ended questions to identify specific types of cold cereals, fruits and vegetables not listed, and specific brands of multiple vitamins and individual supplements. Nutrient intakes were calculated from the AFFQ by multiplying the frequency of use by the nutrient composition for the portion size specified for each item. Age- and sex-specific portion size estimates are used in these calculations (8) . Nutrient calculations for modifications and updates to the AFFQ are based on data from the United States Department of Agriculture’s Continuing Survey of Food Intake of Individuals, 1985–1986 (CSFII-86), and the United States Department of Agriculture’s National Food Consumption Survey, 1987–1988 (9) . Participants were instructed to record portion and frequency of consumption of their WBF supplement in the AFFQ food item corresponding to 100% bran cereal. Therefore, because nutrient data at year 1 were analyzed in a blinded fashion, all participants are assumed to have consumed the high WBF cereal product.

Dietary Records.
Dietary records were collected during the run-in phase of the study, 4–6 weeks after the baseline AFFQ. These were collected on four nonconsecutive, randomly assigned days (2 weekdays and 2 weekend days). The project nutritionist trained the participants on the method of recording food and beverage consumption and portion size estimates. Additional points covered by the nutritionist included the complete description of foods and the recording of recipes or foods prepared by others. Once the records were turned in, they were reviewed by the nutrition staff members, and any clarifications were made via telephone. Recipes were obtained from participants, and the appropriate amounts of the component foods were entered for food items that were not in the database. The records were entered and analyzed using the Nutritionist III nutrient software package (version 6; N² Computing, Salem, OR). Additional constituents such as carotenoids, fatty acids, and specific fiber components were not available at the time of this study because they were not part of the nutrient database.

Data Analysis.
Means and SDs were calculated for total nutrient intakes using the AFFQs and the 4-day diet records. Because all nutrients, as measured by the AFFQ, were correlated with energy intake, variation due to energy intake and its associated measurement error was minimized by energy adjustment of the nutrients using the regression method (10) . This method of energy adjustment is computed from the residuals of the regression model with total energy intake as the independent variable and the nutrient as the dependent variable. Because residuals do not provide an intuitive sense of nutrient intake, the mean energy intake of the study population was added to this value. Energy adjustment was conducted separately for each diet method and provides a value that is uncorrelated with total energy intake. Most nutrient distributions were skewed toward higher values; therefore, all variables were log (natural)-transformed before analysis. Intraclass correlations between intakes assessed by the two AFFQs were computed for unadjusted and energy-adjusted nutrients and alcohol. Pearson correlation coefficients were used to compare data from the AFFQ and diet records for both unadjusted and energy-adjusted nutrients. Spearman correlation coefficients did not differ appreciably from the parametric statistics presented in this study. Disattenuated correlation coefficients were also generated using diet record data to calculate within- and between-person variation (11 , 12) .

	Results

Top Abstract Introduction Materials and Methods Results Discussion References

 
The participants in the present analysis included 97 males and 42 females with a mean age of 66.4 years. Ninety-seven percent of the participants were white, and 84% had 12 or more years of education. There were no significant differences in age, gender, education, or treatment group distribution between this study population and that of the total randomized participants in the WBF trial (5) .

Table 1 presents the means and SDs for the average of the unadjusted and energy-adjusted nutrient intakes based on the diet records and the baseline and year 1 AFFQs for the 139 participants. When compared with the diet record data, a lower intake of macronutrients was observed based on the AFFQs, regardless of energy adjustment (except for carbohydrates at year 1). Using the diet record data as standard, there tended to be more overestimates when using the year 1 AFFQ nutrient intakes than when the baseline AFFQ data were used. Consumption of alcohol was underestimated 20–25% by the AFFQ when compared with the diet records. Of particular interest, dietary fiber (the active agent of the intervention) was slightly lower than the diet record estimate when using the baseline AFFQ. Not surprisingly, however, intake of dietary fiber was substantially higher in the year 1 AFFQ as compared with either the baseline AFFQ or diet records. As noted previously, these blinded analyses assume all participants were consuming the high-fiber supplement.

	Discussion

Top Abstract Introduction Materials and Methods Results Discussion References

The reproducibility of food frequency questionnaires similar to ours has been reported in various settings (13, 14, 15, 16, 17, 18, 19, 20, 21, 22, 23) . The correlation coefficients from our reproducibility study of the AFFQ administered 1 year apart ranged from 0.33–0.64 for unadjusted nutrients; the correlation coefficient for alcohol was 0.81. These reproducibility coefficients, including that of fiber, are in accordance with the results of studies of food frequency questionnaires administered over a period of 1–10 years.

Validation studies of food frequency questionnaires that have used diet records as the comparison method have also been published previously (8 , 13, 14, 15 , 18 , 20 , 23, 24, 25, 26, 27 , 29, 30, 31) , but only a few have used food frequency questionnaires before and after diet record collection (13 , 15) . Correlation coefficients in these studies ranged from 0.00–0.24 for the study by Stuff et al. (20) to 0.69–0.94 for the study by Balogh et al. (31) . Given the wide variation in design and methodology among the numerous validation studies published to date, it is difficult to directly compare the results of these studies with those of ours. Although the correlations we observed were on the lower end, they were within the overall range of those reported in the literature (see Ref. 4 for a complete review). In one of these studies (23) , the reliability and validity of a food frequency questionnaire was assessed against separate sets of dietary records collected at baseline and at the 6-month follow-up among participants in the Women’s Health Trial. The results of this study showed increases in validity from baseline to 6 months, and this increase tended to be larger among women in the intervention group as compared to the control group. A challenge was presented in our design because the diet record collection period occurred before randomization. Although the year 1 AFFQ technically covered the period of time reflected by the diet records, its administration was approximately 11 months after the diet record collection period. Because of this, correlations similar to those of the baseline AFFQ were observed for the comparison of the latter AFFQ and the diet records. This is in contrast to what has been reported in the literature for validation studies not involving an intervention, with stronger correlations observed for the year 1 food frequency questionnaire (13 , 15) . Based on the mean correlation coefficients, energy adjustment of nutrients improved the overall correlations of the baseline AFFQ and diet records but had no overall effect when the year 1 AFFQ was used. Recent publications of cohort studies where food frequency questionnaires are collected throughout the follow-up period (32 , 33) have used data from two to three questionnaires to assess consistency in dietary intake. The results of our analyses suggest that some improvements in the validity estimates are possible when combining data from two food frequency questionnaires.

While it is generally agreed that there is no perfect standard method with which to assess the validity of a food frequency questionnaire, validation studies compare this method with one that is judged to be superior: a series of diet records. Given that the diet records were collected close in time to the baseline AFFQ, it is possible that the process of filling out the AFFQ heightened the participant’s awareness and altered the recording of the diet records. This lack of independence would result in high correlated errors and an overestimate of validity. However, because the source of errors for the AFFQ is minimally shared with that of diet records (4) , there is reason to believe that there is independence between the two methods. In addition, the collection of the year 1 AFFQ, which took place much later in time, provides an additional comparison. It is generally assumed that errors from diet records are uncorrelated with those of the food frequency questionnaire, although recent work by Spiegelman et al. (34) has raised questions about this assumption. Our data show that the disattenuated correlation of nutrient intake by food frequency questionnaire methodology with a gold standard is 0.49. If the frequency and record-based methods are both seen as imperfect indicators of diet, this correlation can be interpreted as indicating that approximately one-half of the observed variance in either indicator is due to error (35) . If the true correlation of nutrient intake with an outcome was 0.5, and the nutrient was measured with half the variance as error, the observed correlation would be between 0.3 and 0.4 (36) . Thus, the association of any nutrient intake with outcome would in all likelihood be underestimated. As well, the ability to look at change in diet is limited due to measurement error. Variance around the mean at baseline and follow-up is greatly increased by measurement error; this excess variance at these time points results in an underestimate of the significance of change in mean consumption.

An important consideration in a trial such as the WBF is whether the intervention caused a change in nutrient intake other than that targeted by the intervention. This change can be assessed by data from the year 1 AFFQ. Based on validation studies in which food frequency questionnaire data were collected at baseline and 1 year, change in nutrient intake occurs even in the absence of an intervention (13 , 15) . Results of these studies indicate that participants tended to report a lower intake of nutrients in the second administration of the food frequency questionnaire compared to the first administration of the food frequency questionnaire. Data from our AFFQs show lower intakes in only 5 of the 17 nutrients when comparing the year 1 AFFQ with the baseline AFFQ. Because the nutrient analyses are blinded (i.e., it was assumed that everyone consumed the high-fiber cereal product), the differences could reflect the overall impact of the WBF intervention. However, because we have no diet record data close to the year 1 AFFQ administration for this set of individuals, we cannot assess the relative validity of the reported changes. In studies such as the Women’s Health Initiative (31) , where the intervention comprises a dietary pattern, monitoring of dietary change is an important component. However, in a trial such as ours, a WBF intervention has little effect on the intake of fiber from other sources (37) . Furthermore, for sources of total fat, the WBF intervention resulted only in an increase in milk consumption and a decrease in table fat (i.e., butter, margarine, and salad dressing). Collection of dietary records should be conducted in dietary intervention studies where assessment of dietary change is important due to the intervention. Dietary intake based on these records could then be compared with the food frequency questionnaires to assess the relative validity of dietary change (31) .

Reproducibility and validity analysis of food frequency questionnaires is quite feasible in the setting of a chemoprevention trial. Due to the make-up of the WBF trial participants (i.e., Caucasian, high socioeconomic status), the results of this study can be generalized to study populations such as ours. The degree of variation in nutrient intakes and the reproducibility and validity of our questionnaire indicate that important associations between diet and various end points can be reasonably quantified by food frequency instruments, subject to the strictures of measurement error, in chemoprevention trials.

	Footnotes

 
The costs of publication of this article were defrayed in part by the payment of page charges. This article must therefore be hereby marked advertisement in accordance with 18 U.S.C. Section 1734 solely to indicate this fact.

¹ Supported in part by USPHS Grant CA-41108 from the National Cancer Institute. M. E. M. is supported by Career Development Award KO1 CA79069-10 from the National Cancer Institute.

² To whom requests for reprints should be addressed, at Arizona Cancer Center, University of Arizona Health Sciences Center, 1515 North Campbell Avenue, Tucson, AZ 85724. Phone: (520) 626-8130; Fax: (520) 626-2735; E-mail: emartinez{at}azcc.arizona.edu

³ The abbreviations used are: WBF, wheat bran fiber; AFFQ, Arizona Food Frequency Questionnaire.

Received 2/ 1/99; revised 7/13/99; accepted 7/21/99.

	References

Top Abstract Introduction Materials and Methods Results Discussion References

 

1. Lampe J. W., Slavin J. L., Melcher E. A., Potter J. D. Effects of cereal and vegetable fiber feeding on potential risk factors for colon cancer. Cancer Epidemiol. Biomark. Prev., 1: 207-211, 1992.[Abstract/Free Full Text]
2. Reddy B. S., Simi B., Engle A. Biochemical epidemiology of colon cancer: effect of types of dietary fiber on colonic diacylglycerols in women. Gastroenterology, 106: 883-889, 1994.[Medline]
3. Alberts D. S., Ritenbaugh C., Story J. A., Aickin M., Rees-McGee S., Buller M. K., Atwood J., Phelps J., Ramanujam P. S., Bellapravalu S., Patel J., Bettinger L., Clark L. Randomized, double-blinded, placebo-controlled study of effect of wheat bran fiber and calcium on fecal bile acids in patients with resected adenomatous colon polyps. J. Natl. Cancer Inst., 88: 81-92, 1996.[Abstract/Free Full Text]
4. Willett W., Lenart E. Reproducibility and validity of food-frequency questionnaires Willett W. eds. . Nutritional Epidemiology, Vol. 30: 101-147, Oxford University Press New York 1998.
5. Martínez M. E., Reid M. E., Guillén-Rodríguez J., Marshall J. R., Sampliner R., Aickin M., Ritenbaugh C., van Leeuwen B., Mason-Liddil N., Giuliano A., Vargas P. A., Alberts D. S. Design and baseline characteristics of study participants in the Wheat Bran Fiber trial. Cancer Epidemiol. Biomark. Prev., 7: 813-816, 1998.[Abstract]
6. Ritenbaugh C., Aickin M., Taren D., Teufel N., Graver E., Woolf K., Alberts D. S. Use of a food frequency questionnaire to screen for dietary eligibility in a randomized cancer prevention Phase III trial. Cancer Epidemiol. Biomark. Prev., 6: 347-354, 1997.[Abstract]
7. Block G., Hartman A. M., Dresser C. M., Carroll M. D., Gannon J., Gardner L. A data-based approach to diet questionnaire design and testing. Am. J. Epidemiol., 124: 453-469, 1986.[Abstract/Free Full Text]
8. Block G., Woods M., Potosky A., Clifford C. Validation of a self-administered diet history questionnaire using multiple diet records. J. Clin. Epidemiol., 43: 1327-1335, 1990.[Medline]
9. United States Department of Agriculture Human Nutrition Information Service. USDA Nutrient Data Base for Individual Intake Surveys National Technical Information Service Springfield, VA 1991.
10. Willett W. C., Stampfer M. J. Total energy intake: implications for epidemiologic analyses. Am. J. Epidemiol., 124: 17-27, 1986.[Free Full Text]
11. Beaton G. H., Milner J., Corey P., McGuire V., Cousins M., Stewart E., de Ramos M., Hewitt D., Grambsch P. V., Kassim N., Little J. A. Sources of variance in 24-hour dietary recall data: implications for nutrition study design and interpretation. Am. J. Clin. Nutr., 32: 2546-2549, 1979.[Free Full Text]
12. Rosner B., Willett W. C. Interval estimates for correlation coefficients corrected for within-person variation: implications for study design and hypothesis testing. Am. J. Epidemiol., 127: 377-386, 1988.[Abstract/Free Full Text]
13. Willett W. C., Sampson L., Stampfer M. J., Rosner B., Bain C., Witschi J., Hennekens C. H., Speizer F. E. Reproducibility and validity of a semiquantitative food frequency questionnaire. Am. J. Epidemiol, 122: 51-65, 1985.[Abstract/Free Full Text]
14. Pietinen P., Hartman A. M., Haapa E., Rasanen L., Haapakoski J., Palmgren J., Albanes D., Virtamo J., Huttunen J. K. Reproducibility and validity of dietary assessment instruments.: II. A qualitative food-frequency questionnaire. Am. J. Epidemiol., 128: 667-676, 1988.[Abstract/Free Full Text]
15. Rimm E. B., Giovannucci E. L., Stampfer M. J., Colditz G. A., Litin L. B., Willett W. C. Reproducibility and validity of a expanded self-administered semiquantitative food frequency questionnaire among male health professionals. Am. J. Epidemiol., 135: 1114-1126, 1992.[Abstract/Free Full Text]
16. Longnecker M., Lissner L., Holden H., Flack V., Taylor P., Stampfer M. J., Willett W. C. Reproduciblity and validity of a self-administered semi-quantitative food frequency questionnaire in subjects from South Dakota and Wyoming. Epidemiology, 4: 356-365, 1993.[Medline]
17. Goldbohm R. A., van’t Veer P., van den Brandt P. A., van’t Hof M. A., Brants H. A. M., Sturmans F., Hermus R. J. J. Reproducibility of a food frequency questionnaire and stability of dietary habits determined from five annually repeated measurements. Eur. J. Clin. Nutr., 49: 420-429, 1995.[Medline]
18. Mannisto S., Virtanen M., Mikkonen T., Pietinen P. Reproducibility and validity of a food frequency questionnaire in a case-control study on breast cancer. J. Clin. Epidemiol., 49: 401-409, 1996.[Medline]
19. Elmstahl S., Gullberg B., Riboli E., Saracci R., Lindgarde F. The Malmo Food Study: the reproducibility of a novel diet history method and an extensive food frequency questionnaire. Eur. J. Clin. Nutr., 50: 134-142, 1996.[Medline]
20. Stuff J. E., Garza C., Smith E. O., Nichols B. L., Montandon C. A comparison of dietary methods in nutrition studies. Am. J. Clin. Nutr., 37: 300-306, 1983.[Abstract/Free Full Text]
21. Pisani P., Faggiano F., Krogh V., Palli D., Vineis P., Berrino F. Relative validity and reproducibility of a food frequency dietary questionnaire for use in the Italian EPIC centres. Int. J. Epidemiol., 26 (Suppl. 1): S152-S160, 1997.[Abstract/Free Full Text]
22. Bohlscheid-Thomas S., Hoting I., Boeing H., Wahrendorf J. Reproducibilty and relative validity of energy and macronutrient intake of a food frequency questionnaire developed for the German part of the EPIC project. Int. J. Epidemiol., 26 (Suppl. 1): S559-S570, 1997.
23. Kristal A. R., Feng Z., Coates R. J., Oberman A., George V. Associations of race/ethnicity, and dietary intervention with the validity and reliability of a food frequency questionnaire. The Women’s Health Trial Feasibility Study in Minority Populations. Am. J. Epidemiol., 146: 856-869, 1997.[Abstract/Free Full Text]
24. Larkin F. A., Metzner H. L., Thompson F. E., Flegal K. M., Guire K. E. Comparison of estimated nutrient intakes by food frequency and dietary records in adults. J. Am. Diet. Assoc., 89: 215-223, 1989.[Medline]
25. Tjonneland A., Overvad K., Haraldsdottir J., Bang S., Ewertz M., Jensen O. M. Validation of a semiquantitative food frequency questionnaire developed in Denmark. Int. J. Epidemiol., 20: 906-912, 1991.[Abstract/Free Full Text]
26. Callmer E., Riboli E., Saracci R., Akesson B., Lindgarde F. Dietary assessment methods evaluated in the Malmo food study. J. Intern. Med., 233: 53-57, 1993.[Medline]
27. Goldbohm R. A., van den Brandt P. A., Brants H. A. M., van’t Veer P., Al M., Sturmans F., Hermus R. J. J. Validation of a dietary questionnaire used in a large-scale prospective cohort study on diet and cancer. Eur. J. Clin. Nutr., 48: 253-265, 1994.[Medline]
28. Johansson I., Hallmans G. Impact of photo portion illustrations on relative validity of a food frequency questionnaire University of Umea, Sweden Umea, Sweden 1995.
29. Jain M., Howe G. R., Rohan T. Dietary assessment in epidemiology: comparison of food frequency and diet history questionnaire with a 7-day food record. Am. J. Epidemiol., 143: 953-960, 1996.[Abstract/Free Full Text]
30. Wolk A., Ljung H., Vessby B., Hunter D., Willett W. C. Effect of additional questions about fat on the validity of fat estimates from a food frequency questionnaire.: Study Group of MRS SWEA. Eur. J. Clin. Nutr., 52: 186-192, 1998.[Medline]
31. Balogh M., Medalie J. H., Smith H., Groen J. J. The development of a dietary questionnaire for an ischemic heart disease survey. Isr. J. Med. Sci., 4: 195-203, 1968.[Medline]
32. Martínez M. E., Giovannucci E. L., Colditz G. A., Stampfer M. J., Hunter D. J., Speizer F. E., Wing A., Willett W. C. Calcium, vitamin D, and the occurrence of colorectal cancer among women. J. Natl. Cancer Inst., 88: 1375-1382, 1996.[Abstract/Free Full Text]
33. Fuchs C. S., Giovannucci E. L., Colditz G. A., Hunter D. J., Stampfer M. J., Rosner B., Speizer F. E., Willett W. C. Dietary fiber and the risk of colorectal cancer and adenoma in women. N. Engl. J. Med., 340: 169-176, 1999.[Abstract/Free Full Text]
34. Spiegelman D., Schneeweiss S., McDermott A. Measurement error correction for logistic regression models with an "alloyed gold standard.". Am. J. Epidemiol., 145: 184-196, 1997.[Abstract/Free Full Text]
35. Carmines E. G., Zeller R. A. Reliability and Validity Assessment Sage Bevery Hills, CA 1979.
36. Marshall J. R., Hastrup J. L. Mismeasurement and resonance of strong confounders: uncorrelated errors. Am. J. Epidemiol., 143: 1069-1078, 1996.[Abstract/Free Full Text]
37. Ritenbaugh C. Dietary supplementation: the case for placebo-controlled trials. Prev. Med., 22: 667-675, 1993.[Medline]

This article has been cited by other articles:

				E. T Jacobs, D. S Alberts, J. A Foote, S. B Green, B. W Hollis, Z. Yu, and M. E. Martinez Vitamin D insufficiency in southern Arizona Am. J. Clinical Nutrition, March 1, 2008; 87(3): 608 - 613. [Abstract] [Full Text] [PDF]

				E. T. Jacobs, M. E. Martinez, D. S. Alberts, E. L. Ashbeck, S. M. Gapstur, P. Lance, and P. A. Thompson Plasma Insulin-Like Growth Factor I Is Inversely Associated with Colorectal Adenoma Recurrence: A Novel Hypothesis Cancer Epidemiol. Biomarkers Prev., February 1, 2008; 17(2): 300 - 305. [Abstract] [Full Text] [PDF]

				T. S. Hudson, M. R. Forman, M. M. Cantwell, A. Schatzkin, P. S. Albert, and E. Lanza Dietary Fiber Intake: Assessing the Degree of Agreement between Food Frequency Questionnaires and 4-Day Food Records. J. Am. Coll. Nutr., October 1, 2006; 25(5): 370 - 381. [Abstract] [Full Text] [PDF]

				L. Natarajan, S. W. Flatt, X. Sun, A. C. Gamst, J. M. Major, C. L. Rock, W. Al-Delaimy, C. A. Thomson, V. A. Newman, J. P. Pierce, et al. Validity and Systematic Error in Measuring Carotenoid Consumption with Dietary Self-report Instruments Am. J. Epidemiol., April 15, 2006; 163(8): 770 - 778. [Abstract] [Full Text] [PDF]

				B. R. Switzer, J. R. Atwood, A. H. Stark, J. W. Hatch, R. Travis, F. Ullrich, E. R. Lyden, X. Wu, Y. Chiu, and J. L. Smith Plasma Carotenoid and Vitamins A and E Concentrations in Older African American Women after Wheat Bran Supplementation: Effects of Age, Body Mass and Smoking History J. Am. Coll. Nutr., June 1, 2005; 24(3): 217 - 226. [Abstract] [Full Text] [PDF]

				M. E. Martinez, S. M Henning, and D. S Alberts Folate and colorectal neoplasia: relation between plasma and dietary markers of folate and adenoma recurrence Am. J. Clinical Nutrition, April 1, 2004; 79(4): 691 - 697. [Abstract] [Full Text] [PDF]

				C. M. Nam, K. W. Oh, K. H. Lee, S. H. Jee, S. Y. Cho, W. H. Shim, and I. Suh Vitamin C Intake and Risk of Ischemic Heart Disease in a Population with a High Prevalence of Smoking J. Am. Coll. Nutr., October 1, 2003; 22(5): 372 - 378. [Abstract] [Full Text] [PDF]

				I. A. Hakim, R. B. Harris, S. Brown, H-H. S. Chow, S. Wiseman, S. Agarwal, and W. Talbot Effect of Increased Tea Consumption on Oxidative DNA Damage among Smokers: A Randomized Controlled Study J. Nutr., October 1, 2003; 133(10): 3303S - 3309. [Abstract] [Full Text] [PDF]

				C. A. Thomson, A. Giuliano, C. L. Rock, C. K. Ritenbaugh, S. W. Flatt, S. Faerber, V. Newman, B. Caan, E. Graver, V. Hartz, et al. Measuring Dietary Change in a Diet Intervention Trial: Comparing Food Frequency Questionnaire and Dietary Recalls Am. J. Epidemiol., April 15, 2003; 157(8): 754 - 762. [Abstract] [Full Text] [PDF]

				E. T. Jacobs, A. R. Giuliano, D. J. Roe, J. M. Guillen-Rodriguez, D. S. Alberts, and M. E. Martinez Baseline Dietary Fiber Intake and Colorectal Adenoma Recurrence in the Wheat Bran Fiber Randomized Trial J Natl Cancer Inst, November 6, 2002; 94(21): 1620 - 1625. [Abstract] [Full Text] [PDF]

				R. L. Sedjo, D. J. Roe, M. Abrahamsen, R. B. Harris, N. Craft, S. Baldwin, and A. R. Giuliano Vitamin A, Carotenoids, and Risk of Persistent Oncogenic Human Papillomavirus Infection Cancer Epidemiol. Biomarkers Prev., September 1, 2002; 11(9): 876 - 884. [Abstract] [Full Text] [PDF]

				E. T. Jacobs, A. R. Giuliano, D. J. Roe, J. M. Guillen-Rodriguez, L. M. Hess, D. S. Alberts, and M. E. Martinez Intake of Supplemental and Total Fiber and Risk of Colorectal Adenoma Recurrence in the Wheat Bran Fiber Trial Cancer Epidemiol. Biomarkers Prev., September 1, 2002; 11(9): 906 - 914. [Abstract] [Full Text] [PDF]

				R. L. Sedjo, P. Inserra, M. Abrahamsen, R. B. Harris, D. J. Roe, S. Baldwin, and A. R. Giuliano Human Papillomavirus Persistence and Nutrients Involved in the Methylation Pathway among a Cohort of Young Women Cancer Epidemiol. Biomarkers Prev., April 1, 2002; 11(4): 353 - 359. [Abstract] [Full Text] [PDF]

				D. S. Alberts, M. E. Martinez, D. J. Roe, J. M. Guillen-Rodriguez, J. R. Marshall, J. B. van Leeuwen, M. E. Reid, C. Ritenbaugh, P. A. Vargas, A.B. Bhattacharyya, et al. Lack of Effect of a High-Fiber Cereal Supplement on the Recurrence of Colorectal Adenomas N. Engl. J. Med., April 20, 2000; 342(16): 1156 - 1162. [Abstract] [Full Text] [PDF]

This Article Abstract Full Text (PDF) Alert me when this article is cited Alert me if a correction is posted Services Similar articles in this journal Similar articles in PubMed Alert me to new issues of the journal Download to citation manager Citing Articles Citing Articles via HighWire Citing Articles via Google Scholar Google Scholar Articles by Martínez, M. E. Articles by Alberts, D. S. Search for Related Content PubMed PubMed Citation Articles by Martínez, M. E. Articles by Alberts, D. S.