This Article Abstract Full Text (PDF) Alert me when this article is cited Alert me if a correction is posted Services Similar articles in this journal Similar articles in PubMed Alert me to new issues of the journal Download to citation manager Citing Articles Citing Articles via HighWire Citing Articles via Google Scholar Google Scholar Articles by Meyskens, F. L. Articles by Szabo, E. Search for Related Content PubMed PubMed Citation Articles by Meyskens, F. L., Jr. Articles by Szabo, E.

Diet and Cancer: The Disconnect Between Epidemiology and Randomized Clinical Trials

¹ Departments of Medicine and Biological Chemistry, Chao Family Comprehensive Cancer Center, University of California, Irvine, Orange, California; and ² Division of Cancer Prevention, National Cancer Institute, NIH, Bethesda, Maryland

Requests for reprints: Frank L. Meyskens, Jr., Hematology/Oncology, University of California, Irvine, Cancer Center, Building 44, Route 81, 101 City Drive Cancer Center, Orange, CA 92668. Phone: 714-456-6310; Fax: 714-456-5039. E-mail: flmeyske{at}uci.edu

	Abstract

Top Abstract References

 
Dietary epidemiology has been highly successful in identifying the responsible agent in many diseases, including scurvy, pellagra, blindness, and spinal bifida. Case-control, cohort, and ecologic observational studies have consistently associated increased consumption of fruits and vegetables with a decreased risk for a wide variety of epithelial cancers and, in many cases, specific dietary components seem to decrease the risk for a wide array of epithelial cancers. Over time, there has been enthusiasm for one or another compounds, such as ß-carotene in the past and folate currently. Despite the success of translating similar epidemiologic observations to clinical benefit in other areas of medicine via the crucible of the randomized clinical trial, this strategy has not been nearly as successful for cancer. We propose that the inability of nutritional epidemiology to identify effective chemopreventive strategies is not just a problem of quantitation, but rather that the discipline is usually qualitatively incapable of identifying a dietary compound(s) that will be efficacious. One needs to consider the following basic questions in trying to understand why nutritional epidemiology has not been translated into progress in cancer prevention: Why do fruits and vegetable show a consistent protective effect against many epithelial cancers in epidemiologic studies? Once a specific dietary compound is identified as protective in observational studies, why do most subsequent observational studies confirm the effect? Why are dietary epidemiology observations frequently not confirmed by the randomized clinical trial? We call the identified problems "fishing with only one bait" and the "four-legged stool problem." The considerations identified in this analysis offer a number of possible solutions to puzzling findings: (a) Fruits and vegetables consistently show a protective effect against cancer in observational studies because they represent the entire "biological action package." (b) Dietary compounds show a protective effect in observational studies, but not in clinical trials, because this is an inevitable consequence of one compound being falsely identified as the active agent in a system in which multiple agents or multiple interacting regulatory molecules underlie the biological effect. The consequences are serious for trying to use epidemiology to identify effective nutritional compounds. The major conclusion has to be as follows: Supplementation with single dietary compounds is rarely going to be as effective as epidemiologic studies suggest; it is the biological action package that determines efficacy. Options for how we should move forward will be discussed. Dietary observational epidemiology is complex and involves many biases and confounders. We need to be more critical in the design of large randomized trials based on observational epidemiology or analysis. Rules of evidence are frequently ignored or misunderstood although the limitations of observational epidemiology are analogous to the problems associated with discovery-based research and biomarker identification. We need to be much more self-critical in the important and critical assessment of dietary compounds and their role in cancer prevention given the very high appeal for this approach both within the lay and scientific communities.

We have recently discussed the general topic of the limited success of chemoprevention trials in human cancer in terms of addressing two broadly posed questions (1):

• Why have we been relatively unsuccessful in translating promising epidemiologic and experimental findings to clinical benefit?
  
• How should we move the field of chemopreventive agent development forward in a manner that will be more productive?
  

An extremely informative analysis by Ioannidis et al. (2) compared the evidence for treatment effects in nonrandomized and randomized trials across a wide spectrum of medical conditions. Although the authors documented that the correlation between nonrandomized and randomized trials was fairly high (r = 0.75), the nonrandomized studies frequently overpredicted the magnitude of the effect by as much as 50% to 100%. Because sample sizes for clinical trials are generally based on the relative risks (or the equivalent) shown in observational studies, there is a high likelihood that randomized trials are consistently underpowered, thereby missing a small, but real effect. Other factors also likely contribute to this divergence, including shorter exposure to interventions during randomized trials compared with exposure assessments in nonrandomized trials, incomplete compliance with interventional regimens, and drop-in and drop-out problems associated with clinical trials. Nevertheless, the question that arises is whether the issue of overprediction is more problematic for nutritional epidemiology and diseases having complex etiologies, such as cancer, in contrast to diseases having simple etiologies, and why this should be so. We propose that the inability of nutritional epidemiology to identify effective chemopreventive strategies is not just a problem of quantitation, but rather that the discipline is usually qualitatively incapable of identifying a dietary compound(s) that will be efficacious. In this commentary, we set forth the basis for this conclusion and discuss potential strategies to provide more useful data and, hopefully, to better define the questions that need to be considered before the next generation of cancer prevention trials based on epidemiologic evidence. Because methodologic issues and limitations of dietary cancer epidemiology assessment tools have been reviewed multiple times previously (3), these will not be discussed further; we will instead focus on theoretical limitations of the ability of epidemiologic investigation to identify efficacious dietary chemopreventives.

Epidemiologic observation has been highly successful in identifying the responsible agent in many diseases caused by specific nutritional deficiencies, such as scurvy, pellagra, blindness, and spina bifida. Similarly, multiple, although not all, case-control, cohort, and ecologic observational studies have associated increased consumption of fruits and vegetables with a decreased risk for a wide variety of epithelial cancers and, in many cases, specific dietary components have seemed to decrease the risk for a wide array of epithelial cancers (4-6). Over time, there has been enthusiasm for one or another compound, such as ß-carotene in the past (7) and folate currently (8, 9). However, despite the success of translating similar epidemiologic observations to clinical benefit in other areas of medicine via randomized clinical trials, this strategy has not been nearly as successful for cancer (10, 11). Although calcium seems to reduce the number of colonic polyps in prone individuals (12, 13), many more dietary components have produced either no benefit or, as in the case of ß-carotene in smokers, an adverse effect (14, 15). Why should this be the case? We propose that nutritional epidemiology has not been translated into progress in cancer prevention because of inability to identify all relevant dietary components that act coordinately to produce any given result and because of inability to identify the other relevant nonnutritional factors that interact with dietary components to achieve any given outcome.

It is important to recognize that micronutrients or any other dietary components do not act in isolation, but as part of a package. Let us first consider the results of micronutrient replacement for deficiency within the context of differing levels of associated micronutrients (Fig. 1). An observational trial detects and associates the presence or level of one micronutrient (MN₁) with a cancer. As shown in Fig. 1A, only MN₁ is low whereas other micronutrients known to be associated with MN₁ (MN₂, MN₃, and MN₄) are normal. Furthermore, additional micronutrients that impact on the same pathway as MN₁ but have not been identified (MN_x and MN_y) are also normal. When MN₁ is replaced by supplementation, as in a clinical trial, a comparable benefit to that predicted by the observational study is shown. The next and subsequent observational studies will continue to show a beneficial effect, as will a meta-analysis of the association of MN₁ with cancer. Not knowing the identity of all relevant micronutrients does not impact the success of the studies in this situation. However, this situation, in which only MN₁ deficiency occurs and leads to cancer in the absence of other micronutrient deficiencies, is probably rare.

View larger version (20K): [in this window] [in a new window]   Figure 1. Observing the "black box" of dietary cancer epidemiology. A. Epidemiologic observations may correctly identify one micronutrient (MN1) as causative when all the other known influencing micronutrients (MN2-4) and unidentified micronutrients (MNx, MNy) that are not assessed are normal. This situation is likely to be rare. B. Epidemiologic observations usually identify one micronutrient as "causative" when, in fact, many others are involved in producing the event, and their levels or concentrations are abnormal. This situation is probably common. Supplementation in a clinical trial in the situation depicted in (A) may result in a beneficial effort, but is unlikely to occur for the situation in (B).

Perhaps sharpening of the measurement tools of nutritional epidemiology may allow better identification of the elements that compose Fig. 1B, although it is possible that the tools may never be accurate or specific enough to identify all relevant dietary components. This concept can be summarized by an analogy to the fisherman who uses only flies of interest to trout as bait and never discovers that bass, pike, or sturgeon also swim at the bottom of the lake. He will continue to catch many trout each time he throws out the flies meant to catch trout, but he will miss the diversity of the lake population. If one cannot determine the identity of critical nutritional components, appropriate replacement strategies cannot be tested. Thus, better and more accurate measures of dietary intake and, critically, of their biological effect in specific organ sites, are necessary for progress to occur. On the other hand, if we keep over fitting the data, we are only going to identify the same dietary components as previously. In this regard, larger cohorts are not going to give us new information because the biases are all in the same direction. Thus, these observations present a paradox in that it seems important to focus nutritional epidemiology tools to allow identification of specific important dietary components and yet what one might ultimately want is a very general way to identify multiple important components simultaneously. The immediate solution to this conundrum is unclear.

More accurate objective measurement (? biomarker) of dietary intake and its defining effects on carcinogenesis in a particular tissue should provide a better definition of the importance of any dietary compound in the human situation. Such information should enhance the likelihood that a single dietary supplement would result in a positive outcome in a clinical trial. Alternatively, multicomponent supplementation or food trials might be worth reconsideration because the reductionist approach has not been particularly successful. The positive results of two large trials in a cohort at risk for gastric/esophageal cancer suggest that a multicomponent approach should be more broadly explored (16, 17).

A more serious limitation of nutritional epidemiology, however, is the failure to measure (and possibly appreciate) what we call the "biological action package." Almost all dietary compounds have a diversity of biological/biochemical effects. Equally important and frequently ignored is that the action of a dietary compound is strongly affected by the biochemical milieu in which it resides, a feature significantly influenced by organ or tissue site. Therefore, the full benefit of dietary component replacement may not be realized if other components of an effector pathway (or pathways) are abnormal.

Factors involved in optimizing the biological effects of a dietary compound include both "upstream" (e.g., absorption, metabolism) and "downstream" (e.g., effector molecules) influences, as well as interactive and parallel pathways. This concept is exemplified by analogy to a four-legged stool, where all four legs of the stool (the multiple components of the biological action package) are involved in keeping the stool erect and functional, and propping up only one leg does not fix the problem if one or more of the other legs remains deficient. As an example, consider any dietary compound that is involved in redox regulation. One cannot get a true understanding of the action of a dietary compound without examining other major components of redox regulation, such as glutathione, thioredoxin, superoxide dismutase, and many others (18). The biochemical status and composition of key biochemical components in an organ may be even more important in determining the effect of a specific micronutrient than are other micronutrients.

To return to the hypothetical situation involving micronutrient MN₁, consider Fig. 2A, where MN₁ is low and the biochemical components that interact with MN₁ are normal. Whereas this situation is likely to be rare, supplementation with MN₁ may actually result in reduction of events in a clinical trial, particularly if it produces a strong biological effect. Much more likely is the situation in Fig. 2B, in which MN₁ may be low and several other key components of the biological action package are also low or out of balance, although their status is not appreciated or measured. Once again, components include those that are important (such as the redox regulators glutathione, thioredoxin, etc.) as well as factors not yet known to be important (labeled F1 and F2 in the figure). Supplementation with MN₁ in this case may allow a small nonsignificant reduction of risk to be shown in the clinical trial, or, more likely, no effect will be evident.

View larger version (19K): [in this window] [in a new window]   Figure 2. The biological action package involves more than dietary compounds. A. MN1 is assessed and found to be low, whereas the other major influencing biochemical parameters are normal. In this example, the redox pathway is highlighted with identification of known components glutathione (GSH), thioredoxin (TX), and superoxide dismutase (SOD). The unknown components of redox regulation are identified as F1 and F2. B. MN1 is assessed and found to be low, whereas the other major influencing biochemical parameters are also abnormal. Epidemiology usually sees only one component of the biological action package. In the situation in (A), which is likely to be rare, supplementation with MN1 results in a beneficial effect in a clinical trial. However, in the situation in (B), which is likely to be more common, supplementation with MN1 shows no or minimal effect.

The considerations discussed in this commentary offer a number of possible solutions to puzzling findings. We propose that: (a) Fruits and vegetables frequently show a protective effect against cancer in observational studies because they represent the entire biological action package. (b) Dietary compounds show a protective effect in observational studies, but not in clinical trials, because this is an inevitable consequence of one compound being falsely identified as the active agent in a system in which multiple agents (Fig. 1B) or multiple interacting regulatory molecules (Fig. 2B) are responsible for the biological effect.

Other concerns in the translation of epidemiologic observations to clinical trials also need to be mentioned. Clinical interventional trials require the use of well-defined compounds at specified doses and for specified durations of time. Epidemiologic data rarely defines these parameters exactly, particularly the duration of replacement therapy and the timing of replacement during the lengthy process of carcinogenesis. Furthermore, pharmacologic replacement frequently involves using a specific compound or compounds with subtle differences from the physiologic entity and at doses that do not necessarily reflect physiologic levels. Hence, pharmacologic replacement may differ significantly from dietary supplementation. The idea to replace specific dietary components may be correct, but the formulation in a clinical trial may be faulty and lead to failure. The adverse results seen in the clinical trials of ß-carotene in smoking individuals may well represent such a case, because the doses used were three to four times greater than the upper limits of the dietary intake and the levels of serum ß-carotene obtained were nonphysiologic (14, 15).

The concepts discussed in this article have consequences for trying to use epidemiology to identify effective nutritional compounds. Our major conclusion has to be that supplementation with single dietary compounds is rarely going to be as effective as epidemiologic studies suggest because it is the biological action package that determines efficacy.

Having identified some of the caveats associated with the translation of epidemiologic observations to clinical trials, the most important question is how should we move forward? Options include the following: (a) Increase the sample size of single-agent trials; (b) Stop performing trials with single agents and do only studies with combinations of compounds. If so, how many and which agents should be studied?, or (c) Reconsider doing food supplementation or broad dietary change clinical or population based studies. However, how does one standardize food sources grown in different areas or in different soils, and how does one change behavioral and cultural habits such as diet? Moving to multiagent, food supplementation, or lifestyle change trials brings an entirely new series of complexities to trial design and execution, although that should not serve as an excuse for not performing the appropriate studies. Recognizing the importance of dietary patterns in chronic disease prevention and the limitations of current knowledge, recommendations for a broadly based research agenda in this area have recently been proposed (19).

So, what should one do? First, recognition of the issues outlined in this commentary should lead to a healthy debate and better definition of the problems associated with translation of epidemiologic data to clinical intervention. A major issue to consider is whether the scientific community is willing to take a more public health approach in addition to rethinking the reductionist medical approach in the matter of diet and cancer. In other words, do we really need to know which components of food are the active agents if changes in diet will result in reduction of cancer incidence or risk in the population at large? Second, although food and agricultural science is far advanced, the basic science of nutrition and its role in carcinogenesis has lagged behind and needs a similar level of understanding. The development of consequential markers of dietary intake/effect on carcinogenesis in the relevant organ is critical. The rationale for single-agent supplementation needs to be carefully defined before proceeding to large trials. Careful consideration should be given to preferentially performing combination or food trials.

These issues need to be discussed and debated before we launch into the next generation of cancer prevention studies based on epidemiologic observations. Dietary observational epidemiology is complex and involves many biases and confounders. We need to be more critical in the design of large randomized trials based on observational epidemiology or analysis. We need to be much more self-critical in the important and critical assessment of dietary compounds and their role in cancer prevention given the very high appeal for this approach both within the lay and scientific communities (20).

	Acknowledgments

 
We thank the participants of the Translational Cancer Prevention Workshop for their many comments; Peter Greenwald (National Cancer Institute) and Tom Taylor (University of California, Irvine) for their comments on this topic; and Hoda Anton-Culver (University of California, Irvine) for her careful reading and comments on the manuscript and for the title of this paper.

	Footnotes

 
Grant support: Grant CA-62203 (F.L. Meyskens).

The costs of publication of this article were defrayed in part by the payment of page charges. This article must therefore be hereby marked advertisement in ccordance with 18 U.S.C. Section 1734 solely to indicate this fact.

Note: The concepts discussed in this article were first presented at the Translational Cancer Prevention Workshop (Haifa, Israel, May 4-6, 2004).

Received 9/ 8/04; revised 2/ 9/05; accepted 3/15/05.

	References

Top Abstract References

 

1. Meyskens FL, Szabo E. How should we move the field of chemoprevention agent development forward in a productive manner? Recent Results Cancer Res 2005;166:113–24.[Medline]
2. Ioannidis JP, Haidich AB, Pappa M, et al. Comparison of evidence of treatment effects in randomized and non-randomized studies. J Am Med Assoc 2001;286:821–30.[Abstract/Free Full Text]
3. Rock CL. Nutritional factors in cancer prevention. Hematol Oncol Clin North Am 1998;12:975–91.[CrossRef][Medline]
4. Riboli E, Norat T. Epidemiologic evidence of the protective effect of fruit and vegetables on cancer risk. Am J Clin Nutr 2003;78:559–69S.
5. Key TJ, Schatzkin A, Willett WC, Allen NE, Spencer EA, Travis RC. Diet, nutrition and the prevention of cancer. Public Health Nutr 2004;7:187–200.[CrossRef][Medline]
6. Hung H-C, Joshipura KJ, Jiang R, et al. Fruit and vegetable intake and risk of major chronic disease. J Natl Cancer Inst 2004;96:1577–84.[Abstract/Free Full Text]
7. Peto R, Doll R, Buckley JD, Sporn MB. Can dietary ß-carotene materially reduce human cancer rates? Nature 1981;290:201–8.[CrossRef][Medline]
8. Lamprecht SA, Lipkin M. Chemoprevention of colon cancer by calcium, vitamin D and folate: molecular mechanisms. Nat Rev 2003 Aug;3:601–9.
9. Giovannucci E, Stampfer MJ, Colditz GA, et al. Multivitamin use, folate and colon cancer in women in the Nurses' Health Study. Ann Intern Med 1998 Oct;129:517–24.[Abstract/Free Full Text]
10. Lamson DW, Brignall MSS. Natural agents in the prevention of cancer. Part I: human chemoprevention trials. Altern Med Rev 2001;6:7–19.[Medline]
11. Ruffin MT IV, Rock CL. Do antioxidants still have a role in the prevention of human cancer? Curr Oncol Rep 2001;3:306–13.[Medline]
12. Wallace K, Baron JA, Cole BF, et al. Effect of calcium supplementation on the risk of large bowel polyps. J Natl Cancer Inst 2004;96:921–5.[Abstract/Free Full Text]
13. Grau MV, Baron JA, Sandler RS, et al. Vitamin D, calcium supplementation and colorectal adenomas: results of a randomized trial. J Natl Cancer Inst 2003;95:1765–71.[Abstract/Free Full Text]
14. ß-Carotene Cancer Prevention Study Group. The effect of vitamin E and ß carotene on the incidence of lung cancer and other cancers in male smokers: the -tocopherol. N Engl J Med 1994;330:1029–35.[Abstract/Free Full Text]
15. Omenn GS, Goodman GE, Thornquist MD, et al. Effects of a combination of ß carotene and vitamin A on lung cancer and cardiovascular disease. N Engl J Med 1996;334:1150–5.[Abstract/Free Full Text]
16. Pelayo C, Fontham ETH, Bravo JC, et al. Chemoprevention of gastric dysplasia: randomized trial of antioxidant supplements and anti-Helicobacter pylori therapy. J Natl Cancer Inst 2000;92:1881–7.[Abstract/Free Full Text]
17. Blot WJ, Li JY, Taylor PR, et al. Nutrition intervention trials in Linxian, China: supplementation with specific vitamin/mineral combinations, cancer incidence and disease-specific mortality in the general population. J Natl Cancer Inst 1993;85:1483–92.[Abstract/Free Full Text]
18. Bounous G, Molson JH. The antioxidant system. Anticancer Res 2003;23:1411–5.[Medline]
19. Prentice RL, Willett WC, Greenwald P, et al. Nutrition and physical activity and chronic disease prevention: research strategies and recommendations. J Natl Cancer Inst 2004;96:1276–87.[Abstract/Free Full Text]
20. Christensen D. Dietary prevention of cancer: a smorgasbord of options for moving ahead. J Natl Cancer Inst 2004;96:822–4.[Free Full Text]

This article has been cited by other articles:

				P. M Rothwell and M. Bhatia Reporting of observational studies BMJ, October 20, 2007; 335(7624): 783 - 784. [Full Text] [PDF]

				E. Flossmann and P. M Rothwell Commentary: Aspirin and colorectal cancer an epidemiological success story Int. J. Epidemiol., October 1, 2007; 36(5): 962 - 965. [Full Text] [PDF]

				H. Shapiro, P. Singer, Z. Halpern, and R. Bruck Polyphenols in the treatment of inflammatory bowel disease and acute pancreatitis Gut, March 1, 2007; 56(3): 426 - 436. [Full Text] [PDF]

				J. P. Fruehauf and F. L. Meyskens Jr. Reactive Oxygen Species: A Breath of Life or Death? Clin. Cancer Res., February 1, 2007; 13(3): 789 - 794. [Abstract] [Full Text] [PDF]

				M. Plummer, J. Vivas, G. Lopez, J. C. Bravo, S. Peraza, E. Carillo, E. Cano, D. Castro, O. Andrade, V. Sanchez, et al. Chemoprevention of Precancerous Gastric Lesions With Antioxidant Vitamin Supplementation: A Randomized Trial in a High-Risk Population J Natl Cancer Inst, January 17, 2007; 99(2): 137 - 146. [Abstract] [Full Text] [PDF]

				L. Fontana, S. Klein, and J. O Holloszy Long-term low-protein, low-calorie diet and endurance exercise modulate metabolic factors associated with cancer risk Am. J. Clinical Nutrition, December 1, 2006; 84(6): 1456 - 1462. [Abstract] [Full Text] [PDF]

				M. E Wright, K. A Lawson, S. J Weinstein, P. Pietinen, P. R Taylor, J. Virtamo, and D. Albanes Higher baseline serum concentrations of vitamin E are associated with lower total and cause-specific mortality in the Alpha-Tocopherol, Beta-Carotene Cancer Prevention Study. Am. J. Clinical Nutrition, November 1, 2006; 84(5): 1200 - 1207. [Abstract] [Full Text] [PDF]

				F. L. Meyskens Jr. American Society of Preventive Oncology Distinguished Career Achievement Lecture 2006--Enjoy the Journey: The Long and Winding Road of Chemoprevention Agent Development. Cancer Epidemiol. Biomarkers Prev., November 1, 2006; 15(11): 2038 - 2041. [Full Text] [PDF]

				C. Doyle, L. H. Kushi, T. Byers, K. S. Courneya, W. Demark-Wahnefried, B. Grant, A. McTiernan, C. L. Rock, C. Thompson, T. Gansler, et al. Nutrition and Physical Activity During and After Cancer Treatment: An American Cancer Society Guide for Informed Choices CA Cancer J Clin, November 1, 2006; 56(6): 323 - 353. [Abstract] [Full Text] [PDF]

				L. H. Kushi, T. Byers, C. Doyle, E. V. Bandera, M. McCullough, T. Gansler, K. S. Andrews, M. J. Thun, and The American Cancer Society 2006 Nutrition and Phy American Cancer Society Guidelines on Nutrition and Physical Activity for Cancer Prevention: Reducing the Risk of Cancer With Healthy Food Choices and Physical Activity CA Cancer J Clin, September 1, 2006; 56(5): 254 - 281. [Abstract] [Full Text] [PDF]

				C. M. Ulrich and J. D. Potter Folate supplementation: too much of a good thing? Cancer Epidemiol. Biomarkers Prev., February 1, 2006; 15(2): 189 - 193. [Full Text] [PDF]

				E. T.H. Fontham, P. Correa, R. Mera, L. E. Bravo, J. C. Bravo, M. B. Piazuelo, and M. C. Camargo Duration of Exposure, a Neglected Factor in Chemoprevention Trials Cancer Epidemiol. Biomarkers Prev., November 1, 2005; 14(11): 2465 - 2466. [Full Text] [PDF]

This Article Abstract Full Text (PDF) Alert me when this article is cited Alert me if a correction is posted Services Similar articles in this journal Similar articles in PubMed Alert me to new issues of the journal Download to citation manager Citing Articles Citing Articles via HighWire Citing Articles via Google Scholar Google Scholar Articles by Meyskens, F. L. Articles by Szabo, E. Search for Related Content PubMed PubMed Citation Articles by Meyskens, F. L., Jr. Articles by Szabo, E.