| HOME | HELP | FEEDBACK | SUBSCRIPTIONS | ARCHIVE | SEARCH | TABLE OF CONTENTS |
Departments of Clinical Cancer Prevention [A. H., S. M. L., D. M. W., S. R.], Experimental Therapeutics [I. V. B., W. N. H.], Biomathematics [E. N. A.], Pathology [N. S., A. S.], and Gynecologic Oncology [M. F.], University of Texas M. D. Anderson Cancer Center, Houston, Texas 77030; Breast Cancer Consultation Service, St. Marys Medical School, San Francisco, California 91405 [M. D. L.]; Surgical Pathology, Jefferson University Hospital, Philadelphia, Pennsylvania 19107 [R. S.]; Department of Pathology, Tarzana Medical Center, Tarzana, California 91356 [W. J. C.]; Hoffman-La Roche Inc., Nutley, New Jersey 07110 [K. D.]; and Division of Cancer Prevention and Control, Chemoprevention Branch, National Cancer Institute, NIH, Bethesda, Maryland 20892 [G. J. K., C. W. B.]
| Abstract |
|---|
|
|
|---|
| Introduction |
|---|
|
|
|---|
A number of approaches have been developed recently to identify the patients at highest risk of recurrence. Some of these methods focus on examining the pathological specimens for features that predict recurrence. Several studies have shown that the presence of tumor at the surgical margin predicts tumor recurrence (14 , 15) . For example, a recent report indicated that margin width is a strong independent predictor of local recurrence, which ranges from an estimated rate of 5% for lesions with a margin of more than 10 mm to a rate of 63% for a margin smaller than 1 mm (2) . However, the definition of a negative margin varied among reported studies, making it difficult to compare results from different sources (14 , 16) . Other studies have looked at conventional histological features to identify a subset of DCIS that behaves more aggressively than others (17, 18, 19, 20, 21) . For example, nuclear grade and comedo necrosis have been reported to be valuable predictors of recurrence of both in situ and invasive carcinoma (17 , 18 , 21 , 22) . However, the value of nuclear grading in predicting recurrence remains an active focus of discussion, perhaps because the accuracy of subjective assessments is limited by a considerable degree of intra- and interobserver variability (23, 24, 25, 26) .
One potential way to overcome the problems associated with subjective histological assessments is to develop objective and reproducible analytical techniques to quantitate the features that pathologists use to describe the histopathological character of the breast lesion. For nuclear grading of DCIS lesions, pathologists usually evaluate such features as cell pleomorphism, pattern of irregularity in spacing among cells, variation in nuclear size, irregularity in nuclear contours, chromatin texture, nuclear:cytoplasmic ratio, position of nucleus inside the cell, number of nucleoli, presence or absence of mitosis, necrosis, and polarization of cells. Many of these features are amenable to quantitative evaluation by computer-assisted image analysis. For example, several investigators have reported high reproducibility in the assessment of morphometric features such as nuclear area, contour length, DNA content, and nuclear roundness or ellipticity using computer-assisted image analysis techniques and have related these features to prognosis in a variety of diseases (27, 28, 29, 30, 31, 32, 33, 34, 35) . In the setting of breast cancer, for example, some investigators have reported a significant correlation between anaplastic nuclear morphometry and recurrence in stage I estrogen receptor-negative breast cancer (36 , 37) .
The goals of the present study were 2-fold. First, we wanted to determine whether image analysis techniques could provide an objective assessment of nuclear morphology that could complement conventional histopathological analysis. Second, we wanted to determine whether specific nuclear morphological features could identify those patients with DCIS who are at the highest risk of treatment failure. If specific nuclear morphological features of prognostic value could be identified, they might provide insight into the biological processes that underlie recurrence of DCIS, and this could lead to directed interventions to decrease the risk of recurrence. To approach these goals, a multi-institutional retrospective study was carried out using a case-control design in which DCIS lumpectomy specimens from patients who subsequently experienced recurrence were compared with specimens from matched patients whose disease did not recur. The results reported here suggest that image analysis techniques allow the identification of objective nuclear features useful for predicting local recurrence in DCIS.
| Materials and Methods |
|---|
|
|
|---|
A total of 217 H&E-stained tissue section slides from potential subjects were obtained from the collaborating institutions, including 82 sample slides from M. D. Anderson, 50 from the Van Nuys Breast Center, and 85 from Jefferson University Hospital. These slides were reviewed by M. D. Anderson pathologists to verify the diagnosis of DCIS before review by a consensus pathology panel. Of the 217 H&E slides submitted for evaluation, 67 slides (31%) had no or insufficient tissue blocks available. An additional 9 slides (4%) were found to have a diagnosis other than DCIS. Of the remaining 141 slides with confirmed diagnoses of DCIS, 43 and 98 were associated with recurrent and nonrecurrent subjects, respectively. One slide (recurrent disease) was excluded because of a lack of clinical information, and 14 slides (nonrecurrent disease) were excluded because of lack of matching.
A consensus pathology panel consisting of six breast pathologists from the three institutions was then assembled to review the remaining 126 slides (42 from recurrent and 84 from nonrecurrent subjects) during the final selection process. A nuclear grading score was assigned to each patient sample according to the Lagios grading criteria (18) . Each pathologist independently recorded the nuclear grade for each slide from recurrent and nonrecurrent subjects. The pathologists were blinded to the recurrence or nonrecurrence status of the study subjects. Slides for which agreement on grade was not unanimous were reviewed at a multiheaded microscope, and a consensus was achieved and recorded. The consensual nuclear grade was used for all analyses. Interobserver variability among the pathologists has been described elsewhere (23) .
On completion of the consensus pathology panel review, 105 subjects were deemed eligible for this analysis: 39 patients (10 recurrent and 29 nonrecurrent) from M. D. Anderson, 16 patients (4 recurrent and 12 nonrecurrent) from the Van Nuys Breast Center, and 50 patients (18 recurrent and 32 nonrecurrent) from Jefferson University Hospital. The primary cause for excluding 21 potentially eligible subjects after the consensus panel review was that the consensus slide was subsequently found not to represent the primary lesion. Thus, slides from 32 recurrent and 73 nonrecurrent subjects, were deemed eligible for image analysis.
Nuclear Morphometric Analysis.
Paraffin-embedded breast tissue blocks were cut in serial 4-µm-thick slices, dewaxed in xylene, and rehydrated through an ethanol series. One set of slides was stained with H&E for light-microscopic evaluation. A second set of slides was stained for DNA content using the protocol of Xillix Technology Co. (Vancouver, British Columbia, Canada), including postfixation in Boehm-Sprenger fixative for 45 min, 45 min of acid hydrolysis in 5 N HCl at room temperature, staining in 0.5 mg/ml of thionin-sulfite DNA stoichiometric stain, and stopping in freshly prepared bisulfite solution. The slides from 3 recurrent DCIS subjects were found to be inevaluable, leaving 29 recurrent and 73 nonrecurrent subjects suitable for evaluation.
Nuclear morphometric analysis of the patient sample material was carried out using the Cyto-Savant computer-assisted image analysis system (Oncometrics Imaging Co., Vancouver, British Columbia, Canada). Prior to acquisition of nuclear images, the pathologist (N. S.) examined the H&E-stained specimen to locate the relevant DCIS region and then marked the DCIS region of interest on the thionin-stained slide. Each nuclear image was captured using a 20x objective with a numerical aperture of 0.75 using a high resolution 12-bit digital camera (1280 x 1024 pixels), for which each pixel had a 100% fill factor. Each pixel was 6.8 µm x 6.8 µm in size. The pixel sampling spacing within the image plane was 0.34 µm with a 0.116 µm2 effective pixel spacing area. An average of 200300 relevant DCIS epithelial cell nuclei and 100 lymphocyte nuclei were then selected from the marked regions by a pathologist (I. V. B.) in an interactive mode, and their nuclear images were digitally captured and stored in computer memory. Only nonoverlapping nuclei with easily detected boundaries and without "capping" were chosen. Lymphocytes were used as internal normalization controls to correct for any staining variation among slides. The ability to display the stored nuclear images at higher magnification allowed the pathologist to review all of the captured nuclei and to eliminate fragmented cells from the final analysis.
The Cyto-Savant imaging system measures 116 features based on the digital nuclear images using computational algorithms described previously (38) . Features measured by the Cyto-Savant imaging system can be grouped into three general categories: nuclear morphological features, chromatin texture, and DNA content. Morphological features include nuclear area and shape parameters that reflect variations from nuclear roundness, angular variation in nuclear contour, and raggedness of the nuclear boundary. Textural features describe variations in absorbance over the nuclear area, and DNA content reflects the integrated absorbance over the nuclear area of the cell relative to that of internal control lymphocytes.
Selection of Independent Nuclear Features.
The mean values of each of 116 nuclear features by the Cyto-Savant System were recorded as a continuous variable. Many of the nuclear features measure similar aspects of cell structure; thus, a high degree of collinearity was observed in this data set. Because the presence of collinear features can degrade the performance of an algorithm as well as increase type I error, the number of morphometric variables was reduced to a manageable level using a diagnostic of collinearity devised by Belsley (39)
. Briefly, a set of variables was considered collinear if a high-scaled condition index was associated with high-scaled variance-decomposition proportions for two or more estimated regression coefficient variances. Condition indices were deemed high when they were >30, and variance proportions were deemed high when they were >0.5. This variable selection procedure was essentially a forward selection procedure. Given a set of (scaled) variables already selected for inclusion in the model, each remaining variable was examined in turn to determine whether its inclusion would result in unacceptable collinearity. Then, from the set of variables that would not give rise to collinearity, variables were selected if, when added to the variables already included, they produced a data set with the smallest overall condition number. The condition number is a measure of the overall level of collinearity present in a data set. This process was repeated until no candidate variables were able to pass the entrance screening procedure. The set of variables selected in this fashion does not necessarily represent the minimum size nor does it possess the lowest degree of collinearity of all subsets of equal size. Rather, it is a subset of variables whose acceptable level of collinearity is such that no variable can be added without raising collinearity to an unacceptable level. To address the absence of uniqueness, the procedure was repeated using each variable in turn as the sole initial candidate.
We also ran backward stepwise logistic regression analyses using varying stringencies as an initial variable screen using both means and variances of nuclear features. Backward selections with stringencies of 0.01, 0.02, 0.05, and 0.10 were performed.
Statistical Analysis.
The Mann-Whitney U test was used to compare values of each morphological feature between recurrent and nonrecurrent study subjects. Each nuclear feature was compared between these two groups, stratified by the consensual nuclear grade of each sample using a box-plot analysis. The mean nuclear feature values were dichotomized into low and high values using the median value of the whole study population as cutoff point (excluding nuclear grade 1 data).
One objective of this study was to estimate the risk of recurrence among patients who were diagnosed with DCIS after lumpectomy/local excision. ORs and 95% CIs for each feature were computed by a logistic regression model based on a maximum likelihood method using the Statistical Package for the Social Sciences (SPSS Inc., Chicago, Illinois) and STATA computer software programs (Stata Corporation, College Station, Texas). Individual matching on age and follow-up interval was suboptimal in some instances; therefore, these variables were adjusted during unconditional multivariate modeling. A P below 0.05 was considered statistically significant.
| Results |
|---|
|
|
|---|
As shown in Table 1
, the median age was similar among subjects with or without recurrence. The median length of follow-up appeared to be longer for nonrecurrent than for recurrent subjects, partly because disease recurrence interrupted follow-up. During selection of nonrecurrent DCIS subjects, an attempt was made to find patients whose surgery was performed in close proximity to the time of surgery of the relevant recurrent subjects (±5 years) to ensure that changes in patterns of care over time did not bias the analysis. When this was not possible, nonrecurrent subjects from earlier time periods were chosen. Fifty-four % of recurrent and 49% of nonrecurrent subjects had extensive necrosis, whereas absence of necrosis was more common among the nonrecurrent group (25%) than the recurrent group (21%). These differences were not statistically significant. Whereas the percentage of grade 3 lesions was similar among the two groups, grade 2 lesions were slightly more numerous among nonrecurrent subjects. (P was not significant). No significant difference was seen between recurrent and nonrecurrent subjects with regard to radiation treatment; however, the participating institutions differed in patient management. The majority of patients (86%) treated at the M. D. Anderson Cancer Center received radiation therapy, whereas none received radiation at Jefferson University Hospital, and only 31% treated at the Van Nuys Breast Center did so.
|
Because many of the quantified features provided by the Cyto-Savant image analysis system reflect similar aspects of nuclear structure, a high degree of collinearity between several variables was observed. After a procedure described by Belsley (39) was applied to identify collinearity, the means of eight features turned out to be independent and informative, including the following: (a) low_den_obj (a measure of the number of grouped pixels with low absorbance); (b) lowDNAarea (a measure of the fraction of the nucleus occupied by low-density pixels); (c) var_radi (a measure of the variance of length of the objects radius vectors); (d) FA2 (FA2, a measure of nuclear texture that reflects the frequency of changes from low-absorbance regions to high-absorbance regions); (e) harmon3 (a nuclear morphometric measure that estimates low harmonic changes in the nuclear boundary); (f) range_extreme (a measure of nuclear texture that describes intensity differences between the largest local maximum and the smallest local minimum, normalized against the slide DNA content); (g) hiDNAcomp (a nuclear texture feature that represents the degree of compactness of the medium- and high-density regions, treated as a single object); and (h) high_cnt_mass (a measure of the separation between the geometric center of the high-absorbance clusters and geometric center of the whole object, normalized by its mean_radius). No statistically significant differences were observed in the median values of recurrent and nonrecurrent subjects for these features.
We also ran backward step-wise logistic regression analyses using varying stringencies for selection of nuclear features using both mean and variance data. Although several new features were identified by backward step-wise logistic regression analyses, none proved to be stronger discriminators than features chosen by Belsleys method (39) . However, variances in nuclear sphericity and FQH showed stronger discriminatory power to separate recurrent DCIS from nonrecurrent DCIS with low FA2.
One of the goals of this study was to use image analysis techniques to quantify nuclear features (e.g., size, pleomorphism) commonly used by pathologists to describe and grade DCIS. We, therefore, examined the usefulness of means of the following eight features provided by the Cyto-Savant instrument: (a) nuclear area (total number of pixels belonging to the object); (b) elongation (the extent of the object along the major axis versus the perpendicular direction); (c) eccentricity (the ratio of the major axis to minor axis of the best-fit ellipse); (d) sphericity (minimum-to-maximum radius ratios, measured from the centroid of the nucleus); (e) compactness (a measure of the overall absorbance of the nucleus); (f) var_radi (a measure of the variation of the radius of the nucleus); (g) freq_low_fft (FQL, a measure of the low harmonic variations in the boundary of the nucleus); and (h) freq_high_fft (FQH, a measure of the high harmonic variations in the boundary of the nucleus). The mean values of recurrent and nonrecurrent subjects were dichotomized into high- and low-value groups for each feature based on the median for the total population. As shown in Table 2
, trends for differences between recurrent and nonrecurrent subjects were observed for several of these nuclear features. For example, the median value of elongation was found to be significantly higher among recurrent compared with nonrecurrent subjects (P = 0.04). Likewise, the median value of eccentricity was also found to be significantly higher among recurrent than nonrecurrent subjects (P = 0.05).
|
|
|
|
|
|
To determine whether a combination of nuclear features might provide better discrimination between recurrent and nonrecurrent subjects, multiple feature sum-score models were developed in which a value of one was assigned to a high feature value associated with recurrence, a value of zero was assigned to a low feature value not associated with recurrence, and then a sum was determined for each subject. These analyses were performed separately for the high and low FA2 groups. To determine the significance of an OR based on the resulting sums of feature values, the summed scores were dichotomized into low and high categories depending on the proportion of recurrent and nonrecurrent subjects in each category. For example, as shown in Table 4
, subjects with a high mean FA2 who also exhibited both high mean nuclear area and high mean var_radi had a 7-fold higher likelihood of experiencing a recurrence than subjects not showing both high feature values (P = 0.09). Moreover, subjects with evidence of three poor morphometric prognostic features (i.e., high mean nuclear area, high mean variation in radius, and high mean FQH had only a slightly higher OR (8.74); however, the result was highly significant (P = 0.01).
|
|
968.9). However, 6 (55%) of 11 of the recurrent subjects with high mean FA2 and three poor nuclear features showed recurrence, compared with 5 (13.9%) of 36 of the high mean FA2 cases without all three poor features. Similarly, for the subjects with low mean FA2 values, 12 (55%) of 22 of the recurrent subjects with high variances in sphericity and FQH showed recurrence compared with 6 (18%) of 33 of the subjects with low variance values.
|
|
| Discussion |
|---|
|
|
|---|
On the basis of the previous literature, we expected nuclear grade to be predictive of recurrence. However, despite the fact that the recurrent and nonrecurrent subjects were not matched histologically, nuclear grade did not predict recurrence in this population. The reason for this finding is not well understood. One possible explanation may be the problem of interobserver variability in grading DCIS lesions. For example, whereas interobserver reproducibility of distinguishing nuclear grade 3 and 2 lesions has been reported to be superior to that of differentiating nuclear grades 2 and 1, disagreement rates between pathologists still approach 3040% for nuclear grade 2 and 3 lesions and more than 60% for grade 1 and 2 lesions (23 , 24) . This interobserver variability may be based on the subjective quality of distinguishing characteristics such as nuclear pleomorphism, nucleolar prominence, and hyperchromasia.
To overcome this problem, we used image analysis to objectively quantify nuclear features and sought features that could distinguish nuclear grade. Not only could this approach provide a more continuous measure, it raised the possibility of detecting subtle nuclear textural changes that even experienced eyes might find difficult to identify in reproducible fashion. The results of this study suggest that the nuclear morphometric feature FA2 correlates well with nuclear grade. This feature combines DNA content, nuclear area, and nuclear texture into one measure. Because different nuclear features were subsequently found to distinguish recurrent and nonrecurrent subjects with nuclear grade 2 or 3 lesions, it was important to define a quantifiable feature that was closely associated with nuclear grade so that the whole evaluation could remain objective.
To the best of our knowledge, although similar approaches have been used in other disease settings (34 , 43) , this is the first case-control study to examine the potential role of image analysis of nuclear morphometry in predicting recurrence of DCIS. Other studies have examined the role for image analytic techniques in objective nuclear grading and distinguishing benign versus invasive breast disease. For example, Bacus et al. (44) showed in a parallel study using another analytical system that DCIS pathological nuclear grades 2 and 3 could be distinguished from each other and from normal breast epithelium by determination of a mean morphometric nuclear grade based on a standard deviation-derived Z-score using four nuclear features (i.e., area, DNA content, entropy, and valley). Nuclear grade 1 samples were not included in their model. It should be noted that these same features are also part of the determination of the FA2 feature used in this study. Another study (45) used image analysis techniques to focus on the normal-appearing epithelial cells in the field of breast lesions in an attempt to distinguish benign and malignant breast disease. The authors defined MACs based on eight nuclear features (including FA2 and absorbance skewness) and found that they could discriminate benign tumor from breast carcinoma in 86% of cases by using a cutoff value of 34% MAC nuclei. In that study, however, DCIS lesions and invasive ductal carcinoma showed considerable overlaps in MAC values, and the relationship of these values to recurrence was not examined.
The population examined in our study was unique in that it included a cohort of patients with DCIS who underwent breast-sparing surgery at a time when most patients were treated with mastectomy. These subjects, therefore, had a longer follow-up. Also unique was the collaboration in histological evaluations of slides by a consensus panel, consisting of expert pathologists from three well-known cancer centers. Although they reached consensus in each case, disagreement remained with regard to grade and presence or absence of necrosis.
The study was limited by several factors. First, the total number of recurrent subjects for inclusion in the study was limited. Although 432 patients diagnosed with DCIS were originally identified as potential candidates, only 102 patients were included in the analysis because of the need for matching recurrent and nonrecurrent subjects and the availability of evaluable tissue blocks and slides for review. This limited our ability to adjust these results for other factors previously shown to be related to a likelihood of recurrence, including histological subtype, body mass index, hormone replacement therapy, or potential responsiveness to subsequent treatment such as radiation and/or tamoxifen (6 , 46 , 47) . Confirmation of these associations await enlarged studies that control for previously described prognostic factors. Nevertheless, despite the relatively small number of recurrent and nonrecurrent subjects, intriguing associations between objective nuclear features and recurrence risk were identified.
A second limitation of the study was that data on margin status, tumor size, and the absence or presence of comedo-type necrosis for the majority of recurrent and nonrecurrent subjects were not readily available from all of the participating institutions. Recent reports suggest that DCIS patients with surgical margins of >10 mm (in every direction) have extremely low recurrence rates with or without radiation therapy (2 , 14 , 15) , whereas patients showing <1-mm margins have a recurrence rate of 63% without and 29% with postoperative radiation (2) . Moreover, prediction of recurrence risk is claimed to be improved if the size of the lesion and nuclear grading are also taken into account (17) . Similarly, Cheng et al.(14) evaluated the relationship of margin status and likelihood of recurrence among patients with DCIS undergoing breast-conserving surgery and found that tumor size and margin status are independent predictors of residual disease. However, the definition of a negative-free margin differs widely among investigators reporting DCIS data, and the results of studies from different institutions are difficult to compare. Thus, in the present study, it was difficult to correlate these nuclear image analysis features with other factors that may be important for predicting the risk of recurrence. Nevertheless, this approach may prove useful for identifying patients with <10-mm margins that may benefit from treatment beyond local excision.
Although the biological mechanisms underpinning local recurrence are not fully understood, two possibilities are usually considered. First, local recurrence may result from the presence of residual tumor cells outside the resected margin. Alternatively, recurrence may be caused by the presence of a multiclonal field. Both possibilities can be supported by the fact that wider resection margins and mastectomy reduce the risk of recurrence significantly. However, the findings that (a) DCIS lesions and invasive cancers from the same resection show many common sites of loss of heterozygosity (48) , and (b) recurrent lesions exhibit many genetic changes in common with the original DCIS lesion (49) , favor the first possibility.
Interestingly, lower-grade lesions have been reported to recur as invasive cancer more frequently than higher-grade lesions (50) . In this regard, it was interesting that two nuclear features found important for predicting recurrence in subjects with lower FA2 (i.e., lower nuclear grade) were high nuclear elongation and high nuclear eccentricity. Recent studies with mammary cells in vitro and in vivo have demonstrated that an early event in tumorigenic progression and invasion is increased cell migration associated with a change in cell morphology to an elongated form and a change from epithelial to mesenchymal features (51, 52, 53) . The possibility exists, therefore, that the finding of high nuclear elongation in high-risk, lower-grade lesions represents an early stage of epithelial migration, whereby some DCIS cells have developed the ability to migrate along the duct. If these cells migrate beyond the surgical margin without establishing a focus of identifiable DCIS, they may represent the seeds of the future recurrence. To test this hypothesis, we are currently examining the margins of DCIS lesions for the presence of cells showing nuclear features associated with recurrence.
In summary, the current study suggests that nuclear image analysis of DCIS lesions may be an important tool for objective pathological analysis, for both assessment of nuclear grade and determination of features that predict patient outcome. The use of such an approach will overcome the limitations of interobserver agreement and may provide an important adjunct to other clinical procedures for identifying patients with DCIS who are at highest risk of recurrence and may benefit from additional treatment. In the long run, the hope is that the nuclear features discovered to be associated with recurrence will lead to new biological insights regarding the cellular pathways that underlie recurrence and lead to new targeted treatment strategies.
| Acknowledgments |
|---|
| Footnotes |
|---|
1 This research was supported by Grant NCI-CN-65004 from the National Cancer Institute. ![]()
2 To whom requests for reprints should be addressed, at Department of Experimental Therapeutics (Box 019), University of Texas M. D. Anderson Cancer Center, 1515 Holcombe Boulevard, Houston, TX 77030. Phone: (713) 792-2961; Fax: (713) 792-3754; E-mail: whittelm{at}mail.mdanderson.org ![]()
3 The abbreviations used are: DCIS, ductal carcinoma in situ; OR, odds ratio; CI, confidence interval; FA2, fractal2_area; var_radi, variation of radius; FQH or freq_high_fft, frequency of high boundary harmonics; FQL or freq_low_fft, frequency of low boundary harmonics; MAC, malignancy-associated change. ![]()
Received 7/ 5/00; revised 12/ 8/00; accepted 12/15/00.
| References |
|---|
|
|
|---|
-difluoromethylornithine. Cytometry, 38: 214-223, 1999.[Medline]
This article has been cited by other articles:
![]() |
S. E. Steigen, B. Straume, D. Turbin, A. K.W. Chan, S. Leung, T. O. Nielsen, and S. Lindal Clinicopathologic Factors and Nuclear Morphometry as Independent Prognosticators in KIT-positive Gastrointestinal Stromal Tumors J. Histochem. Cytochem., February 1, 2008; 56(2): 139 - 145. [Abstract] [Full Text] [PDF] |
||||
![]() |
G. J. Kelloff, S. M. Lippman, A. J. Dannenberg, C. C. Sigman, H. L. Pearce, B. J. Reid, E. Szabo, V. C. Jordan, M. R. Spitz, G. B. Mills, et al. Progress in Chemoprevention Drug Development: The Promise of Molecular Biomarkers for Prevention of Intraepithelial Neoplasia and Cancer--A Plan to Move Forward Clin. Cancer Res., June 15, 2006; 12(12): 3661 - 3697. [Abstract] [Full Text] [PDF] |
||||
![]() |
M. S. Pepe, H. Janes, G. Longton, W. Leisenring, and P. Newcomb Limitations of the Odds Ratio in Gauging the Performance of a Diagnostic, Prognostic, or Screening Marker Am. J. Epidemiol., May 1, 2004; 159(9): 882 - 890. [Abstract] [Full Text] [PDF] |
||||
| ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
| HOME | HELP | FEEDBACK | SUBSCRIPTIONS | ARCHIVE | SEARCH | TABLE OF CONTENTS |
| Cancer Research | Clinical Cancer Research |
| Cancer Epidemiology Biomarkers & Prevention | Molecular Cancer Therapeutics |
| Molecular Cancer Research | Cancer Prevention Research |
| Cancer Prevention Journals Portal | Cancer Reviews Online |
| Annual Meeting Education Book | Meeting Abstracts Online |