
| HOME | HELP | FEEDBACK | SUBSCRIPTIONS | ARCHIVE | SEARCH | TABLE OF CONTENTS |
1 Northern California Cancer Center, Union City, California; 2 Stanford University Medical Center, Stanford, California; and 3 Department of Epidemiology, and Biostatistics, School of Medicine, University of California, San Francisco, San Francisco, California
| Abstract |
|---|
|
|
|---|
statistics. Agreement of registry and expert diagnoses was high (98%). Thirty patients were found on review not to have NHL; most of these had leukemia. For subtypes, agreement of registry and expert classification was more moderate (59%). Agreement varied substantially by subtype from 5% to 100% and was 77% for the most common subtype, diffuse large cell lymphoma. Seventy-seven percent of 128 registry-unclassified lymphomas were assigned a subtype on re-review. Our analyses suggest excellent diagnostic reliability but poorer subtype reliability of NHL in cancer registry data information that is critical to the interpretation of lymphoma time trends. Thus, overall NHL incidence and survival statistics from the early 1990s are probably accurate, but subtype-specific statistics could be substantially biased, especially because of high (1520%) proportions of unclassified lymphomas. | Introduction |
|---|
|
|
|---|
A major concern for the epidemiological study of NHL involves tumor subtype. At present, at least 20 subtypes of NHL have been defined (3) , each distinct with respect to histopathological, immunological, and clinical characteristics, leading to the assumption that they might also differ according to incidence trends and etiology. However, the surveillance and study of NHL subtypes are methodologically challenging. First, even large studies may have low statistical power for the many relatively uncommon subtypes. Second, the coexistence of multiple NHL classification systems (e.g., Kiel, Lukes-Collins, Rappaport, Working Formulation, Revised European-American Lymphoma (REAL), and WHO) over the past few decades complicates the comparison of study results. Third, diagnostic and classification criteria may not be uniform in cancer registry or other population-based settings because NHL may have been diagnosed and classified by numerous independent pathologists, perhaps using diverse methodologies. This problem should be mitigated somewhat with the implementation of the WHO consensus classification, the most recently developed classification scheme that demonstrates superior reliability to prior schemes in clinical settings (4) . Regardless, for cancer registry data collected before 2001 that classified NHL according to the Working Formulation, variability in subtype classifications could have resulted in inaccurate incidence and survival statistics, especially time trends such as the marked increases reported recently for follicular, peripheral T-cell, and small cell lymphocytic lymphomas (5 , 6) .
Interobserver reliability of NHL diagnostic criteria and Working Formulation classifications has been addressed in clinical series (4 , 7) but has not been evaluated recently in population-based data. To our knowledge, only one prior analysis compared NHL diagnostic and subtype information reported from a cancer registry in the early 1980s with that obtained from a panel of expert pathologists and found 93% agreement with the diagnosis of NHL, but only 55% agreement with subtype (8) . Therefore, to update our understanding of interobserver reliability for NHL, we compared cancer registry NHL subtype diagnoses, which are transcribed directly from the medical record, with diagnoses obtained from a uniform re-review by an expert hematopathologist as part of a large, population-based study of NHL patients diagnosed in the San Francisco Bay Area in the early 1990s. We also estimated the impact of this reliability on NHL subtype incidence statistics.
| Materials and Methods |
|---|
|
|
|---|
Of 1610 consenting patients, pathology review could not be undertaken for 53 (3%) for technical reasons (e.g., pathology reports or diagnostic slides could not be located, or sections were determined to be technically inadequate). In addition, original registry histology could not be retrieved for 35 patients (2%) who were determined by the cancer registry not to be incident NHL cases in the region after study completion. Therefore, 1522 patients with valid registry and re-review information were included in the present analysis.
In the cancer registry, lymphoma classification is operationalized through the International Classification of Diseases for Oncology (ICD-O) morphological classification system, which is routinely updated to reflect changes in diagnostic practice. For lymphomas, the first (ICD-O-1) and second (ICD-O-2) editions (18)
generally classified lymphomas according to the Working Formulation and other now-obsolete schemes. ICD-O-1 was used to code cases diagnosed before 1990, and a field trial edition of ICD-O-2 was used for cases diagnosed in 1990 and 1991. The final ICD-O-2 was used to classify diagnoses in the years 1992 through 2000. For the present analysis, all cancer registry and expert diagnoses were classified according to ICD-O-2 (Table 1)
, although the hematopathologist did not use the ICD-O-2 classifications 9693 (lymphocytic lymphoma, well-differentiated, nodular), 9696 (lymphocytic lymphoma, poorly differentiated nodular); 9701 (Sezarys disease), 9702 [peripheral T-cell lymphoma, not otherwise specified (NOS)], 9704 (lymphoepitheloid lymphoma), or 9709 (cutaneous lymphoma). Therefore, we grouped original registry diagnoses using these classifications (n = 33; 2%) into an "obsolete codes" category for comparison with expert diagnoses. In addition, several generally uncommon classifications not originally represented in the case series could not be re-reviewed; these included 9674 (centrocytic lymphoma), 9676 (centroblastic-centrocytic lymphoma, diffuse), 9692 (centroblastic-centrocytic lymphoma, follicular), 9697 (centroblastic lymphoma, follicular), 9703 (T-zone lymphoma), 9705 (peripheral T-cell lymphoma angioimmunoblastic lymphadenopathy with dysproteinemia), 9706 (peripheral T-cell lymphoma, pleomorphic small cell), 9707 (peripheral T-cell lymphoma, pleomorphic medium and large cell), 9712 (angioendotheliomatosis), 9713 (angiocentric T-cell lymphoma), and 9714 (large cell Ki-1+ lymphoma). Altogether, these classifications represented less than half of 1% of all eligible NHLs reported to the cancer registry during this time period. For some analyses, we grouped subtypes together into broader categories modified from those used by Groves et al. (5)
, including NHL, NOS (95909595), follicular (9690, 9691, 9695, and 9698), diffuse (9672, 9673, 9675, 96809682, and 9711), and high grade (96859687).
|
statistic, which represents the extent of agreement beyond that expected by chance (20)
, and the 95% confidence interval around this statistic. In general,
statistics ranging from 0.41 to 0.60 have been interpreted to indicate "moderate" agreement, those ranging from 0.61 to 0.80 have been interpreted to indicate "substantial" agreement, and those of
0.81 have been interpreted to indicate "near perfect" agreement (21)
. Calculation of all cross-tabulations and study statistics was performed using SAS version 6.12. To understand the impact of diagnostic and classification reliability on NHL incidence statistics, we estimated the hypothetical distribution of histological subtypes that would have been expected if expert review had occurred for all cases in the SEER database. We did not have sufficient numbers to assess positive predictive values for age-specific groups needed to recalculate age-adjusted incidence rates. To produce the hypothetical distribution, we obtained case counts for all NHLs by ICD-O-2 histological type for the entire nine-registry SEER database (22) for the same period from which the re-reviewed cases were diagnosed (19881994) and multiplied those counts by the positive predictive values described above.
| Results |
|---|
|
|
|---|
Subtype Classification Reliability.
Overall, for the 1506 cases confirmed as NHL, original and expert subtype classification agreed for only 883 (59%). Moderate overall agreement was indicated by the
statistic of 0.54 (95% confidence interval, 0.500.57). However, across subtypes, agreement ranged from 4% to 100% (Table 2)
. Agreement was 77% for diffuse large cell lymphoma, the most common NHL subtype in this series. Agreement was perfect for monocytoid B-cell lymphomas (100%) and was also high for mycosis fungoides (88%) but was lower for other subtypes including small lymphocytic lymphoma (69%) and immunoblastic lymphoma (44%). The subtypes with the poorest agreement included diffuse small cleaved cell lymphoma (5%) and follicular lymphoma, NOS (4%).
|
Among the 128 NHL cases originally unclassified, only 23% remained unclassified after re-review. NHL cases that originally were unclassified were disproportionately re-reviewed as large B-cell lymphoma. In addition, 68 cases classified in the cancer registry as specific subtypes were found by the expert to be unclassifiable. These included a disproportionate number of diffuse and high-grade subtypes including immunoblastic, lymphoblastic, Burkitts, and diffuse small cell noncleaved lymphoma.
Application of Results to SEER Database.
When these results were extrapolated to the larger SEER database to determine the impact of the expert review on the distribution of subtypes (Table 3)
, the proportion of unclassified cases was cut in half, from 14% to 7%. Some subtypes were increased in representation (small lymphocytic, diffuse lymphocytic, and diffuse large cell, and follicular, small cleaved cell), whereas others decreased slightly (diffuse, small cleaved cell, and immunoblastic lymphomas). Diffuse large cell lymphoma remained the most common subtype but represented a greater proportion of all patients (32% versus 25%).
|
| Discussion |
|---|
|
|
|---|
Whereas overall diagnostic reliability was shown to be excellent, our data suggest poorer reliability of NHL subtypes. Our findings of 59% agreement between registry and expert subtype classification, as well as substantial variation in agreement by specific subtype (5100%), concur with those reported by Dick et al. (8) , who found 55% overall agreement and subtype variation of 14100% in cases diagnosed at least 10 years previously. Subtype-specific agreements observed in this study also were generally similar to those reported by Dick et al., with agreement exceeding 75% for small lymphocytic lymphoma and most follicular subclassifications (with the exception of follicular, NOS), and poor agreement for diffuse small non-cleaved cell (Burkitts) lymphoma (8) . However, we observed substantially better agreement for diffuse large cell lymphoma (77%) than that reported in the Midwestern data (47%; Ref. 8 ). We also observed that agreement for broader groupings of subtypes (e.g., follicular, diffuse) was generally better than that for component subtypes.
These results suggest that incidence and survival rates for NHL produced with data from the SEER program or other cancer registries collected prior to 2001 probably are not substantially impacted by diagnostic misclassification with leukemias, HD, or other cancers but that rates for certain NHL subtypes could be moderately biased. Rates for broader groupings of subtypes may be less biased than single subtypes. Although we did not have the statistical power to estimate age-specific agreement that would be needed to recalculate incidence rates properly, our estimates of the revised distribution of lymphoma subtypes suggest that, without the benefit of uniform review, rates of diffuse large cell lymphoma may be underestimated, whereas rates of unclassified lymphomas may be overestimated. These findings also illustrate the importance of including uniform re-review in population-based epidemiological studies of NHL to assign subtype, although not necessarily to exclude invalid diagnoses of NHL.
Our results have identified several areas for improvement in the registration of lymphomas. Among NHLs reported to the cancer registry as unclassifiable, only 25% could not be assigned a subtype by our expert hematopathologist. Fewer than 5% of follicular lymphoma NOS cases could not be subclassified by the expert, suggesting that nearly all follicular lymphomas in the cancer registry can be assigned a subclassification. Ambiguous terminology on pathology reports can result in cancer registrars interpreting and classifying NHL subtypes nonuniformly (25) , but otherwise, the reasons why NHLs are registered as unclassified and whether these problems are remediable remain unclear. Because unclassified lymphomas represented nearly one-fifth of all NHLs reported to the SEER program throughout the 1990s, the misclassification of classifiable lymphomas as NOS has biased subtype distributions, as shown here, and is likely to have biased subtype-specific incidence rates, trends, and survival statistics published previously (2 , 5 , 6 , 26 , 27) .
The generalizability of our results could be limited by several factors. First, because slides for pathological re-review were obtained for patients who participated in a case-control study as opposed to a complete population-based series, our estimate of overall agreement for NHL subtypes may be biased by the nonparticipation of patients with concurrent HIV infection or otherwise poor survival (15) , who were more likely to have had high-grade or immunoblastic subtypes that showed generally poorer agreement than other subtypes. However, it is uncertain how nonparticipation might have biased subtype-specific estimates of diagnostic agreement and positive predictive value. Second, because this study was conducted in the San Francisco Bay Area during the crest of the HIV epidemic, its distribution of NHL subtypes probably differs from that of other regions. Whereas the distribution of subtypes itself should not have materially impacted our findings, the excess of HIV-associated NHL subtypes in our region may have influenced physicians diagnostic or classification practices. Third, the location in this region of Stanford University Medical Center, a renowned lymphoma referral center, could have resulted in higher agreement, although diagnostic and classification agreement did not differ between HD patients initially diagnosed at Stanford University Medical Center and those diagnosed elsewhere (23) . Fourth, different rates of agreement may have been obtained from a panel review, an approach used in other reliability studies (4) .
Because this comparison used ICD-O-2 classifications based on the Working Formulation, it cannot address the reliability in population-based data using the new ICD-O-3 classifications now being used by cancer registries to classify lymphomas diagnosed in the year 2001 and beyond. The ICD-O-3 classification is based heavily on the WHO system, which relies substantially on immunohistochemical characteristics, and has been shown to have interobserver reliability exceeding 85%, a major improvement over the Working Formulation and other systems (28) that depend more on microscopic characteristics. The better reliability of the WHO classification in the clinical setting should translate to improved reliability in cancer registry data. Nonetheless, reliability of ICD-O-2 subtype classifications will remain relevant in analyses of time trends and in population-based series including patients diagnosed before 2001.
The lack of uniformity in NHL diagnostic and subtype classification in cancer registry and other multicenter data has been unsettling for decades, particularly before the adoption of a consensus classification system. The implementation of the reliable consensus WHO system marks a hopeful moment in our quest to learn more about the etiologies of specific NHL subtypes, especially subtypes shown to be increasing in incidence. Therefore, interobserver reliability will continue to be important to the interpretation of secular trends in the incidence of NHL and specific subtypes and should be reassessed periodically.
| Acknowledgments |
|---|
| Footnotes |
|---|
The costs of publication of this article were defrayed in part by the payment of page charges. This article must therefore be hereby marked advertisement in accordance with 18 U.S.C. Section 1734 solely to indicate this fact.
Requests for reprints: Christina A. Clarke, Northern California Cancer Center, 32960 Alvarado-Niles Road, #600, Union City, California 94587. Phone: (510) 429-2500; Fax: (510) 991-4405; E-mail: tina{at}nccc.org
Received 7/28/03; revised 9/ 2/03; accepted 9/10/03.
| References |
|---|
|
|
|---|
This article has been cited by other articles:
![]() |
J. B. Yu, R. C. Blitzblau, R. H. Decker, D. M. Housman, and L. D. Wilson Analysis of Primary CD30+ Cutaneous Lymphoproliferative Disease and Survival From the Surveillance, Epidemiology, and End Results Database J. Clin. Oncol., March 20, 2008; 26(9): 1483 - 1488. [Abstract] [Full Text] [PDF] |
||||
![]() |
S. Koutros, Y. Zhang, Y. Zhu, S. T. Mayne, S. H. Zahm, T. R. Holford, B. P. Leaderer, P. Boyle, and T. Zheng Nutrients Contributing to One-Carbon Metabolism and Risk of Non-Hodgkin Lymphoma Subtypes Am. J. Epidemiol., February 1, 2008; 167(3): 287 - 294. [Abstract] [Full Text] [PDF] |
||||
![]() |
L. M. Morton, J. J. Turner, J. R. Cerhan, M. S. Linet, P. A. Treseler, C. A. Clarke, A. Jack, W. Cozen, M. Maynadie, J. J. Spinelli, et al. Proposed classification of lymphoid neoplasms for epidemiologic research from the Pathology Working Group of the International Lymphoma Epidemiology Consortium (InterLymph) Blood, July 15, 2007; 110(2): 695 - 708. [Abstract] [Full Text] [PDF] |
||||
![]() |
E van Balen, R Font, N Cavalle, L Font, M Garcia-Villanueva, Y Benavente, P Brennan, and S de Sanjose Exposure to non-arsenic pesticides is associated with lymphoma among farmers in Spain Occup. Environ. Med., October 1, 2006; 63(10): 663 - 668. [Abstract] [Full Text] [PDF] |
||||
![]() |
E. D. Flick, K. A. Chan, P. M. Bracci, and E. A. Holly Use of Nonsteroidal Antiinflammatory Drugs and Non-Hodgkin Lymphoma: A Population-based Case-Control Study Am. J. Epidemiol., September 1, 2006; 164(5): 497 - 504. [Abstract] [Full Text] [PDF] |
||||
![]() |
T. Battaglioli, G. Gorini, A. S. Costantini, P. Crosignani, L. Miligi, O. Nanni, E. Stagnaro, R. Tumino, and P. Vineis Cigarette smoking and alcohol consumption as determinants of survival in non-Hodgkin's lymphoma: a population-based study Ann. Onc., August 1, 2006; 17(8): 1283 - 1289. [Abstract] [Full Text] [PDF] |
||||
![]() |
R. Moslehi, S. S. Devesa, C. Schairer, and J. F. Fraumeni Jr. Rapidly Increasing Incidence of Ocular Non-Hodgkin Lymphoma. J Natl Cancer Inst, July 5, 2006; 98(13): 936 - 939. [Abstract] [Full Text] [PDF] |
||||
![]() |
C. A. Clarke, D. M. Undurraga, P. J. Harasty, S. L. Glaser, L. M. Morton, and E. A. Holly Changes in cancer registry coding for lymphoma subtypes: reliability over time and relevance for surveillance and study. Cancer Epidemiol. Biomarkers Prev., April 1, 2006; 15(4): 630 - 638. [Abstract] [Full Text] [PDF] |
||||
![]() |
L. M. Morton, S. S. Wang, S. S. Devesa, P. Hartge, D. D. Weisenburger, and M. S. Linet Lymphoma incidence patterns by WHO subtype in the United States, 1992-2001 Blood, January 1, 2006; 107(1): 265 - 276. [Abstract] [Full Text] [PDF] |
||||
![]() |
S. Y. Pan, Y. Mao, A.-M. Ugnat, and and the Canadian Cancer Registries Epidemiology Re Physical Activity, Obesity, Energy Intake, and the Risk of Non-Hodgkin's Lymphoma: A Population-based Case-Control Study Am. J. Epidemiol., December 15, 2005; 162(12): 1162 - 1173. [Abstract] [Full Text] [PDF] |
||||
![]() |
J. J. Turner, A. M. Hughes, A. Kricker, S. Milliken, A. Grulich, J. Kaldor, and B. Armstrong WHO Non-Hodgkin's Lymphoma Classification by Criterion-Based Report Review followed by Targeted Pathology Review: An Effective Strategy for Epidemiology Studies Cancer Epidemiol. Biomarkers Prev., September 1, 2005; 14(9): 2213 - 2219. [Abstract] [Full Text] [PDF] |
||||
![]() |
W. T. Swenson, J. E. Wooldridge, C. F. Lynch, V. L. Forman-Hoffman, E. Chrischilles, and B. K. Link Improved Survival of Follicular Lymphoma Patients in the United States J. Clin. Oncol., August 1, 2005; 23(22): 5019 - 5026. [Abstract] [Full Text] [PDF] |
||||
![]() |
A. Altieri, J. L. Bermejo, and K. Hemminki Familial risk for non-Hodgkin lymphoma and other lymphoproliferative malignancies by histopathologic subtype: the Swedish Family-Cancer Database Blood, July 15, 2005; 106(2): 668 - 672. [Abstract] [Full Text] [PDF] |
||||
![]() |
E. T. Chang, H. Hjalgrim, K. E. Smedby, M. Akerman, E. Tani, H. E. Johnsen, B. Glimelius, H.-O. Adami, and M. Melbye Body Mass Index and Risk of Malignant Lymphoma in Scandinavian Men and Women J Natl Cancer Inst, February 2, 2005; 97(3): 210 - 218. [Abstract] [Full Text] [PDF] |
||||
| ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
| HOME | HELP | FEEDBACK | SUBSCRIPTIONS | ARCHIVE | SEARCH | TABLE OF CONTENTS |
| Cancer Research | Clinical Cancer Research |
| Cancer Epidemiology Biomarkers & Prevention | Molecular Cancer Therapeutics |
| Molecular Cancer Research | Cancer Prevention Research |
| Cancer Prevention Journals Portal | Cancer Reviews Online |
| Annual Meeting Education Book | Cell Growth & Differentiation |