
| HOME | HELP | FEEDBACK | SUBSCRIPTIONS | ARCHIVE | SEARCH | TABLE OF CONTENTS |
1 Departments of Epidemiology and Molecular Microbiology and Immunology, Johns Hopkins University, Baltimore, Maryland; Divisions of 2 Cancer Epidemiology and Genetics and 3 Cancer Prevention, National Cancer Institute, NIH, Department of Health and Human Services, Bethesda, Maryland; and 4 Departments of Molecular Genetics and Microbiology and Obstetrics and Gynecology, University of New Mexico Health Sciences Center, School of Medicine, Albuquerque, New Mexico
Requests for reprints: Philip E. Castle, Division of Cancer Epidemiology and Genetics, National Cancer Institute, NIH, Department of Health and Human Services, Room 5004, EPS MSC 7234, 6120 Executive Boulevard, Bethesda, MD 20892-7234. Phone: 301-435-3976; Fax: 301-402-0916. E-mail: castlep{at}mail.nih.gov
| Abstract |
|---|
|
|
|---|
Methods: LA and hc2 results were compared on baseline specimens collected from women with an atypical squamous cells of undetermined significance (ASCUS) Pap referred into ASCUS and Low-Grade Squamous Intraepithelial Lesion Triage Study (n = 3,488). hc2 was conducted at the time of the study on liquid cytology specimens. LA was conducted retrospectively on aliquots from a second, stored cervical specimen masked to the hc2 results and clinical data. Paired LA and hc2 results (n = 3,289; 94%) were compared for the detection of carcinogenic HPV (HPV 16, 18, 31, 33, 35, 39, 45, 51, 52, 56, 58, 59, 66, and 68) and 2-year cumulative cervical intraepithelial neoplasia (CIN) grade
3 as diagnosed by the quality-control pathology review.
Results: LA was more likely to test positive for carcinogenic HPV than hc2 (55% versus 53%; P = 0.001). For 2-year cumulative
CIN3, LA and hc2 had similar sensitivities (93.3% versus 92.6%, respectively; P = 1), and LA was marginally less specific than hc2 (48.1% versus 50.6%, respectively; P = 0.05). LA and hc2 had similar negative predictive values (98.70% versus 98.64% respectively; P = 0.4), and LA had a slightly lower positive predictive value than hc2 (14.6% versus 15.1%, respectively; P < 0.0001).
Conclusion: We observed that LA and hc2 performed similarly in the detection of carcinogenic HPV and identification of CIN3 among women with an ASCUS Pap. (Cancer Epidemiol Biomarkers Prev 2008;17(5):1248–54)
| Introduction |
|---|
|
|
|---|
15 cancer-associated (carcinogenic) human papillomavirus (HPV) genotypes cause virtually all cervical cancer and its immediate precursor lesions, most importantly cervical intraepithelial neoplasia (CIN) grade 3 ("cervical precancer"). HPV infections are common and typically resolve within 1 to 2 years. Uncommonly, carcinogenic HPV infections can persist, and this persistence is strongly associated with cervical precancer, which if left untreated can lead to invasive disease.
Based on knowledge of the central role for persistent, carcinogenic HPV in the development of cervical cancer, carcinogenic HPV testing offers several advantages over cytology, including (a) greater sensitivity for the detection of CIN3 or cancer (
CIN3; refs. 1-7); (b) as a consequence of greater sensitivity, higher negative predictive value (NPV), that is, testing negative for carcinogenic HPV DNA implies an extremely low risk of prevalent or incipient cancer/CIN3 (1, 2, 8), permitting an extension of screening intervals; and (c) greater reproducibility (9, 10). Accordingly, carcinogenic HPV testing has now been approved in the United States as an adjunct to cytology for triage of equivocal cytology at all ages and for general screening in women
30 years old (11).
One pooled probe test for detection of the carcinogenic genotypes of HPV DNA (as a group), Hybrid Capture 2 (hc2; Digene), has already been approved by the Food and Drug Administration. Other tests are in development or being validated and are expected to become widely available soon. One of these tests, Linear Array (LA; Roche Molecular Systems), is a PCR-based assay that detects 37 HPV genotypes individually, including the main 14 carcinogenic HPV genotypes. LA is the commercialized (research use–only) version of the Line Blot Assay (Roche) that has been used in numerous epidemiologic and clinical studies (12-17), including the Atypical Squamous Cells of Undetermined Significance (ASCUS) and Low-Grade Squamous Intraepithelial Lesion (LSIL) Triage Study (ALTS; refs. 14, 17, 18). Using baseline specimens from women referred into ALTS because of an ASCUS (equivocal) Pap, we sought to evaluate the performance of LA, compared with the reference standard of hc2, for detection of carcinogenic HPV and triage of ASCUS Pap for identifying women with
CIN3.
| Subjects and Methods |
|---|
|
|
|---|
HPV DNA Testing
Residual PreservCyt specimens, after being used for liquid-based cytology, were tested by hc2 (23), a pooled probe, signal amplification DNA test that targets a group of 13 HPV genotypes (HPV 16, 18, 31, 33, 35, 39, 45, 51, 52, 56, 58, 59, and 68; ref. 24). Per the manufacturer's instructions, a protocol for converting the liquid cytology samples into a STM equivalent was used. In addition, hc2 cross-reacts strongly with a 14th carcinogenic HPV genotype, HPV66 (25-27), as well as other untargeted, noncarcinogenic HPV genotypes, including HPV53. hc2 signal strength [relative light units per positive control (RLU/CO)] was used as semiquantitative measure of HPV viral load ("HPV semiquantitative viral load"; ref. 28). An equivalent of 10% of each original specimen was used for hc2 testing.
Aliquots of the archived, enrollment STM specimens were retrospectively tested by LA (29), which employs L1 consensus primers PGMY09/11 for amplification, and amplicons were subjected to reverse-line blot hybridization for detection of 37 HPV individual genotypes (HPV 6, 11, 16, 18, 26, 31, 33, 35, 39, 40, 42, 45, 51-56, 58, 59, 61, 62, 64, 66-73, 81, 82, 82v, 83, 84, and 89). Because of intellectual property rights, LA does not directly detect HPV52 but combines a set of probes that detects HPV 33, 35, 52, and 58 combined (HPVmix). Specimens that test negative for HPV 33, 35, and 58 individually, but are positive for the HPVmix, are considered to be HPV52 positive. The specimens that test positive for the HPVmix and HPV 33, 35, and/or 58 have an uncertain HPV52 status, and for this analysis, these specimens were considered to be HPV52 negative. LA was used according to the manufacturer's instructions in the product insert, which includes DNA extraction using the QIAamp MinElute Media Kit (Qiagen, Valencia, CA). The only deviation from the LA product insert protocol was to implement an automated sample preparation for extraction of up to 96 specimens at a time on the Qiagen MDx platform (using the MinElute Media MDx Kit and manufacturer's instructions) rather than processing 24 specimens per batch with the manual vacuum method (29, 30). An equivalent of 2.8% of each original specimen was used for LA testing. Specimens were tested by LA a median of 104 months after collection, masked to the hc2 results and clinical data.
HPV genotypes 16, 18, 31, 33, 35, 39, 45, 51, 52, 56, 58, 59, 66, and 68 were considered the primary carcinogenic genotypes (31, 32). We included HPV66 in our definition because it was recently reclassified as a carcinogenic HPV genotype (32), and it is well known that hc2 strongly detects HPV66, although it is not one of the 13 genotypes directly targeted by hc2 (25, 26, 27). In fact, in a previous analysis, we found hc2 to be more likely to be positive in the presence of HPV66 than in the presence of HPV68, one of the hc2-targeted HPV genotypes. LA results were assigned a HPV risk group according to a priori established cervical cancer risk (e.g., HPV16 causes 50-60% of all cancers, HPV18 causes 15-20% of all cancers, and the other 12 carcinogenic HPV genotypes cause the remaining cases of cancer): (a) positive for HPV16, (b) else positive for HPV18 and negative for HPV16, (c) else positive for any carcinogenic HPV genotypes and negative for HPV 16 and 18 (carcinogenic HPV excluding HPV 16 and 18), (d) else positive for any noncarcinogenic HPV genotypes and negative for all carcinogenic genotypes, or (e) LA negative (HPV16 > HPV18 > carcinogenic HPV excluding HPV 16 and 18 > noncarcinogenic HPV > PCR negative).
Pathology and Treatment
Clinical management was based on the clinical center pathologists' cytologic and histologic diagnoses. In addition, all referral smears, ThinPrep, and histology slides were sent to the Pathology Quality Control Group (QC Pathology) based at the Johns Hopkins Hospital for independent review and diagnosis. CIN2 or worse (
CIN2) diagnosis based on the clinical center pathology or a
CIN3 diagnosis based on the QC Pathology review triggered treatment by Loop Electrosurgical Excision Procedure. In addition, women with persistent LSIL or carcinogenic HPV-positive ASCUS at the time of the exit from the study were offered Loop Electrosurgical Excision Procedure.
Statistical Analysis
Detection of carcinogenic HPV by LA and hc2 was compared by calculating
values, percent total agreement, and percent positive agreement (that is, agreement among paired tests in which at least one was positive). Differences in detection were tested for statistical significance (P < 0.05) using an exact McNemar's
2 (two categories). Results of paired tests were also compared following stratification on enrollment ThinPrep cytology results (negative versus ASCUS or more severe; alternatively, negative, ASCUS, LSIL, and HSIL, including atypical squamous cells, cannot rule out HSIL; because of the variability of cytologic interpretation (33), the enrollment ThinPrep cytology results differed from the referral cytology). LA results were also stratified on hc2 status (negative, positive) and hc2-derived log units of the HPV semiquantitative viral load (1.00-9.99, 10.00-99.99, 99.99-999.99, and
1,000 RLU/CO).
Sensitivity, specificity, positive predictive value (PPV), NPV, and Youden's index (YI) were calculated for histologically confirmed
CIN3 as diagnosed by QC Pathology at enrollment restricted to the IC arm in which all women were referred to colposcopy (and therefore there was no bias in referral) and over the 2-year duration of ALTS in all arms combined because the 2-year cumulative risk
CIN3 did not differ significantly by study arm, only in the timing of diagnosis. In secondary analyses, the clinical performance was also calculated for histologically confirmed
CIN2 as diagnosed by the clinical center pathologist at enrollment (restricted to the IC arm) and over the 2-year duration of ALTS, restricted to IC and HPV arms of the trial because of the evidence of regression of CIN2 in the CM arm of the trial (21, 22). Differences in test sensitivity and specificity for
CIN3 and
CIN2 were tested for statistical significance using an exact McNemar's
2. Differences in PPV and NPV were tested for statistical significance using a method developed by Leisenring et al. (34). Differences in YI were tested for statistical significance as described previously (3). Finally, the 2-year cumulative absolute risks of histologically confirmed
CIN3 as diagnosed by QC Pathology were calculated for testing positive or negative at enrollment for carcinogenic HPV as detected by LA or hc2. These risks were also calculated for LA-defined subgroups of HPV genotypes and for log-unit categories of semiquantitative viral load as measured by hc2.
| Results |
|---|
|
|
|---|
of 0.68 (Table 1
). Both tests were more likely to test positive for carcinogenic HPV among women with an enrollment cytology of ASCUS or worse (72% for LA versus 74% for hc2; P = 0.003) than women with negative cytology (38% for LA versus 30% for hc2; P < 0.0001). There was also better agreement between tests among women with an enrollment cytology of ASCUS or worse compared with women with negative cytology. LA was less likely to test positive than hc2 among women with LSIL (P < 0.0001) or HSIL cytology (P = 0.03). Among hc2-positive women, the proportion of LA tests positive for carcinogenic HPV increased with increasing semiquantitative viral load categorized in log units (Ptrend < 0.0001).
|
CIN3 (n = 55) in the IC arm (Table 2
). Using YI (sensitivity + specificity - 100%) as a measure of accuracy, LA appeared very slightly less accurate than hc2 (35.6% versus 38.7%), but the difference was not significant (P = 0.4). LA had a slightly lower PPV than hc2 (8.1% versus 8.5%; P = 0.0009), which was statistically but perhaps not clinically significant. The NPV for both assays were similar (98.77% for LA versus 99.00% for hc2). Similar estimates for clinical performance variables for both assays and similar differences between assays were observed when diagnoses of
CIN2 by the clinical center pathologists restricted to IC arm were used as the endpoint.
|
CIN3 (in all arms; Table 3
), thereby correcting for the differences in sensitivity by study arm and initial clinical management (35). LA and hc2 had similar sensitivities (93.3% versus 92.6%, respectively; P = 1) and LA was marginally less specific (48.1% versus 50.6%, respectively; P = 0.05). The YI for LA (42.2%) was similar to the YI for hc2 (43.2%; P = 0.4). The PPV for LA was lower than for hc2 (14.6% versus 15.1%, respectively; P < 0.0001) and there was no statistically significant difference in NPV between LA and hc2 (98.70% versus 98.64%, respectively; P = 0.4). LA was less sensitive (87.8% versus 91.0%; P = 0.09) and less specific (50.4% versus 53.1%; P = 0.007) than hc2 for clinical center pathology-diagnosed
CIN2. The YI was lower for LA (38.2%) than for hc2 (44.1%; P = 0.003) for 2-year cumulative clinical center pathology diagnosed
CIN2.
|
CIN3 diagnosed by QC Pathology for women with and without carcinogenic HPV for each test is shown in Table 4
. The risk of
CIN3 was <1.5% for women who tested negative for carcinogenic HPV and
15% for women who tested positive by either test. Women who tested positive for HPV16 by LA (n = 563) were at a higher 2-year cumulative risk (28.6%) of
CIN3 than women with HPV18 (9.5%) or other carcinogenic HPV genotypes (8.2%). Women positive for any
9 genotype, excluding HPV16 (n = 729; HPV 31, 33, 35, 52, 58, and 67), were at an 11.4% 2-year cumulative risk of
CIN3; women positive for any
7 genotype, excluding HPV18 (n = 732; HPV 39, 45, 59, 68, and 70), were at a 12.4% 2-year cumulative risk of
CIN3 (data not shown).
|
CIN3 using hc2-measured semiquantitative HPV viral load. Women with higher semiquantitative viral loads (
10 RLU/CO) were at
2-fold higher 2-year cumulative risk for
CIN3 than women with the lowest viral load (1-9.99 RLU/CO; 7.6%), but there was no trend with increasing viral load (17.4% for 10-99.99 RLU/CO, 18.2% for 100-999.99 RLU/CO, and 15.4% for
1,000 RLU/CO). | Discussion |
|---|
|
|
|---|
CIN3. Each assay offers different advantages over the other. hc2 showed slightly greater clinical specificity and therefore marginally better PPV than LA. Conversely, LA offers the advantage of HPV genotyping for identifying women at the greater risk of
CIN3 among carcinogenic HPV-positive women. These high-risk groups include women with HPV16 infection as shown here and in previous reports (18, 36-39). Additionally, LA may confer an advantage of potentially identifying those women with genotype-specific persistent carcinogenic HPV infections that are at the greatest risk of having or getting cervical precancer or cancer (40-42).
When we used 2-year cumulative, clinical center pathology diagnoses of
CIN2 as our endpoint, the differences between hc2 and LA were more pronounced, with hc2 showing marginally greater sensitivity than LA due to the detection of CIN2 caused by noncarcinogenic HPV genotypes. Eleven of the 22 CIN2 diagnoses that tested hc2 positive and LA negative for carcinogenic HPV were positive for noncarcinogenic HPV genotypes as detected by LA, and 10 of 11 were confirmed as having noncarcinogenic HPV genotypes (and no carcinogenic HPV genotypes) by Line Blot Assay, the prototype assay for LA (refs. 29, 17; data not shown). This is consistent with previous reports that hc2 cross-reacts with some noncarcinogenic HPV genotypes (25, 26), and as shown here, these genotypes occasionally cause CIN2. In addition, some of these untargeted HPV genotypes, such as HPV 73 and 82, are possibly weekly carcinogenic (43). Although CIN2 is the threshold diagnosis for treatment, CIN2 is equivocal precancer (44), representing a mix of HPV infections of carcinogenic and noncarcinogenic HPV that cause histopathologic changes, such as CIN1, most likely to regress, and CIN3, which is precancerous and may invade if left undetected and untreated. It is also a poorly reproducible diagnosis (33) partly as a consequence of its ambiguous nature and because of the technical difficulties in mounting biopsies. It is therefore important when interpreting clinical performance for detection of
CIN2 to account for clinically irrelevant diagnoses of CIN2. For these reasons, we emphasized
CIN3 as our primary and more rigorous endpoint.
We have shown previously that LA was more analytically sensitive for any carcinogenic HPV and HPV risk groups compared with its prototype assay, Line Blot Assay (45). This is the likely explanation of why LA was more likely to test positive and was less clinically specific than hc2, the converse of what we observed in our comparison of Line Blot Assay with hc2 (17). LA was more likely to test positive among women with normal cytology, which led to greater overall likelihood of testing positive compared with hc2. Conversely, hc2 was more likely than LA to test positive among women with LSIL and HSIL cytology. It was observed previously that hc2 was more likely than another PCR assay, SPF10LiPA25, to test positive among women with LSIL cytology, which is indicative of a productive HPV infection producing higher viral loads compared with normal cytology. We suggest that viral load of the cervical specimen may have a greater influence on hc2 test performance than on PCR-based assay performance.
One additional advantage of LA has over hc2 is the internal β-globin control to verify the adequacy of the specimen. Although specimen adequacy is probably an uncommon occurrence, given the performance of hc2 (1.7) the perception is that lack of internal control is a concern (46). It is also noteworthy that LA uses a smaller fraction of the specimen than hc2 so that its use as a co-test with liquid cytology specimens is also less apt to have a missing test result due to insufficient specimen volume.
One limitation of our analysis was LA and hc2 were conducted on different specimens and in different manners. LA was conducted on STM specimens, a specimen genotype for which it has not been optimized, a median of 104 months after collection, whereas hc2 was conducted on PreservCyt specimens in real time after cytology slides were made. We did not conduct the LA testing on the archived PreservCyt specimens, which had been stored at ambient temperature since 1997 to 1998, because we found LA that performed less sensitively on the PreservCyt specimens than the STM specimens in a pilot study (data not shown). Yet, the performance of LA was very similar to hc2, indicating that LA may be a robust assay as performed in an expert laboratory.
Although we found similar clinical performance between the two assays, we point out that clinical performance is only one of several important considerations for introducing a molecular test into clinical practice. Other criteria include reproducibility and capacity for high throughput. hc2 testing has been shown to be reproducible (9, 10, 47, 48) and using the automation provided by Rapid Capture System (Digene; http://www.digene.com/labs/labs_rapid_01.html) can achieve high-volume throughput. LA has shown neither reproducibility nor high-volume capacity, both of which will be needed before LA can be widely used in cervical cancer screening programs.
LA has been approved for use in Europe and is currently in clinical trials, and it will be important to verify its clinical performance and establish reproducibility as criteria for clinical use. We compared LA with hc2, which has repeatedly showed both good clinical performance (1, 4, 7, 49) and reliability (9, 10, 47, 48), and found the two tests comparable. If and when it is approved by the Food and Drug Administration and has high throughput capacity, LA may be another valuable screening tool for the secondary prevention of cervical cancer.
| Disclosure of Potential Conflicts of Interest |
|---|
|
|
|---|
| Acknowledgments |
|---|
We thank the ALTS Group Investigators for help in planning and conducting the trial, Information Management Services (Rockville, MD) for data management and programming support, and Meera Sangaramoorthy, Manu Sharma, and Kennita Riddick for the Roche LA testing. This research was supported [in part] by the Intramural Research Program of the NIH, National Cancer Institute.
| Footnotes |
|---|
Received 12/14/07; revised 2/11/08; accepted 2/13/08.
| References |
|---|
|
|
|---|
This article has been cited by other articles:
![]() |
Q. Feng, S. Cherne, R. L. Winer, A. Balasubramanian, S.-K. Lee, S. E. Hawes, N. B. Kiviat, and L. A. Koutsky Development and Evaluation of a Liquid Bead Microarray Assay for Genotyping Genital Human Papillomaviruses J. Clin. Microbiol., March 1, 2009; 47(3): 547 - 553. [Abstract] [Full Text] [PDF] |
||||
![]() |
P. E. Castle, C. Porras, W. G. Quint, A. C. Rodriguez, M. Schiffman, P. E. Gravitt, P. Gonzalez, H. A. Katki, S. Silva, E. Freer, et al. Comparison of Two PCR-Based Human Papillomavirus Genotyping Methods J. Clin. Microbiol., October 1, 2008; 46(10): 3437 - 3445. [Abstract] [Full Text] [PDF] |
||||
| ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
| HOME | HELP | FEEDBACK | SUBSCRIPTIONS | ARCHIVE | SEARCH | TABLE OF CONTENTS |
| Cancer Research | Clinical Cancer Research |
| Cancer Epidemiology Biomarkers & Prevention | Molecular Cancer Therapeutics |
| Molecular Cancer Research | Cancer Prevention Research |
| Cancer Prevention Journals Portal | Cancer Reviews Online |
| Annual Meeting Education Book | Meeting Abstracts Online |