
| HOME | HELP | FEEDBACK | SUBSCRIPTIONS | ARCHIVE | SEARCH | TABLE OF CONTENTS |
Laboratory for Molecular Epidemiology, Department of Epidemiology and Biostatistics, University of California San Francisco, San Francisco, California 94143-0560 [J. K. W., S. Z., C. G., M. R. W., R. M.]; Institut Salut Publica de Catalunya, Pavello Central, Campus de Bellvitge, Universitat de Barcelona, Ciutat Sanitaria de Bellvitge, Feixa Llarga s/n, 08907 Hospitalet de Llobregat, Barcelona, Spain [A. L.]; Department of Surgery, Hospital St. Pablo, Barcelona, Spain [M. J. L., M. T.]; and Department of Clinical Biochemistry, Hospital Clinic i Provincial, University of Barcelona, Spain [A. B.]
| Abstract |
|---|
|
|
|---|
| Introduction |
|---|
|
|
|---|
Creating an etiological model of CRC that integrates these epidemiological features of the disease with the manifold molecular and genetic aspects of CRC that have recently been discovered is a formidable challenge. The well-described model of colorectal carcinogenesis envisions a stepwise accumulation of early and late genetic alterations in the progression of adenoma to carcinoma (19) . Epidemiological clues to the etiology of CRC have been sought by studying the mutational patterns within these loci (e.g., the p53 gene; Ref. 20 ). Identification of mutations within the familial APC (21) and within HNPCC genes (22) has helped to explain the inherited forms of CRC. Interestingly, loci involved in the heritable forms of CRC may also be altered somatically in sporadic CRC (23) , providing a mechanistic bridge between familial and sporadic CRC.
In addition to mutational changes, epigenetic mechanisms play a prominent role in CRC. Aberrant DNA methylation has long been noted in colorectal carcinogenesis; imbalances in methylation are thought to occur early in the process and are characterized by genome-wide hypomethylation and regional and locus-specific hypermethylation (24) . Among the common targets for aberrant DNA methylation is the 5' region of the p16INK4a tumor suppressor gene (25 , 26) . The p16INK4a protein plays an important role in the passage of cells through the G1 phase of the cell cycle by binding to cyclin-dependent kinases and inhibiting their interaction with cyclin D1 and reducing phosphorylation of the retinoblastoma protein (pRB; Ref. 27 ). Methylation of cytosine residues at CpG sites in p16INK4a is common in CRC cell lines and is associated with transcriptional silencing of the gene (28 , 29) . Epigenetic alterations that suppress gene expression are potentially reversible, offer unique opportunities for the development of new therapies, and could also be the focus of preventive strategies.
In the present study, we measured the occurrence of p16INK4a methylation in primary CRCs using a recently developed MSPCR method and explored the relationship of methylation to demographic and clinicopathological characteristics of the patients. Because of the known epidemiological correlates of gender and anatomical location, we stratified our population by gender and location to test whether p16INK4a methylation is involved in a unique pathway for CRC development.
| Materials and Methods |
|---|
|
|
|---|
35 years of age and <90 years were invited to participate in the study. Eighteen subjects refused to participate, leaving a total of 249 enrolled subjects (132 men and 117 women). A consecutive case-series subset of 120 patients within one surgical service also provided tissue specimens (uninvolved colon and tumor) for the current molecular study. Patients provided signed informed consent; all procedures were approved by the Hospital Clinics institutional review board (Comite Etico de Investigacion Clinica). Primary tumors were surgically dissected and immediately frozen at -80°C. A questionnaire was administered to each patient by an interviewer; the questionnaire elicited demographic information and data on occupation, diet, and personal medical history. Clinicopathological data were collected and merged with patient questionnaires. A modified version of the Dukes staging system was used. Surgical records identified eight subsites: (a) cecum; (b) ascending colon; (c) transverse colon; (d) descending colon; (e) sigmoid colon; (f) rectosigmoid junction; (g) rectum; and (h) anal canal. Proximal tumors were defined as including the right side of the colon and descending colon up to the sigmoid colon. Additional analyses were carried out that included the transverse and descending colon tumors with the distal category of CRCs.
DNA was isolated from tumor specimens using standard methods involving RNase, proteinase K, chloroform/isoamyl alcohol extraction, and ethanol precipitation. DNA was quantitated by Hoescht 33258 fluorometry (Hoeffer Scientific).
MSPCR.
Detection of methylated CpG sites within the 5' region of the p16INK4a gene was carried out using MSPCR (30
, 31)
. Briefly, 1.0 µg of purified DNA was diluted in 36 µl of H20 to which 4 µl of 3.0 M NaOH were added, and DNA was denatured at 37°C for 15 min. The sample was then treated with 416 µl of 3.6 M sodium bisulfite solution (pH 5.0) and 24 µl of 10 mM hydroquinone. Both bisulfite and hydroquinone solutions were prepared fresh for each analysis. Samples were incubated at 55°C for 16 h; 100 µl of mineral oil were layered on top of the solution to prevent evaporation. After incubation, the solution was cooled to -80°C for 10 min, after which the unfrozen mineral oil was removed without disturbing the bisulfite-DNA solution.
Bisulfite-modified DNA was purified with the Wizard DNA Clean-UP System and Vacuum Manifold (Promega), according to the manufacturers instructions. DNA was eluted twice with a total volume of 100 µl of 10 mM Tris-1 mM EDTA buffer (pH 7.8). The final step of the cytosine to uracil conversion reaction was achieved with alkali treatment (NaOH, final concentration = 0.3 M) at 37°C for 15 min followed by ammonium acetate (pH 7.0; final concentration, 3.0 M) neutralization and ethanol precipitation. For each set of tumors assayed, two cell line DNA samples were also treated with bisulfite and amplified by MSPCR. Both a methylation-positive CRC cell line (SW-480; American Type Culture Collection) and a methylation-negative cell line (SK-N-SH; American Type Culture Collection) served as controls for the bisulfite conversion, DNA recovery, and PCR reactions.
For each tumor, a multiplex PCR amplification of bisulfite-treated DNA was carried out with primers (Life Technologies, Inc.) specific for methylated (M primer) and nonmethylated (U primer) CpG sites within the p16INK4a promoter region (31) ; (M primer, 5'-TTATTAGAGGGTGGGGCGGATCGC and 5'-GACCCCGAACCGCGACCGTAA), and nonmethylated (U2 primer, 5'-TTATTAGAGGGTGGGGTGGATTGT and 5'-CCACCTAAATCAACCTCCAACCA). The PCR mixture contained GeneAmp PCR buffer (Perkin-Elmer Corp.), MgCl2 (1.5 mM), deoxynucleotide triphosphates (200 µM each), primers (0.4 µM for each primer), modified DNA templates (50 ng), and 2.5 Units of AmpliTaq (Perkin-Elmer Corp.) in a total volume of 50 µl. The PCR reaction was repeated for 35 cycles on a GeneAmp 9600 thermal cycler (Perkin-Elmer Corp.) under the following conditions: preheat at 94°C for 1 min, 94°C for 30 s, 65°C for 10 s, 72°C for 30 s, and a final extension at 72°C for 10 min. Aliquots (15 µl) of PCR products were loaded onto 2.5% agarose gels, stained with ethidium bromide, and visualized under UV light.
To confirm the specificity of the method, PCR product from the positive and negative controls and several CRC tumor specimens were sequenced using purified PCR product and an ABI 377 automated sequencer with dye primer chemistry. To assess the sensitivity of the MSPCR method, methylated and unmethylated cell line DNA samples were mixed in different ratios; a single unambiguous p16INK4a methylated band was detectable when methylated template was present at greater than 1:32 (3%) of the total DNA. All analyses were carried out on coded samples without knowledge of the patients clinical status.
Statistical Analysis.
Data were analyzed using statistical analysis software. Means and SDs were computed for continuous variables. The ORs and 95% confidence intervals were calculated to detect associations of variables with the p16INK4a methylation status of patients tumors. Multivariate analyses (logistic regression) were used to estimate the association of variables that were identified in univariate analyses with p16INK4a methylation. Significance levels of 0.05 were used for hypothesis testing.
Results
Patient Population and Molecular Approach for Detecting p16INK4a Methylation.
Patients in the present study were 120 consecutive incident cases of CRC ascertained through the University of Barcelona surgical services. As shown in Table 1
, equal numbers of male and female patients were included in the series (50% male), with female patients showing an older age at presentation. The proportion of male cases from the larger hospital series (i.e., 53%) was somewhat, although not significantly, greater than the p16INK4a series. Population data from the Tarragona cancer registry, which is the closest regional registry to Barcelona, also indicate a greater proportion of male CRC; 57% of all incident CRCs in this region were male (19821995). The somewhat lower male:female ratio of CRC in our study may be due to the fact that men are less likely to undergo surgery; resection rates for rectal cancer, which is more common in men, are lower than for proximal CRC disease.
|
The multiplex MSPCR method was found to be highly specific and sensitive in the detection of methylated p16INK4a. DNA sequencing (data not shown) indicates that for methylated cell line DNA, all CpG sites within the amplified fragment were resistant to bisulfite conversion, whereas all cytosines at non-CpG sites were converted to thymidine residues. Only methylated PCR product was detected in the SW-480 cell line. Conversely, in the unmethylated cell line, all cytosines were converted to thymidine. Only unmethylated PCR product was detected in the SK-N-SH cell line. The MSPCR method, using 35 rounds of amplification, was capable of detecting 3% methylated template within a background of unmethylated DNA. Other studies (33) have validated the MSPCR approach by showing that it yields results that are fully concordant with other assays of p16INK4a methylation (e.g., restriction digest and Southern blot). Overall, 22 tumors were found to contain methylated p16INK4a. An unmethylated PCR product was detected in all tumors.
Clinicopathological Correlations with p16INK4a Methylation.
We used univariate analyses to explore correlations of clinical factors with p16INK4a methylation. Variables that had been previously identified as risk factors for anatomical and gender subtypes of CRC or that have prognostic importance were examined. Table 2
shows the strong association of several of these factors with methylated p16INK4a. These factors were proximal location, advanced age, female gender, and poor histological differentiation. Stage was not associated with p16INK4a methylation status. To determine which of these factors was independently associated with p16INK4a methylation, a logistic regression analysis was carried out with the variables identified in the univariate comparisons. As shown in Table 3
, proximal location, poor differentiation, and female gender remain statistically significant when included in this model; however, age was not a significant predictor. Fig. 1
shows that women were much more likely than men to have methylated tumors and that proximal tumors were more likely to contain methylated p16INK4a. In Fig. 2
, the p16INK4a methylation data are stratified according to the anatomical subsite of the CRCs. Although methylated tumors were dominant in cecal tumors and were common in cancers occurring in the ascending, transverse, and descending segments of the colon, methylation was very uncommon in tumors arising in the sigmoid, rectosigmoid colon, and rectum. Only 4 of 77 distal cancers had detectable p16INK4a methylation (Table 2)
. The association of methylation with proximal location remained highly significant in the logistic regression when distal cases were defined as those occurring beyond the hepatic flexure (location, OR = 10.7; P < 0.002; female gender, OR = 6.5; P = 0.01).
|
|
|
|
Taken together, the current results and previous epidemiological, clinical, and molecular evidence strongly indicate that distinct anatomical and gender-related subtypes of sporadic CRC exist (5 , 34 , 35) . It is of interest to compare our results on p16INK4a methylation with other molecular features of these subtypes; we note both overlap and divergence among the different genetic pathways. As shown here, an epigenetic pathway involving p16INK4a methylation dominates in proximal CRC in older women. The observation that microsatellite instability in sporadic CRC is far more common in the proximal versus distal colon and also shows a gender and age bias toward older women is similar to our observations (36) . Furthermore, high-grade microsatellite instability, which was recently observed in 16% of a large series of CRCs, is strongly associated with a loss of hMLH1 expression (36 , 37) . Although mutations in the hMLH1 gene are the most commonly known genetic change in HNPCC, they are not frequent (<25%) in sporadic CRC with microsatellite instability. Hence, methylation silencing is now thought to be the dominant mechanism for affecting hMLH1 in sporadic CRC (37, 38, 39, 40) and has an anatomical distribution similar to p16IN4a methylation. The consequence of deficient DNA mismatch repair, whether caused by mutation or transcriptional silencing, is thought to be the accumulation of mutations in critical genes containing simple repetitive sequences within their coding regions (e.g., transforming growth factor ß receptor type II and insulin-like growth factor receptor type II). Although a large series of CRC patients has not yet been studied, preliminary evidence indicates that most type II transforming growth factor ß and insulin-like growth factor receptor mutations occur in proximal colon tumors containing microsatellite instability (41, 42, 43) .
Another distinct subtype of CRC involves mutations in the p53 gene that occur dominantly in the distal colon and rectum (44) . A gender bias in mutant p53 has not been documented, but distal and particularly rectal CRC are well known to favor male gender. Mutations in codons 12 and 13 of the K-ras gene are also a common feature of CRC that may define yet another pathway in CRC genesis; the influences of anatomical location and gender in this pathway are not entirely clear. Although a meta-analysis of 2721 CRCs did not reveal an association of K-ras mutation with tumor location or gender (45) , other studies have reported a higher incidence of K-ras mutation in proximal cancers (46) and in proximal disease in younger women (<40 years) and older men (>90 years; Refs. 44 and 47 ).
Perhaps the most common alterations in CRC are those affecting the APC and DCC genes; these occur with high frequency (e.g., 70%) and have not been noted to occur preferentially in any anatomical location or gender group (48) . Thus, these alterations may also overlap several mechanisms of colon carcinogenesis. Interrelationships between methylation-driven mechanisms and those involving APC may be anticipated; however, based on observations in transgenic mice, tumorigenesis related to the APC gene is modified significantly by DNA methylation (49) . In addition, the APC gene promoter itself is a target of hypermethylation (50) .
The present results raise once again the intriguing and unresolved question of how female gender influences a specific pathway for CRC development. One of the earliest hypotheses addressing the role of anatomical subsite and gender in CRC postulated an influence of estrogen on bile acid secretion (17 , 18) . According to this hypothesis, estrogen, through its effect on serum cholesterol levels, affects the concentrations of secondary bile acids (e.g., deoxycholate), which have toxic, trophic, and promoting effects on the colonic epithelium. Diets high in animal fat and low in vegetables and fiber also increase bile secretion. A recent case-control study found that lower intake of vegetables and dietary fiber is a risk factor for proximal cancer specifically in older women and men (51) . In contrast, only limited evidence has been found to support a role for dietary factors thought to affect methylation (e.g., folate, B12, alcohol, and methinone intake; Ref. 52 ). There are clinical observations, however, that add to the biological plausibility of an etiological pathway operating within the proximal colon in women that involves aberrant DNA repair. For example, it has been noted that in HNPCC families, young women have about half the risk of men of developing CRC (53) . Our results indicate that the MSPCR method provides a powerful marker that future molecular epidemiological investigations can use to test specific hypotheses about estrogen, reproductive factors, diet, and CRC risk.
The unique anatomical distribution and gender bias found for p16INK4a methylation in our study indicate a distinct molecular pathway in CRC and provide important clues to the etiology of this subtype of sporadic CRC. Our a priori hypothesis concerning the point of anatomical division of proximal versus distal CRC (i.e., between the descending and sigmoid colon) was based on a large (38,931 cases) descriptive study of CRC that found this specific anatomical division to be correlated with secular increases in CRC risk within gender and ethnic subgroups (54) . We are aware, however, that several definitions of right- versus left-sided CRC have been proposed by different investigators. Among the considerations is the fact that the proximal and distal segments of the large intestine have different embryological origins (midgut versus hindgut, respectively) and vascular supplies (superior versus inferior mesenteric arteries). Interestingly, our data indicate an increased prevalence of p16INK4a methylation in CRCs up to the sigmoid colon and hence may provide a molecular correlate to the observed epidemiological differential in risk by gender. When we analyzed our data by redefining proximal CRC at the hepatic or splenic flexures, the location and gender associations with methylation remained highly significant. In addition, the anatomical distribution of CRC, and perhaps the associated methylation abnormalities, may be influenced by the source population of CRC. Spain has historically been a relatively low CRC risk country compared with other European countries or the United States. In recent decades, however, CRC incidence and mortality have increased markedly in Spain and have been accompanied by changes in dietary habits (55) .
In addition to being of significance in understanding the etiology of CRC, our results also have implications for the clinical management of CRC. The association of p16INK4a methylation with poorly differentiated tumors may indicate a more aggressive form of the disease. Also, it has been noted that as life expectancy increases in Westernized countries and the location of CRC is shifted toward more proximal cancers in older individuals, an increasing number of CRCs may not be detected with current screening practices (56) . Furthermore, these problems may be exaggerated in certain minority populations (6 , 7) . Future studies of the pathobiology of methylation silencing in colon carcinogenesis could help elucidate new screening and diagnostic approaches to target populations at high risk for anatomical and gender-specific subtypes of CRC. Finally, the aberrations of DNA methylation that are so common in some forms of CRC are potentially reversible alterations; hence, drug development targeting methylation could specifically aid in the treatment of populations now identified by anatomical location, gender, and ethnic characteristics (57) .
| Footnotes |
|---|
1 Supported by the Foundation Marato (A. L., M. J. L.) and the National Institutes of Environmental Health Sciences NIH Grant P42-ESO4705 with funds provided by the Environmental Protection Agency (J. K. W., S. Z., C. G.). ![]()
2 To whom requests for reprints should be addressed, at Laboratory for Molecular Epidemiology, Department of Epidemiology and Biostatistics, University of California San Francisco, 500 Parnassus Avenue, MU-W 420, San Francisco, CA 94143-0560. ![]()
3 The abbreviations used are: CRC, colorectal cancer; MSPCR, methylation-specific PCR; APC, adenomatous polyposis coli; HNPCC, hereditary nonpolyposis colorectal cancer; OR, odds ratio. ![]()
Received 12/ 4/98; revised 3/15/99; accepted 4/ 7/99.
| References |
|---|
|
|
|---|
This article has been cited by other articles:
![]() |
M. K. Keyes, H. Jang, J. B. Mason, Z. Liu, J. W. Crott, D. E. Smith, S. Friso, and S.-W. Choi Older Age and Dietary Folate Are Determinants of Genomic and p16-Specific DNA Methylation in Mouse Colon J. Nutr., July 1, 2007; 137(7): 1713 - 1717. [Abstract] [Full Text] [PDF] |
||||
![]() |
K. Woodson, D. J. Weisenberger, M. Campan, P. W. Laird, J. Tangrea, L. L. Johnson, A. Schatzkin, and E. Lanza Gene-Specific Methylation and Subsequent Risk of Colorectal Adenomas among Participants of the Polyp Prevention Trial Cancer Epidemiol. Biomarkers Prev., May 1, 2005; 14(5): 1219 - 1223. [Abstract] [Full Text] [PDF] |
||||
![]() |
X. Li, A.-M. Hui, L. Sun, K. Hasegawa, G. Torzilli, M. Minagawa, T. Takayama, and M. Makuuchi p16INK4A Hypermethylation Is Associated with Hepatitis Virus Infection, Age, and Gender in Hepatocellular Carcinoma Clin. Cancer Res., November 15, 2004; 10(22): 7484 - 7489. [Abstract] [Full Text] [PDF] |
||||
![]() |
S. Kamoshida, H. Matsuoka, T. Ishikawa, K. Maeda, R. Shimomura, K.-i. Inada, and Y. Tsutsumi Immunohistochemical Evaluation of Thymidylate Synthase (TS) and p16INK4a in Advanced Colorectal Cancer: Implication of TS Expression in 5-FU-based Adjuvant Chemotherapy Jpn. J. Clin. Oncol., October 1, 2004; 34(10): 594 - 601. [Abstract] [Full Text] [PDF] |
||||
![]() |
K. Nakao, K. R. Mehta, J. Fridlyand, D. H. Moore, A. N. Jain, A. Lafuente, J. W. Wiencke, J. P. Terdiman, and F. M. Waldman High-resolution analysis of DNA copy number alterations in colorectal cancer by array-based comparative genomic hybridization Carcinogenesis, August 1, 2004; 25(8): 1345 - 1357. [Abstract] [Full Text] [PDF] |
||||
![]() |
X. Wu, V. W. Chen, J. Martin, S. Roffers, F. D. Groves, C. N. Correa, E. Hamilton-Byrd, and A. Jemal Subsite-Specific Colorectal Cancer Incidence Rates and Stage Distributions among Asians and Pacific Islanders in the United States, 1995 to 1999 Cancer Epidemiol. Biomarkers Prev., July 1, 2004; 13(7): 1215 - 1222. [Abstract] [Full Text] [PDF] |
||||
![]() |
S. Zheng, X. Ma, L. Zhang, L. Gunn, M. T. Smith, J. L. Wiemels, K. Leung, P. A. Buffler, and J. K. Wiencke Hypermethylation of the 5' CpG Island of the FHIT Gene Is Associated with Hyperdiploid and Translocation-Negative Subtypes of Pediatric Leukemia Cancer Res., March 15, 2004; 64(6): 2000 - 2006. [Abstract] [Full Text] [PDF] |
||||
![]() |
K. Kawakami and G. Watanabe Identification and Functional Analysis of Single Nucleotide Polymorphism in the Tandem Repeat Sequence of Thymidylate Synthase Gene Cancer Res., September 15, 2003; 63(18): 6004 - 6007. [Abstract] [Full Text] [PDF] |
||||
![]() |
M. van Rijnsoever, H. Elsaleh, D. Joseph, K. McCaul, and B. Iacopetta CpG Island Methylator Phenotype Is an Independent Predictor of Survival Benefit from 5-Fluorouracil in Stage III Colorectal Cancer Clin. Cancer Res., August 1, 2003; 9(8): 2898 - 2903. [Abstract] [Full Text] [PDF] |
||||
![]() |
M van Rijnsoever, F Grieu, H Elsaleh, D Joseph, and B Iacopetta Characterisation of colorectal cancers showing hypermethylation at multiple CpG islands Gut, December 1, 2002; 51(6): 797 - 802. [Abstract] [Full Text] [PDF] |
||||
![]() |
B Shannon, S Gnanasampanthan, J Beilby, and B Iacopetta A polymorphism in the methylenetetrahydrofolate reductase gene predisposes to colorectal cancers with microsatellite instability Gut, April 1, 2002; 50(4): 520 - 524. [Abstract] [Full Text] [PDF] |
||||
![]() |
K. Woodson, E. Lanza, J. A. Tangrea, P. S. Albert, M. Slattery, J. Pinsky, B. Caan, E. Paskett, F. Iber, J. W. Kikendall, et al. Hormone Replacement Therapy and Colorectal Adenoma Recurrence Among Women in the Polyp Prevention Trial J Natl Cancer Inst, December 5, 2001; 93(23): 1799 - 1805. [Abstract] [Full Text] [PDF] |
||||
![]() |
Z. Xiong, A. H. Wu, C. M. Bender, J.-L. Tsao, C. Blake, D. Shibata, P. A. Jones, M. C. Yu, R. K. Ross, and P. W. Laird Mismatch Repair Deficiency and CpG Island Hypermethylation in Sporadic Colon Adenocarcinomas Cancer Epidemiol. Biomarkers Prev., July 1, 2001; 10(7): 799 - 803. [Abstract] [Full Text] [PDF] |
||||
![]() |
H. Elsaleh, B. Powell, K. McCaul, F. Grieu, R. Grant, D. Joseph, and B. Iacopetta P53 Alteration and Microsatellite Instability Have Predictive Value for Survival Benefit from Chemotherapy in Stage III Colorectal Carcinoma Clin. Cancer Res., May 1, 2001; 7(5): 1343 - 1349. [Abstract] [Full Text] |
||||
![]() |
M. Esteller, S. Gonzalez, R. A. Risques, E. Marcuello, R. Mangues, J. R. Germa, J. G. Herman, G. Capella, and M. A. Peinado K-ras and p16 Aberrations Confer Poor Prognosis in Human Colorectal Cancer J. Clin. Oncol., January 15, 2001; 19(2): 299 - 304. [Abstract] [Full Text] [PDF] |
||||
![]() |
S. Zheng, P. Chen, A. McMillan, A. Lafuente, M. J. Lafuente, A. Ballesta, M. Trias, and J. K. Wiencke Correlations of partial and extensive methylation at the p14ARF locus with reduced mRNA expression in colorectal cancer cell lines and clinicopathological features in primary tumors Carcinogenesis, November 1, 2000; 21(11): 2057 - 2064. [Abstract] [Full Text] [PDF] |
||||
![]() |
T. Ueki, M. Toyota, T. Sohn, C. J. Yeo, J.-P. J. Issa, R. H. Hruban, and M. Goggins Hypermethylation of Multiple Genes in Pancreatic Adenocarcinoma Cancer Res., April 1, 2000; 60(7): 1835 - 1839. [Abstract] [Full Text] |
||||
| ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||