
| HOME | HELP | FEEDBACK | SUBSCRIPTIONS | ARCHIVE | SEARCH | TABLE OF CONTENTS |
1 Menzies Research Institute, University of Tasmania, Hobart, Tasmania, Australia and 2 Murdoch Childrens Research Institute, Melbourne, Victoria, Australia
Requests for reprints: I.A.F. van der Mei, Menzies Research Institute, University of Tasmania, Private Bag 23, Hobart, Tasmania 7001, Australia. Phone: 61-3-6226-7700; Fax: 61-3-6226-7704. E-mail: Ingrid.vanderMei{at}utas.edu.au
| Abstract |
|---|
|
|
|---|
Methods: A population-based case-control study was conducted in Tasmania on 136 cases with multiple sclerosis and 272 age- and sex-matched community controls. Repeat interviews on 52 cases and 52 controls were done on average 11 weeks after the initial interview. Sun exposure was assessed by questionnaire and lifetime calendar. Other measurements included serum 25-hydroxyvitamin D, actinic damage, and skin phenotype.
Results: There was an association between recent sun exposure and serum vitamin D (time in the sun: r = 0.22, P < 0.01; activities outside: r = 0.31, P < 0.01 for controls) and between lifetime sun exposure and actinic damage [correlation between 0.34 (P < 0.01) and 0.17 (P = 0.01) for controls]. The test-retest weighted
statistic of self-reported sun exposure ranged from 0.43 to 0.74. Recall of childhood/adolescent sun exposure by standardized questioning was no less reproducible than recall of recent adult sun exposure and no less reliable when made with the calendar method. Comparing the questionnaire and calendar method, the measures of childhood/adolescent sun exposure had a similar predictive validity for multiple sclerosis.
Conclusions: The results of this study provide further evidence that adults are able to recall past sun exposure with shown validity and reliability and present information about the possible reasons for the good reliability of recalled sun exposure measures. (Cancer Epidemiol Biomarkers Prev 2006;15(8):153844)
| Introduction |
|---|
|
|
|---|
Measurement of childhood sun exposure by questionnaire requires recall of past events possibly several decades earlier, with potential for measurement error. Studies that have investigated and compared the quantum, type, and determinants of this error in different instruments and approaches provide important information relevant to controlling and reducing it. Unfortunately, there have been few such studies to date and no study has assessed the validity of past sun exposure against both short-term (such as vitamin D status) and long-term (such as actinic damage) biomarkers for criterion validity. Vitamin D status can be assessed by serum 25-hydroxyvitamin D [25(OH)D]. It provides a measure of recent sun exposure because it has a half-life time of 1 to 2 months (6), and nearly all (90-100%) of the vitamin D in the human body is sourced from exposure to sunlight (7). Actinic damage of the skin, assessed from silicon casts of the skin of the hand, has previously been used as a measure of lifetime sun exposure. It has been found to be associated with lifetime sun exposure (8), residence in a high UVR location (9), outdoor occupations and leisure activities (10), solar keratosis (10, 11), and basal and squamous cell cancer (10). To measure sun exposure, we used not only standardized questions in a face-to-face interview but also a personal residential and working history. This history, which we refer to as a lifetime calendar, used memorable events as guideposts to assist recall. This life events approach has shown to be an effective strategy to record exposure histories accurately (12-14). A similar strategy was used to measure sun exposure in several other studies (4, 15-17).
Three validity studies have been conducted in school children (18-20), showing that these children are able to recall recent and current habitual sun exposure. In adolescents, polysulfone badge recordings of UVR exposure on 4 weekend days in late spring correlated well with two questions on habitual sun exposure (correlation 0.35 for time in the sun, 0.29 for activities outside; ref. 18). In 8-year-old (19) and adolescent (20) children, recent sun exposure was associated with levels of serum 25(OH)D. In adults, current sun exposure recorded in a diary has been shown to correlate with personal UVR dosimeters (18, 21), and lifetime sun exposure has been associated with actinic damage (8). Two studies assessed the reproducibility of recall of childhood and adolescent sun exposure by adults (8, 22). Rosso et al. (22) and English et al. (8) conducted retests after 18 to 26 months and 5 years, respectively, and observed a good level of agreement though slightly lower than that observed for lifetime sun exposure.
To broaden the range of findings available on this topic, we investigated in the Tasmanian Multiple Sclerosis case-control study the following: (a) the criterion validity of self-reported past sun exposure by comparing recent adult sun exposure with serum 25(OH)D status and by comparing lifetime sun exposure with actinic damage, (b) the test-retest reproducibility of self-reported sun exposure during childhood and adolescence and compared it with that of recent adult sun exposure, and (c) the agreement between measurements by questionnaire and lifetime calendar of self-reported sun exposure during childhood and adolescence and compared it with that of recent adult sun exposure.
| Materials and Methods |
|---|
|
|
|---|
Reliability refers to the reproducibility of a measure, that is, how consistently a measure can be repeated in the same subjects (23). We examined the intramethod reliability (or test-retest reproducibility) of standardized questions on sun exposure by measuring a subsample of participants at two points in time. We also examined the intermethod reliability of self-reported sun exposure by comparing standardized questions with a lifetime calendar method. For both the intramethod reliability and intermethod reliability, we compared recall of childhood/adolescence sun exposure with recall of recent sun exposure. Lastly, because sun exposure is associated with multiple sclerosis in this sample (1), we compared how well sun exposure in both methods (standard questionnaire and lifetime calendar) could statistically predict multiple sclerosis, noting that causality for this association has not been established (24).
Participants
The total sample consisted of 136 cases and 272 controls of the Tasmanian Multiple Sclerosis case-control study (1). Participants were persons ages <60 years who were residents of Tasmania, Australia and who had at least one grandparent born in Tasmania. Eligible cases had cerebral magnetic resonance imaging abnormalities consistent with multiple sclerosis (25) and clinically definite multiple sclerosis (26). Controls were selected from the comprehensive roll of electors registered in vote in Tasmanian elections. For each case, two control subjects were randomly selected and matched to the index case on sex and birth year. For the 136 cases included in the study, 272 eligible controls participated (participation rate, 76%). The subjects were interviewed between March 1999 and June 2001 by two research assistants: one in the north of the state (telephone district 63 and 64) and one in the south of the state (telephone district 62). Repeat interviews (T2) of 52 cases and 52 controls were conducted on average 11.1 weeks (SD, 2.9 weeks) after the initial interview (T1). The participants in T2 were sourced from the first 55 cases (participation rate, 95%) and 52 controls (participation rate, 100%) in the main study who lived in the south of Tasmania. A different interviewer conducted the T2. The project received ethics approval from the Human Research Ethics Committee of the Royal Hobart Hospital. Written consent was obtained from all participants.
Measurements during T1
Questionnaire. The interviewer-administered questionnaire sought information about the amount of sun exposure during four age spans of life (6-10 years, 11-15 years, 16-20 years, and the last 3 years) separately for summer and winter. Firstly, subjects were asked about their "time in the sun" with the question during weekends and holidays, how much time would you normally have spent in the sun in the following age spans? and the response categories were <1, 1 to 2, 2 to 3, 3 to 4, and
4 hours daily. Secondly, they were asked about their "activities outside" with the question how much did your activities (playing, day sports, spectator sports, gardening, walking, working activities, etc.) take you outside in the following age spans? and the response categories were not that often, a moderate amount, quite a lot, and virtually all the time. Occupational sun exposure was assessed with a question that asked whether their jobs were overall mainly indoors, both indoors and outdoors, or mainly outdoors. The questionnaire also included questions on lifetime sunburns (never, once, 2-5 times, 6-10 times, and >10 times) and sun-sensitive skin phenotype (tendency to burn: never burn, burn after >2-hour sun exposure, burn after 1 to 2 hours, burn after 0.5-1 hour, and burn within 0.5 hour; skin reaction: burn then peel, burn then tan, and tan only; ability to tan: a dark tan, a medium tan, light tan, and practically no tan).
Lifetime Calendar. Before T1, subjects were sent a lifetime calendar and asked to complete it for each year of their life. This required them to provide annual information on place of residence, school attended or type of work, and number of days weekly spent in each. During the interview, subjects answered the "time in the sun" question for summer only for each year of their life from 6 years to their current age using memorable events as guideposts to assist recall. The information already filled out on the calendar was used to identify blocks of years where the "time in the sun" lifestyle was constant or not. In addition, for each year of occupation, they were required to indicate how much time to the closest 15 minutes they would spend outside on a usual working day during working hours. For the comparison with the questionnaire data also taken at T1, an average of the rank score was taken of the annual calendar data for the relevant age spans.
Objective Measures. Serum 25(OH)D levels at interview were measured with a commercially available RIA (DiaSorin, Inc., Stillwater, MN) for 136 cases and 262 controls. Silicon skin surface casts of the hand, measuring actinic damage, were obtained as an objective marker of cumulative lifetime sun exposure (1). The grader was blinded to subject identity. Skin phenotype was assessed with a spectrophotometer at the upper inner arm and buttock, body sites usually not exposed to sunlight. Cutaneous melanin density was estimated from the skin reflectance of light centered at 400 and 420 nm (27).
Measurements during T2
T2 included all questions mentioned in the questionnaire section and the measurement of actinic damage using silicon casts. The lifetime calendar, serum 25(OH)D, and the assessment of melanin density with the spectrophotometer were not repeated.
Data Analysis
Assessment of Criterion Validity. To compare the association between serum 25(OH)D and questionnaire and calendar measures of recent adult exposure (both taken at T1), Pearson correlation coefficients were calculated. The questionnaire measures were "time in the sun" in summer and winter during the last 3 years and "activities outside" in summer and winter during the last 3 years. Because serum 25(OH)D is a marker of recent sun exposure, we also included correlations comparing 25(OH)D with sun exposure in summer for subjects who had their samples taken in summer or autumn (December-May) and with sun exposure in winter for those who had their samples taken in winter or spring (June-November).
Next, using Pearson correlations, we compared actinic damage with cumulative lifetime sun exposure measures obtained from the calendar. The analysis was restricted to 323 subjects with high quality casts, excluding 39 subjects whose casts were difficult to grade and 46 whose casts were unable to be graded. The 85 excluded subjects did not differ from the 323 included subjects in terms of the characteristics reported in Table 1 or the indices of agreement and validity reported for other analyses. Including the data for the 39 subjects whose casts were difficult to grade did not influence the results of this analysis. Lifetime sun exposure during leisure days was calculated by aggregating "time in the sun" in summer during leisure days for each year of life between age 6 years and their current age after the categories of the question were assigned the following scores: <1 hour daily = 0.5 hour, 1 to 2 hours daily = 1.5 hours, 2 to 3 hours daily = 2.5 hours, 3 to 4 hours daily = 3.5 hours, and >4 hours daily = 4.5 hours. Lifetime sun exposure during work days was calculated by aggregating the time daily reportedly spent outside during work hours firstly over work days in the week, then over weeks in the year, and finally over years to date of working life. Total lifetime sun exposure was the aggregate of these.
|
statistic (28) were calculated as measures of agreement (29). To assess systematic underreporting or overreporting, Bowker's test of symmetry (30) was applied to the misclassification matrices (the cross-tabulations of the two measures). To investigate factors associated with agreement, we used log binomial regression to model the probability of agreement (agreement = 1/disagreement = 0) as a function of predictors, such as question type, life span, and season of the year, using the generalized estimating equations algorithm to take account of correlated responses for the same individual. To assess confounding and effect modification by case/control status, age at interview, sex, education level, type of multiple sclerosis, disease duration, or disability level (assessed by expanded disability status scale), we entered linear predictors and interaction terms for these variables. Assessment of Intermethod Reliability. The intermethod comparison of measurements by questionnaire and lifetime calendar (both taken at T1) was conducted on the total sample of 136 cases and 272 controls. To compare the questionnaire data for four times (6-10 years, 11-15 years, 16-20 years, and the last 3 years) with the annual measurements by lifetime calendar, we averaged the category rank scores of the annual calendar data for relevant years and rounded the result. The methods of analysis of test-retest reproducibility were used here also.
Intermethod Comparison of the Predictive Validity of Measures of Sun Exposure. The association between summer sun exposure and multiple sclerosis was assessed using unadjusted age- and sex-matched odds ratios and 95% confidence intervals (95% CI) estimated using conditional logistic regression. Results are presented for the "time in the sun" question, with responses dichotomized at 2 to 3 hours daily, comparing questionnaire and calendar methods.
| Results |
|---|
|
|
|---|
Criterion Validity of Measures of Self-Reported Past Sun Exposure
Association Between Recent Adult Sun Exposure and Serum 25(OH)D. We compared serum 25(OH)D with recent sun exposure indices. The results are shown in Table 2
. Importantly, the correlations were much higher if the measurements of 25(OH)D and sun exposure were aligned correctly by season. The associations between time in the sun in summer in the last 3 years and 25(OH)D were nearly identical for the questionnaire and calendar-based method.
|
|
|
For comparison, we show in Table 5 the test-retest results for self-reports of sun-sensitive skin phenotype. In analyses of responses by individuals, the skin questions overall had better agreement on retest than questions on childhood/adolescent sun exposure (cases, P = 0.03; controls, P = 0.04). This was principally due to high agreement on the "tanning" question (cases, P < 0.01; controls, P < 0.01) and, for controls (P < 0.01), on the "skin reaction" question. Also shown in Table 5 are the test-retest results for the assessments of actinic damage made using standardized laboratory protocols from silicon casts of subjects' hands. The probability of agreement was higher than that of the two sun questions for controls (P < 0.01) and similar for cases (P = 0.85) and nearly as high as the agreement for the question on occupational sun exposure.
|
|
|
Intermethod Comparison of the Predictive Validity of Measures of Sun Exposure. Lastly, we compared the association between multiple sclerosis and sun exposure ("time in the sun" in summer) measured by the questionnaire and the calendar. For the questionnaire, this association was estimated for the four age spans (6-10 years, 11-15 years, 16-20 years, and the last 3 years). For the calendar, this association was estimated at every age from 6 to 20 years, at the current age of subjects, and for each year in the 3 years before their current age (Fig. 1 ). The odds ratios for multiple sclerosis for measurements of sun exposure made using the calendar were similar to those for measurements for the corresponding age span made using the questionnaire in at least three of the four age spans (Fig. 1).
|
| Discussion |
|---|
|
|
|---|
The sample of subjects for the reproducibility study was small (52 cases and 52 controls), which could have reduced the ability of this study to detect differences in reliability between subgroups. However, the repeat sample was similar in structure to the total sample of subjects and, reducing the potential for nonresponse bias, participation rates for both T1 and T2 were high. The use of a different interviewer for the repeat interviewers might have increased the variability and underestimated the true reliability of self-reported sun exposure, but the use of a standardized questionnaire and interview protocol limited the influence of the interviewer. The use of past "time in the sun" measures could have lead to substantial misclassification of the measurement of past sun exposure if participants had resided in locations with varying ambient UVR levels, but a very high proportion of participants lived in Tasmania for most of their lives and their estimated sun exposure would not be confounded by their residential history. We did not conduct a test-retest comparison using the calendar approach, but English et al. (8) found good agreement for this method. This is the only study that was able to assess criterion validity using both actinic damage and serum vitamin D levels.
The instruments used to measure past sun exposure seem to provide valid estimates when used to measure recent adult exposure or lifetime exposure. We found that sun exposure in the last year or 3 years correlated relatively well with vitamin D status, given there was an attenuation of the correlation due to measurement error, because sun exposure in the last year or 3 years was measured rather than sun exposure in the last 1 to 2 months. Lifetime sun exposure measured by calendar also correlated relatively well with actinic damage. It predicted
10% of the variation of actinic damage, a commonly used criterion for quantitative significance (32). Adjustment for age in Table 1 may have resulted in an overadjustment because it was highly correlated with, and integral to, lifetime actinic damage. Therefore, the true association lies somewhere between the unadjusted and adjusted correlation coefficient.
These findings are consistent with those in other studies using samples with varied age groups. Two Tasmanian studies of 8-year-old (19) and adolescent (20) children found that serum 25(OH)D was correlated with usual levels of sun exposure in the season preceding the measurements [r = 0.20, P < 0.01 (19) and r = 0.23, P = 0.01 (20) for exposure during school holidays; r = 0.16, P = 0.02 (19) and r = 0.23, P = 0.01 (20) for exposure during weekends]. Lifetime sun exposure in adults measured by a calendar method was associated with actinic damage in the study by English et al. (8). Sun exposure assessed using a questionnaire in adolescents (18) or a diary method in adults (21) has also been shown to be correlated with short-term UVR exposure measured by polysulfone badges or personal UVR dosimeters.
We found that recall of childhood/adolescent sun exposure by standardized questioning was no less reproducible than recall of recent adult sun exposure. Two other reliability studies, examining agreement of sun exposure, also found that sun exposure in the distant past was recalled with reliability comparable with that of exposure in the recent past (8, 22). On retest after 5 years using a calendar method, English et al. (8) found an intraclass correlation coefficient of 0.55 (0.43-0.65) for sun exposure at ages 8 to 14 years and 0.77 (0.70-0.83) at ages 15 to 19 years. Their reliability coefficients for more recent exposure were 0.74 (0.66-0.80) at ages 25 to 34 years and 0.73 (0.65-0.75) at ages 35 to 39 years. On retest after 18 to 26 months, Rosso et al. (22) found an intraclass correlation coefficient of 0.65 (0.56-0.73) for the number of weighted outdoor hours at the beach in childhood. Their reliability coefficient for lifetime weighted outdoor hours at the beach was 0.79 (0.69-0.88). Thus, there are now three test-retest studies with different times between the interviews, showing the same finding that recall of sun exposure in childhood and adolescence is reproducible.
In this study, a major factor contributing to the high reproducibility of questions on childhood/adolescent sun exposure was the distribution of responses. Agreement on retest for controls was highest on questions on childhood exposure, but this was because a higher proportion of their responses to those questions fell in the highest exposure category, and those who reported the highest level of exposure at T1 tended to report the same category of exposure on the second occasion. The age span of life for which exposure was being recalled did not contribute to test-retest agreement independently of this factor. We suppose that disagreement would have been greater had we provided a wider choice of high exposure categories. In that sense, the relatively high level of agreement we found for childhood exposure was due in part to the structure of the questions. The reproducibility of recall of childhood/adolescent sun exposure was lower than that for some (but not all) questions on skin phenotype (33-36), a factor that does not change by stage of life, season, or weather. The reproducibility of recall of sun exposure was not influenced by factors, such as level of education, age, sex, case-control status, type of multiple sclerosis, disease duration, or disability level. A higher disability was associated with a higher agreement, but again, this seemed to be explained by the distribution of responses because cases with a high disability more often reported an answer in the lowest exposure category.
The life events calendar approach has been used in recent studies (1, 4, 15-17) to obtain information on sun exposure. The calendar approach provides flexibility to focus on exposure during specific periods of life and the information on residential and working history that is necessary to base an assessment of ambient UVR levels. A recent study showed that a shortened version of a calendar, administered via a telephone interview, had construct validity against the "whole-of-life" calendar [intraclass correlation coefficient, 0.65 (0.48-0.78); ref. 37]. Based on analysis of the "whole-of-life" calendar, this shortened version asks about sun exposure at the four most informative ages (10, 20, 30, and 40 years; ref. 37). The interview part of a lifetime calendar is less standardized, with more nonscripted interaction between interviewer and participant, and interviewers need to be trained carefully to limit interviewer administration effects. In this study, no evidence was found of interviewer effects but the measurements by calendar were systematically higher than the measurements by questionnaire, and this difference became increasingly pronounced for more recent exposure. This trend in systematic error coincided with diminished agreement between questionnaire- and calendar-based measurements even after adjustment for the distribution of responses. Although the intermethod agreement decreased for more recent sun exposure, there was no difference in the correlation between sun exposure in the last 3 years and vitamin D status between the questionnaire and calendar-based method. In addition, both methods showed a similar association between sun exposure and multiple sclerosis in three of the four age spans that were examined.
In conclusion, the results of this study provide further evidence that adults are able to recall past sun exposure with shown validity and reliability and present information about the possible reasons for the good reliability of recalled sun exposure measures.
| Acknowledgments |
|---|
| Footnotes |
|---|
The costs of publication of this article were defrayed in part by the payment of page charges. This article must therefore be hereby marked advertisement in accordance with 18 U.S.C. Section 1734 solely to indicate this fact.
Received 12/26/05; revised 5/10/06; accepted 6/ 1/06.
| References |
|---|
|
|
|---|
: nominal scale agreement with provision for scaled disagreement or partial credit. Psychol Bull 1968;70:21320.[CrossRef]This article has been cited by other articles:
![]() |
K. M. Blackmore, M. Lesosky, H. Barnett, J. M. Raboud, R. Vieth, and J. A. Knight Vitamin D From Dietary Intake and Sunlight Exposure and the Risk of Hormone-Receptor-Defined Breast Cancer Am. J. Epidemiol., August 27, 2008; (2008) kwn198v1. [Abstract] [Full Text] [PDF] |
||||
![]() |
T. Dwyer, I. van der Mei, A-L Ponsonby, B. V. Taylor, J. Stankovich, J. D. McKay, R. J. Thomson, A. M. Polanowski, and J. L. Dickinson Melanocortin 1 receptor genotype, past environmental sun exposure, and risk of multiple sclerosis Neurology, August 19, 2008; 71(8): 583 - 589. [Abstract] [Full Text] [PDF] |
||||
![]() |
S.-M. Orton, A. P Morris, B. M Herrera, S. V Ramagopalan, M. R Lincoln, M. J Chao, R. Vieth, A D. Sadovnick, and G. C Ebers Evidence for genetic regulation of vitamin D status in twins with multiple sclerosis Am. J. Clinical Nutrition, August 1, 2008; 88(2): 441 - 447. [Abstract] [Full Text] [PDF] |
||||
![]() |
C. A McCarty Sunlight exposure assessment: can we accurately assess vitamin D exposure from sunlight questionnaires? Am. J. Clinical Nutrition, April 1, 2008; 87(4): 1097S - 1101S. [Abstract] [Full Text] [PDF] |
||||
![]() |
A. E Millen and L. M Bodnar Vitamin D assessment in population-based studies: a review of the issues Am. J. Clinical Nutrition, April 1, 2008; 87(4): 1102S - 1105S. [Abstract] [Full Text] [PDF] |
||||
![]() |
H. Sahota, H. Barnett, M. Lesosky, J. M. Raboud, R. Vieth, and J. A. Knight Association of Vitamin D Related Information from a Telephone Interview with 25-Hydroxyvitamin D Cancer Epidemiol. Biomarkers Prev., January 1, 2008; 17(1): 232 - 238. [Abstract] [Full Text] [PDF] |
||||
![]() |
J. A. Knight, M. Lesosky, H. Barnett, J. M. Raboud, and R. Vieth Vitamin D and Reduced Risk of Breast Cancer: A Population-Based Case-Control Study Cancer Epidemiol. Biomarkers Prev., March 1, 2007; 16(3): 422 - 429. [Abstract] [Full Text] [PDF] |
||||
| ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
| HOME | HELP | FEEDBACK | SUBSCRIPTIONS | ARCHIVE | SEARCH | TABLE OF CONTENTS |
| Cancer Research | Clinical Cancer Research |
| Cancer Epidemiology Biomarkers & Prevention | Molecular Cancer Therapeutics |
| Molecular Cancer Research | Cancer Prevention Research |
| Cancer Prevention Journals Portal | Cancer Reviews Online |
| Annual Meeting Education Book | Meeting Abstracts Online |