Skip to main content
  • AACR Publications
    • Blood Cancer Discovery
    • Cancer Discovery
    • Cancer Epidemiology, Biomarkers & Prevention
    • Cancer Immunology Research
    • Cancer Prevention Research
    • Cancer Research
    • Clinical Cancer Research
    • Molecular Cancer Research
    • Molecular Cancer Therapeutics

AACR logo

  • Register
  • Log in
  • My Cart
Advertisement

Main menu

  • Home
  • About
    • The Journal
    • AACR Journals
    • Subscriptions
    • Permissions and Reprints
  • Articles
    • OnlineFirst
    • Current Issue
    • Past Issues
    • CEBP Focus Archive
    • Meeting Abstracts
    • Progress and Priorities
    • Collections
      • COVID-19 & Cancer Resource Center
      • Disparities Collection
      • Editors' Picks
      • "Best of" Collection
  • For Authors
    • Information for Authors
    • Author Services
    • Best of: Author Profiles
    • Informing Public Health Policy
    • Submit
  • Alerts
    • Table of Contents
    • Editors' Picks
    • OnlineFirst
    • Citation
    • Author/Keyword
    • RSS Feeds
    • My Alert Summary & Preferences
  • News
    • Cancer Discovery News
  • COVID-19
  • Webinars
  • Search More

    Advanced Search

  • AACR Publications
    • Blood Cancer Discovery
    • Cancer Discovery
    • Cancer Epidemiology, Biomarkers & Prevention
    • Cancer Immunology Research
    • Cancer Prevention Research
    • Cancer Research
    • Clinical Cancer Research
    • Molecular Cancer Research
    • Molecular Cancer Therapeutics

User menu

  • Register
  • Log in
  • My Cart

Search

  • Advanced search
Cancer Epidemiology, Biomarkers & Prevention
Cancer Epidemiology, Biomarkers & Prevention
  • Home
  • About
    • The Journal
    • AACR Journals
    • Subscriptions
    • Permissions and Reprints
  • Articles
    • OnlineFirst
    • Current Issue
    • Past Issues
    • CEBP Focus Archive
    • Meeting Abstracts
    • Progress and Priorities
    • Collections
      • COVID-19 & Cancer Resource Center
      • Disparities Collection
      • Editors' Picks
      • "Best of" Collection
  • For Authors
    • Information for Authors
    • Author Services
    • Best of: Author Profiles
    • Informing Public Health Policy
    • Submit
  • Alerts
    • Table of Contents
    • Editors' Picks
    • OnlineFirst
    • Citation
    • Author/Keyword
    • RSS Feeds
    • My Alert Summary & Preferences
  • News
    • Cancer Discovery News
  • COVID-19
  • Webinars
  • Search More

    Advanced Search

Research Articles

The Sun Solutions Intervention for Operating Engineers: A Randomized Controlled Trial

Sonia A. Duffy, Stephanie V. Hall, Alai Tan, Andrea H. Waltje, Samantha A. Cooper and Carolyn J. Heckman
Sonia A. Duffy
1College of Nursing, Ohio State University, Columbus, Ohio.
2VA Center for Clinical Management and Research, Department of Veterans Affairs Healthcare System, Ann Arbor, Michigan.
3Department of Psychiatry, University of Michigan, Ann Arbor, Michigan.
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • For correspondence: Duffy.278@osu.edu
Stephanie V. Hall
2VA Center for Clinical Management and Research, Department of Veterans Affairs Healthcare System, Ann Arbor, Michigan.
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Alai Tan
1College of Nursing, Ohio State University, Columbus, Ohio.
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Andrea H. Waltje
4Division of Metabolism, Endocrinology and Diabetes, University of Michigan, Ann Arbor, Michigan.
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Samantha A. Cooper
5Department of Veteran's Affairs, Serious Mental Illness Treatment Resource and Evaluation Center, Ann Arbor, Michigan.
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Carolyn J. Heckman
6Rutgers Cancer Institute of New Jersey, New Brunswick, New Jersey.
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
DOI: 10.1158/1055-9965.EPI-17-1023 Published August 2018
  • Article
  • Figures & Data
  • Info & Metrics
  • PDF
Loading

Abstract

Background: Because Operating Engineers (heavy equipment operators) are outdoor workers at risk for skin cancer, interventions are needed to promote sun safety. The objectives were to determine changes in sunscreen use and sunburning among Operating Engineers randomized to four conditions in the Sun Solutions study: (i) education only; (ii) education and text message reminders; (ii) education and mailed sunscreen; and (iv) education, text message reminders, and mailed sunscreen.

Methods: In this randomized controlled trial, Operating Engineers (N = 357) were recruited at required safety training sessions throughout Michigan during winter/spring of 2012 to 2013 and provided baseline surveys. The four interventions were delivered over the summer. Postintervention surveys were collected in the fall (82.1% follow-up).

Results: Sunscreen use improved significantly from baseline to follow-up in all four conditions (P < 0.05), except sunscreen use among those receiving education and text message reminders was only marginally significant (P = 0.07). There were significantly greater increases in sunscreen use in the two conditions that were mailed sunscreen (P < 0.001). There was a significant decrease in the number of reported sunburns from baseline to follow-up in all four conditions (P < 0.001), but there were no significant differences in sunburns among the groups. Participant evaluated the interventions highly with those who received mailed sunscreen rating the intervention the highest.

Conclusions: Providing proper sun-safety education and minimizing barriers to sunscreen use can increase sunscreen use and decrease reported sunburns.

Impact: The implementation of the Sun Solutions intervention may be an effective method to modify skin cancer–related behaviors. Cancer Epidemiol Biomarkers Prev; 27(8); 864–73. ©2018 AACR.

This article is featured in Highlights of This Issue, p. 843

Introduction

Nearly 5 million cases of nonmelanoma skin cancer occur annually (1). U.S. rates of melanoma, the most deadly form of skin cancer, are mostly attributed to ultraviolet radiation (UVR) exposure and are expected to increase at a rate of 3% per year through 2019 (2). Melanoma accounts for approximately 75% of skin cancer–related deaths in the United States (3). In 2017, it is estimated that there will be 87,110 new cases of melanoma, and an estimated 9,370 will die from the disease (4). The annual cost of treating newly diagnosed melanomas is estimated to increase from $457 million in 2011 to $1.6 billion in 2030 (2). Many people diagnosed with skin cancer are Caucasian men over the age of 50, and 1 out of 33 Caucasian males will develop skin cancer in his lifetime (1).

Outdoor workers are exposed to high UVR levels and have lower sun protection behaviors (5), increasing their risk of malignant melanoma (6) and nonmelanoma skin cancer (7, 8). Among outdoor workers, being male, younger, and reporting perceived barriers to using sun protection have been shown to be associated with lower levels of sun protection behaviors (5). Male outdoor workers may feel that it is not masculine to protect themselves from the sun (9), especially when around other men. Furthermore, putting on sunscreen and wearing long sleeves are often viewed as uncomfortable and “a hassle” (10–12). Positive attitudes toward tans may prevent those regularly exposed to UVR from taking sun protection seriously (11).

Sunscreen use and other sun protection behaviors have been shown to decrease sunburning and the risk of developing squamous cell carcinoma and melanoma (13–19). Past skin cancer–prevention interventions for outdoor workers such as lifeguards, other recreation workers, farmers, and mail carriers have often included multiple components such as education, placing messages at the worksite, videos discussing sun protection methods and the cancerous effects of UVR exposure, showing ultraviolet filtered photos of the face demonstrating existing skin damage, sending text message reminders of the weather report, role modeling, physician skin examinations, environmental support such as sunscreen dispensers and shade structures, and policy changes (20–26). At least 13 moderate to high-quality studies from the United States and elsewhere have demonstrated desirable intervention effects of up to a year on various sun-safety behaviors (i.e., sunscreen, hat, long-sleeve, sunglasses, and shelter use) and in some cases, sunburn (27, 28).

However, a systematic review concluded that outdoor workers' knowledge and attitudes about sun protection behaviors were inadequate (28). Similarly, our team found that among mostly male Operating Engineers (heavy equipment operators), 80% (n = 498) reported spending 4 to 5 hours in the sun during summer weekdays, yet approximately two thirds reported never or rarely wearing sunscreen (29). Almost half reported two or more first-degree sunburns per summer and a median of blistering two times in their lifetime. Hence, the Sun Solutions study, based on the Health Belief Model (30, 31), was conducted among Operating Engineers. A preliminary study showed that the educational component significantly improved perceived self-efficacy, perceived barriers to and benefits of use of sunscreen, and perceived susceptibility to and severity of sunburning (12).

This randomized controlled trial (RCT) evaluated the efficacy of four Sun Solutions interventions on sunscreen use and sunburning among Operation Engineers. Among the four interventions, the educational component was designed to increase perceived susceptibility to and severity of sun burning and enforce the benefits of sunscreen use. Mailed sunscreen was designed to reduce barriers and served as a cue to action. Text messages were designed to emphasize perceived benefits and served as cues to action. The study is unique in that it recruits participants during their regularly scheduled safety training and compares four interventions of varying intensity. The hypothesis was that a greater number of intervention components would be associated with greater improvements in sunscreen use and decreased sunburning.

Materials and Methods

Design

A 2 × 2 factorial design allowed the effects of text message reminders and mailed sunscreen to be tested simultaneously. As detailed in a protocol paper (32), Michigan Operating Engineers were randomized to either: (i) Education Only; (ii) Education and Text Message Reminders; (iii) Education and Mailed Sunscreen; or (iv) Education, Text Message Reminders, and Mailed Sunscreen. All participants provided written informed consent in accordance with the Declaration of Helsinki, International Ethical Guidelines for Biomedical Research Involving Human Subjects, the Belmont Report, and the U.S. Common Rule. Institutional review board approval was obtained from the University of Michigan.

Setting and sample

Participants were recruited from December 2012 to April 2013 during their annual winter safety training sessions provided by Michigan Local Union 324 Operating Engineers Training Centers. Education was provided at this time and additional interventions were provided between May and September (interventions described in the following sections). Operating Engineers were included if they: (i) were at least 18 years of age; (ii) were interested in enrolling in the sun protection study; (iii) owned a cell phone that accepted text messages; and (iv) were willing to share their phone number with the research institution.

Procedures

A research nurse consented participants and provided them with an information packet, which included a baseline survey. Using a computerized random number generator, a statistician randomly allocated the consented participants to one of the four intervention arms with an equal allocation (or, 1:1:1:1 allocation). Both the researchers and the participants were blinded to the condition of randomization. Participants were sent a follow-up survey in October following the sun protection interventions. Participants received $10.00 for each survey completed (baseline and follow-up).

Description of interventions

Education only.

To increase knowledge and foster behavior change (21, 27, 33, 34), participants in all four conditions were shown a 30-minute PowerPoint presentation during their annual safety trainings. The content was gathered from published articles, the FDA, the U.S. Preventive Services Task Force (USPSTF), and the American Academy of Dermatology. The presentation included information on: (i) the current use of sun protection among Local 324 members taken from our prior survey of this population (29); (ii) the incidence and prevalence of skin cancer especially among outdoor workers; (iii) the types of skin cancers and skin cancer risk factors; and, (iv) methods to prevent sunburning, including choosing from different products and reading Sun Protection Factor (SPF) labels, correct application of sunscreen, and preventive measures such as wearing hats, UVR-blocking sunglasses, and using shade. Because pictures and graphs can enhance understanding (35), adapting information to address specific populations can gain attention and change attitudes and behaviors (20, 27, 36–39). And because pictures of skin cancer can motivate people to action (21, 40), pictures were shown of: Operating Engineers working in the sun, skin cancer, different SPF labels, and sunscreens. Perceived barriers and opinions about using sunscreen were discussed.

Education and text message reminders.

Although recall of sun protection messages is problematic (41), the provision of cellular text message reminders has been found to increase adherence to sunscreen application (22). Hence, in addition to the educational presentation, the second group also received computer-generated cellular telephone text messages on three random weekdays between 8 and 10 a.m. for the months of May, June, July, August, and September for a total of 60 unique messages in random order over the 20-week summer period. The text bank was first drafted by faculty and students and then modified with feedback from a few Operating Engineers. Because positive messages have been found to appeal to the reader's desire for happy emotions (42), negatively oriented text messages were excluded. Sample text messages included: “Your family and friends love you—put on sunscreen!,” “Yikes it's hot—put on sunscreen!,” and “86% of OE's burn each summer—but not you, right?” The text message bank and cell phone numbers were entered into a software program called TXT180. As required by law, the first text message sent by the program informed participants that they may be charged for the messages and allowed them to opt out by replying “STOP” to any messages sent throughout the intervention period.

Education and sunscreen.

To reduce barriers to obtaining sunscreen, in addition to educational presentation, the third group also received mailed sunscreen three times over the summer, including large bottles of SPF30 lotion and a small bottle that could be refilled and attached to their key rings (as keys are important to heavy equipment operators). A letter accompanying the mailing reminded them of proper sunscreen application techniques.

Education, text message reminders, and sunscreen.

To determine whether the combination of these interventional components results in improvements above and beyond the individual parts, the fourth intervention group received the educational presentation, text message reminders, and mailed sunscreen.

Measures

Sun solutions intervention.

The four interventions were Education Only, Education and Text Message Reminders, Education and Mailed Sunscreen, and Education, Text Message Reminders, and Mailed Sunscreen.

Sun exposure covariates.

Participants were asked about their sun exposure with the following questions: In general, during the summer weekdays, about how many hours a day are you outside between 10 a.m. and 3 p.m.? (43). In general, during the summer holidays and weekends, about how many hours a day are you outside between 10 a.m. and 3 p.m. (less than an hour, 1 to 2 hours, 2 to 3 hours, 3 to 4 hours, 4–5 hours)? (43). Which best describes how your skin generally reacts to the sun when you are not using any sun protection (always burn, unable to tan; usually burn, then can tan if I work at it; sometimes mild burn, then tan easily; rarely burn, tan easily)? (43, 44). About how many times in your life do you recall having had a sunburn severe enough to cause your skin to blister? (43, 44).

Other covariates.

Because demographic factors may influence sun protection behaviors, participants were surveyed about demographics including: age, sex, ethnicity/race, educational level, marital, and veteran status. Because comorbidities can affect health motivation, probable depression was measured using the well validated Patient Health Questionnaire-2 (PHQ-2; ref. 45), and medical comorbidities were measured using a validated self-report instrument (46). Poor health habits have been shown to cluster together (47–49), and our prior research has shown that problem drinking, greater body mass index (BMI), and greater physical activity levels predict greater sunburning (29). Hence, validated questions were asked about smoking in the past 30 days (50), problem drinking (Alcohol Use Disorders Identification Test-C: AUDIT-C; ref. 51), diet (two questions on fruit and vegetable intake from the validated Willett food frequency questionnaire; ref. 52), physical activity (53), self-reported height and weight to determine BMI, and sleep quality (54). Job characteristics measured included the occupational exposure of heat stress, extent of cab enclosure (partially enclosed or not enclosed), and percentage of time with doors and windows of cab open. Several other measures described in the protocol paper (32) were reported in a prior article (12).

Outcome variables.

Sun exposure and protection was assessed using two validated questions. In the past summer, on the days when you were outside in the sunlight, how often did you use sunscreen (never, some of the time, about half the time, most of the time, always)? On average, how many times did you get a sunburn this past summer (0, 1, 2, 3, 4 or more times)? (43, 44)

Evaluation measures.

Participants were asked to evaluate specific intervention components on “ease of understanding,” “helpfulness,” “satisfaction,” “likelihood that they would use sunscreen,” and “would recommend intervention to others” with 5-point Likert response categories, and if they purchased sunscreen in the past summer (yes/no).

Statistical analysis

Descriptive statistics were calculated for all variables. The equivalence of the intervention arms was tested using χ2 or Fisher's exact tests of association for categorical variables and ANOVA tests for continuous variables. Because the differences between baseline and follow-up survey dependent variables (sunscreen use and sunburns) were roughly normally distributed, paired t tests were used to test for baseline to follow-up differences in use of sunscreen and sunburning for each treatment arm. Using an intent-to-treat analysis, ANOVA was used to estimate the effects of text message reminder, mailed sunscreen, their interaction, and post hoc comparisons among the groups on baseline, follow-up, and baseline to follow-up changes in self-reported use of sunscreen and sunburning. Power analyses indicated that a final sample size of 256 participants was needed to provide 80% power to detect medium-sized effects with a two-tailed alpha of 0.05 (32). On basis of prior experience with Operating Engineers, it was expected that 460 individuals would need to be approached to produce the intended final sample. Post hoc comparisons were performed with Tukey's HSD (honest significant difference) test.

Additional analyses conducted included: (i) ordinal logistic regression analyses which treated the dependent variable as ordinal; and (ii) multivariate linear regressions that controlled for baseline differences across treatment arms. Evaluation questions were analyzed using the Kruskal–Wallis test statistic. Two-tailed tests with alpha of 0.05 were conducted. Analyses were conducted using SAS version 9.2 (SAS Institute Inc.).

Results

Description of study sample

Figure 1 shows that of the 535 who attended the classes, 357 were consented and eligible (66.7% participation rate), and 293 participants were followed (82.1% follow-up rate). Participants lost to follow-up were marginally more likely to be younger (P = 0.07), nonwhite (P = 0.02), and smoke cigarettes (P = 0.02) than those followed. About 46.9% (n = 84/179) of those assigned to receive text messages immediately opted out using the “STOP” feature due to a legally mandated warning “Msg&data rates may apply.” There was no significant difference in the opt-out rate between the two groups eligible to receive text messages (47.7% vs. 46.2%, P = 0.84).

Figure 1.
  • Download figure
  • Open in new tab
  • Download powerpoint
Figure 1.

Consort diagram. The consort diagram displays how participants were recruited, randomized, and retained. Follow-up rates are provided by intervention arm.

A description of the population can be seen in Table 1. The average age was 44.2 years, and the majority were non-Hispanic white males. About one quarter had high blood pressure. Approximately one quarter of the population reported smoking cigarettes, almost two thirds reported hazardous drinking, and almost half were obese.

View this table:
  • View inline
  • View popup
Table 1.

Characteristics of Operating Engineers (N = 357)a

Participants reported an average of 6.1 severe burns throughout their lifetime. About 82.9% reported spending 4 to 5 hours per day outside between 10am and 3pm during summer week days and 70.3% reported spending 4 to 5 hours per day outside between 10 a.m. and 3 p.m. during summer holidays and weekends. About 18.8% reported that their skin always or usually burns when they are outside in the sun without any sun protection. The most common hazardous exposure was heat stress (62.2%). Most had at least a partially (38.7%) or fully (48.1%) enclosed cab. Even so, almost half (48.9%) operated the cab with doors and windows open 76% to 100% of the time and another 20.9% did so 50 to 75% of the time. The percentage of participants who reported never wearing sunscreen when outside in the sunlight decreased from 38.1% at baseline to 21.8% at follow-up. The percentage of participants who reported burning 4 or more times during the past summer was 18.6% at baseline and decreased to 5.8% at follow-up. The only baseline difference (P = 0.04) across treatment conditions was that those who received education only reported having significantly more high blood pressure (36.7%), whereas those who received education and mailed sunscreen only reported the lowest percentage (17.4%).

Changes in sunscreen use and sunburns

In Table 2 the unadjusted intention-to-treat analyses show that sunscreen use increased significantly for all treatment conditions (P < 0.05), except significance was only marginal for those who received education and text message reminders (P = 0.07). Both follow-up sunscreen use and mean differences in sunscreen use from baseline to follow-up were statistically different across the four treatment groups (P < 0.001). Moreover, the number of reported sunburns decreased significantly from baseline to follow-up in all four treatment conditions (P < 0.001). Although there were no statistically significant decreases in sunburning among the different conditions, the greatest decrease in sunburns were in the groups that received mailed sunscreen, particularly the group that received all three interventions. Additional analyses treating the dependent variables as ordinal and controlling for baseline differences (high blood pressure) across groups produced similar results to those reported in Table 2, and are therefore not reported. When sunscreen use and change in sunscreen use were regressed on indicator variables for receipt of text messages, receipt of mailed sunscreen, and an interaction term for receipt of text messages and receipt of mailed sunscreen, the interactions were nonsignificant and therefore not reported. Post hoc analyses showed that the two groups that received mailed sunscreen were significantly more likely to use sunscreen than the two groups that were not mailed sunscreen (see Fig. 2).

View this table:
  • View inline
  • View popup
Table 2.

Unadjusted differences in sunscreen use and sunburns from baseline to follow-up and across conditions among Operating Engineers (N = 357)

Figure 2.
  • Download figure
  • Open in new tab
  • Download powerpoint
Figure 2.

Mean difference in sunscreen use (baseline to follow-up) by intervention group. This figure displays participants' mean changes in sunscreen use from baseline to follow-up by intervention group. Frequency of sunscreen use was assessed on a five-point scale of Never/Some of the time/About half of the time/Most of the time/Always. A positive change indicates increased frequency of sunscreen use.

Evaluation of the interventions

Table 3 shows the participants' opinions about the four interventions rated on a 5-point scale on perceived: (i) understanding, (ii) helpfulness, (iii) satisfaction, and (iv) likelihood of increased sunscreen use.

View this table:
  • View inline
  • View popup
Table 3.

Operating Engineers' evaluation of the interventions (N = 293)

Understanding and helpfulness.

The mean rating for understanding of the educational intervention was 4.46; those in the Education, Text Message, and Mailed Sunscreen group rated it the highest (P = 4.49), whereas those in the Education and Text Message group rated it the lowest (4.31; P < 0.05). The mean rating of helpfulness was 4.37 for the educational intervention, 4.48 for the mailed sunscreen, but only 3.67 for text messages.

Satisfaction and likelihood of using sunscreen.

The mean rating of satisfaction was 4.40 for the educational intervention, 4.48 for mailed sunscreen, but was only 3.59 for text messages. Those who received Education, Text Messages, and Mailed Sunscreen tended to be the most satisfied with the educational intervention (P = 0.031) compared with the other groups. The mean rating of the likelihood of using sunscreen as a result of the educational intervention was 4.03, as a result of the mailed sunscreen was 4.27, but was only 3.56 for text messages. Both groups that received mailed sunscreen indicated that the educational presentation increased the likelihood of using sunscreen (means = 4.17 and 4.18), compared with Education and Text Messages (mean = 3.98) and Education Only (3.83) groups (P = 0.031).

Recommendation of intervention and purchase of sunscreen.

Overall, the mean score for likelihood of recommending the intervention to others was 4.34 with the two conditions receiving mailed sunscreen marginally more likely to recommend (means = 4.48 and 4.37) than the other two conditions (means = 4.26 and 4.24; P = 0.079). About 57.4% said they had purchased sunscreen over the summer. Not surprisingly, those who were not mailed sunscreen were more likely to have purchased sunscreen over the summer, compared with those participants who were mailed sunscreen (P < 0.001).

Discussion

This study showed that all four conditions of the Sun Solutions intervention increased sunscreen use and decreased the number of sunburns from baseline to follow-up. Although the greatest decreases in sunburning were in the group that received mailed sunscreen, there was no significant difference among the groups in sunburning. The majority of participants found all interventions to be helpful, satisfactory, and likely to increase sunscreen use. Even a simple educational PowerPoint presentation tailored to Operating Engineers, which was rated to be highly understandable, was enough to make a difference in both sunscreen use and sunburning.

A study conducted by Armstrong and colleagues (22) found text messaging to be effective in changing sun protection behaviors. Yet in the current study, those who received Education and Text Message Reminders only marginally improved sunscreen use and participants evaluated text messaging lower than education and mailed sunscreen. It is difficult to determine whether some of the lower scores for text messaging were due to the intervention itself or because almost half of participants eligible to receive text messages chose to opt out, which we anecdotally believe was due to potential costs. In retrospect, it may have been advantageous to educate the participants upon recruitment, that if they had free text messaging, they would not be charged for the text messages. Although the interaction of text messages and mailed sunscreen was not significant, compared with the other groups, those who received Education, Text Message Reminders, and Mailed Sunscreen reported slightly more sunscreen use and tended to evaluate the intervention higher, suggesting the possibility that text messages enhanced the effect of mailed sunscreen.

Other technology-based interventions shown to improve sun protection behaviors include mobile apps, although usage has been shown to be low. In one study only 41% of participants used a smart phone app (55), which is similar, but even less than the 53.1% that participated in the text messages in this study. This may be because mobile apps require active participation, whereas text messages can be passively sent to participants, unless they opt out.

Post hoc analyses showed that the two groups that were mailed sunscreen were more likely to use sunscreen than the other groups. Moreover, groups receiving mailed sunscreen tended to evaluate all of the intervention components more positively. The study is similar to an efficacious study that provided sun prevention interventions, including free sunscreen to mostly male postal workers (34). However, in the former study, the sunscreen was placed in locker rooms versus this study that mailed sunscreen to the participants' homes. Either way, the provision of sunscreen seems to have eliminate the barriers to access to sunscreen. It is possible that the key chain sunscreen samples decreased barriers to reapplication, as the keys are hanging directly in front of them all day long as they are driving. Outdoor workers are more likely to use sunscreen than wear long-sleeve clothing during summer time (27).

Despite the fact that most had access to partially or totally enclosed cabs, many chose to operate their equipment with the doors and/or windows of the cab open. Almost half of the participants were obese, and about a quarter screened positive from problem drinking, both of which have been shown to be associated with sunburning (29, 49, 56, 57), although the exact reasons for these associations are unknown. Physical activity scores were a bit higher than average and high physical activity, most likely due to more outdoor exposure, has been shown to be associated with a higher rate of sunburning (29). The majority of participants were males and men are less inclined to engage in sun protection behaviors (9–12). Although this population was highly at risk for sunburning and two thirds reported heat stress as an occupational exposure, work-site interventions such as the Sun Solutions intervention introduced during mandated safety training sessions have the potential to improve sun protection behaviors.

Strengths and limitations of the study

The study was an RCT design guided by the Health Belief Model and the high participation and follow-up rates increase the generalizability of the results and emphasize participant interest and the feasibility of the intervention. The study had the potential to control for a number of co-variates, including comorbidities, other health behaviors, and job characteristics. The study relied on self-reported data on sunscreen use and sunburns, which may result in bias related to poor recall, improved recall by those who sunburn, and over-reporting desirable behaviors postintervention, but because all groups received some amount of intervention, the potential for socially desirable reporting is reduced. Moreover, several authors have previously validated self-report against direct observation among outdoor workers and found self-report to be accurate (34, 44, 58, 59). The fidelity of the text messaging intervention was compromised due to the 23.5% opt-out rate.

Conclusion

Heat stress is a major concern of the Occupational Safety & Health Administration. The USPSTF recommends that interventions to change behaviors should aim to reduce exposure to UVR including: (i) avoiding sun during the UVR peak times; (ii) using a broad-spectrum high-SPF sunscreen; (iii) wearing sun protective clothing; and (iv) avoiding indoor tanning (13). However, avoiding the sun during the UVR peak time is unrealistic for outdoor workers. Hence, sun protection interventions such as the Sun Solutions intervention, that educate outdoor workers and reduce barriers to sunscreen use, can be effective primary prevention methods to reduce skin cancer–related morbidity and mortality in this population (60, 61).

Disclosure of Potential Conflicts of Interest

No potential conflicts of interest were disclosed.

Disclaimer

The Blue Cross Blue Shield of Michigan Foundation was not involved in the design, collection, analysis, interpretation of data, writing of the article and in the decision to submit the article for publication.

Authors' Contributions

Conception and design: S.A. Duffy

Development of methodology: S.A. Duffy, S.V. Hall

Acquisition of data (provided animals, acquired and managed patients, provided facilities, etc.): S.A. Duffy, A.H. Waltje, S.A. Cooper

Analysis and interpretation of data (e.g., statistical analysis, biostatistics, computational analysis): S.A. Duffy, S.V. Hall, A. Tan, S.A. Cooper

Writing, review, and/or revision of the manuscript: S.A. Duffy, S.V. Hall, A. Tan, A.H. Waltje, S.A. Cooper, C.J. Heckman

Administrative, technical, or material support (i.e., reporting or organizing data, constructing databases): S.A. Duffy, S.V. Hall, A.H. Waltje, S.A. Cooper

Study supervision: S.A. Duffy

Acknowledgments

This work was supported by the Blue Cross Blue Shield of Michigan Foundation (N015454-00; to S.A. Duffy).

The authors would also like to thank the Operating Engineers that participated in this study as well as the Operating Engineers leadership staff including Bill Nelson, Willie Dubas, and Lee Graham. The authors also acknowledge David Ronis, PhD, the original statistician, who passed away before the study was completed.

The costs of publication of this article were defrayed in part by the payment of page charges. This article must therefore be hereby marked advertisement in accordance with 18 U.S.C. Section 1734 solely to indicate this fact.

  • Received November 2, 2017.
  • Revision received December 27, 2017.
  • Accepted May 15, 2018.
  • Published first June 28, 2018.
  • ©2018 American Association for Cancer Research.

References

  1. 1.↵
      American Cancer Society. Cancer Facts & Figures 2016. Atlanta, GA: American Cancer Society; 2016.
    1. 2.↵
      1. Guy GP Jr.,
      2. Thomas CC,
      3. Thompson T,
      4. Watson M,
      5. Massetti GM,
      6. Richardson LC
      . Vital signs: melanoma incidence and mortality trends and projections - United States, 1982-2030. MMWR Morb Mortal Wkly Rep 2015;64:591–6.
      OpenUrlPubMed
    2. 3.↵
      1. Jerant AF,
      2. Johnson JT,
      3. Sheridan CD,
      4. Caffrey TJ
      . Early detection and treatment of skin cancer. Am Fam Physician 2000;62:357–68.
      OpenUrlPubMed
    3. 4.↵
      1. Suhag V,
      2. Vats P
      . Shifting paradigms in the management of metastatic and unresectable melanoma. Adv Modern Oncol Res 2017;3:162–5.
      OpenUrl
    4. 5.↵
      1. Nahar VK,
      2. Ford MA,
      3. Hallam JS,
      4. Bass MA,
      5. Vice MA
      . Sociodemographic and psychological correlates of sun protection behaviors among outdoor workers: a review. J Skin Cancer 2013;2013:453174.
      OpenUrlPubMed
    5. 6.↵
      1. Hakansson N,
      2. Floderus B,
      3. Gustavsson P,
      4. Feychting M,
      5. Hallin N
      . Occupational sunlight exposure and cancer incidence among Swedish construction workers. Epidemiology 2001;12:552–7.
      OpenUrlCrossRefPubMed
    6. 7.↵
      1. Schmitt J,
      2. Seidler A,
      3. Diepgen TL,
      4. Bauer A
      . Occupational ultraviolet light exposure increases the risk for the development of cutaneous squamous cell carcinoma: a systematic review and meta-analysis. Br J Dermatol 2011;164:291–307.
      OpenUrlCrossRefPubMed
    7. 8.↵
      1. Bauer A,
      2. Diepgen TL,
      3. Schmitt J
      . Is occupational solar ultraviolet irradiation a relevant risk factor for basal cell carcinoma? A systematic review and meta-analysis of the epidemiological literature. Br J Dermatol 2011;165:612–25.
      OpenUrlPubMed
    8. 9.↵
      1. Lewis EC,
      2. Mayer JA,
      3. Slymen D
      . Postal workers' occupational and leisure-time sun safety behaviors (United States). Cancer Causes Control 2006;17:181–6.
      OpenUrlCrossRefPubMed
    9. 10.↵
      1. Garside R,
      2. Pearson M,
      3. Moxham T
      . What influences the uptake of information to prevent skin cancer? A systematic review and synthesis of qualitative research. Health Educ Res 2010;25:162–82.
      OpenUrlCrossRefPubMed
    10. 11.↵
      1. Woolley T,
      2. Lowe J,
      3. Raasch B,
      4. Glasby M,
      5. Buettner PG
      . Workplace sun protection policies and employees' sun-related skin damage. Am J Health Behav 2008;32:201–8.
      OpenUrlPubMed
    11. 12.↵
      1. Lee C,
      2. Duffy SA,
      3. Louzon SA,
      4. Waltje AH,
      5. Ronis DL,
      6. Redman RW,
      7. et al.
      The impact of Sun Solutions educational interventions on select health belief model constructs. Workplace Health Safety 2014;62:70–9.
      OpenUrl
    12. 13.↵
      1. Lin JS,
      2. Eder M,
      3. Weinmann S
      . Behavioral counseling to prevent skin cancer: a systematic review for the U.S. Preventive Services Task Force. Ann Intern Med 2011;154:190–201.
      OpenUrlCrossRefPubMed
    13. 14.↵
      1. Lazovich D,
      2. Vogel RI,
      3. Berwick M,
      4. Weinstock MA,
      5. Warshaw EM,
      6. Anderson KE
      . Melanoma risk in relation to use of sunscreen or other sun protection methods. Cancer Epidemiol Biomarkers Prev 2011;20:2583–93.
      OpenUrlAbstract/FREE Full Text
    14. 15.↵
      1. Gilaberte Y,
      2. Gonzalez S
      . [Update on photoprotection]. Actas Dermosifiliogr 2010;101:659–72.
      OpenUrlPubMed
    15. 16.↵
      1. Sambandan DR,
      2. Ratner D
      . Sunscreens: an overview and update. J Am Acad Dermatol 2011;64:748–58.
      OpenUrlCrossRefPubMed
    16. 17.↵
      1. Green AC,
      2. Williams GM,
      3. Logan V,
      4. Strutton GM
      . Reduced melanoma after regular sunscreen use: randomized trial follow-up. J Clin Oncol 2011;29:257–63.
      OpenUrlAbstract/FREE Full Text
    17. 18.↵
      1. Thompson SC,
      2. Jolley D,
      3. Marks R
      . Reduction of solar keratoses by regular sunscreen use. N Engl J Med 1993;329:1147–51.
      OpenUrlCrossRefPubMed
    18. 19.↵
      1. Darlington S,
      2. Williams G,
      3. Neale R,
      4. Frost C,
      5. Green A
      . A randomized controlled trial to assess sunscreen application and beta carotene supplementation in the prevention of solar keratoses. Arch Dermatol 2003;139:451–5.
      OpenUrlCrossRefPubMed
    19. 20.↵
      1. Buller DB,
      2. Andersen PA,
      3. Walkosz BJ,
      4. Scott MD,
      5. Cutter GR,
      6. Dignan MB,
      7. et al.
      Randomized trial testing a worksite sun protection program in an outdoor recreation industry. Health Educ Behav 2005;32:514–35.
      OpenUrlCrossRefPubMed
    20. 21.↵
      1. Stock ML,
      2. Gerrard M,
      3. Gibbons FX,
      4. Dykstra JL,
      5. Weng CY,
      6. Mahler HI,
      7. et al.
      Sun protection intervention for highway workers: long-term efficacy of UV photography and skin cancer information on men's protective cognitions and behavior. Ann Behav Med 2009;38:225–36.
      OpenUrlCrossRefPubMed
    21. 22.↵
      1. Armstrong AW,
      2. Watson AJ,
      3. Makredes M,
      4. Frangos JE,
      5. Kimball AB,
      6. Kvedar JC
      . Text-message reminders to improve sunscreen use: a randomized, controlled trial using electronic monitoring. Arch Dermatol 2009;145:1230–6.
      OpenUrlCrossRefPubMed
    22. 23.↵
      1. Horsham C,
      2. Auster J,
      3. Sendall MC,
      4. Stoneham M,
      5. Youl P,
      6. Crane P,
      7. et al.
      Interventions to decrease skin cancer risk in outdoor workers: update to a 2007 systematic review. BMC Res Notes 2014;7:10.
      OpenUrl
    23. 24.↵
      1. Buller DB,
      2. Andersen PA,
      3. Walkosz BJ,
      4. Scott MD,
      5. Beck L,
      6. Cutter GR
      . Rationale, design, samples, and baseline sun protection in a randomized trial on a skin cancer prevention intervention in resort environments. Contemp Clin Trials 2016;46:67–76.
      OpenUrl
    24. 25.↵
      1. Buller DB,
      2. Walkosz BJ,
      3. Buller MK,
      4. Wallis A,
      5. Andersen PA,
      6. Scott MD,
      7. et al.
      Results of a randomized trial on an intervention promoting adoption of occupational sun protection policies. Am J Health Promot. 2017:890117117704531.
    25. 26.↵
      1. Buller DB,
      2. Andersen PA,
      3. Walkosz BJ,
      4. Scott MD,
      5. Beck L,
      6. Cutter GR
      . Effect of an intervention on observed sun protection by vacationers in a randomized controlled trial at North American resorts. Prev Med 2017;99:29–36.
      OpenUrl
    26. 27.↵
      1. Glanz K,
      2. Buller DB,
      3. Saraiya M
      . Reducing ultraviolet radiation exposure among outdoor workers: state of the evidence and recommendations. Environ Health: A Global Access Sci Source 2007;6:22.
      OpenUrl
    27. 28.↵
      1. Reinau D,
      2. Weiss M,
      3. Meier CR,
      4. Diepgen TL,
      5. Surber C
      . Outdoor workers' sun-related knowledge, attitudes and protective behaviours: a systematic review of cross-sectional and interventional studies. Br J Dermatol 2013;168:928–40.
      OpenUrl
    28. 29.↵
      1. Duffy SA,
      2. Choi SH,
      3. Hollern R,
      4. Ronis DL
      . Factors associated with risky sun exposure behaviors among operating engineers. Am J Ind Med 2012;55:786–92.
      OpenUrlCrossRefPubMed
    29. 30.↵
      1. Rosenstock IM
      . Historical origins of the health belief model. Health Educ Monogr 1974;2:328–35.
      OpenUrlCrossRef
    30. 31.↵
      1. Becker MH
      . The health belief model and sick role behavior. Health Educ Monogr 1974;2:409–19.
      OpenUrlCrossRef
    31. 32.↵
      1. Duffy SA,
      2. Ronis DL,
      3. Waltje AH,
      4. Choi SH
      . Protocol of a randomized controlled trial of sun protection interventions for operating engineers. BMC Public Health 2013;13:273.
      OpenUrl
    32. 33.↵
      1. Armstrong AW
      . Effects of video-based, online education on behavioral and knowledge outcomes in sunscreen use: a randomized controlled trial. Patient Educ Couns 2011;83:273–7.
      OpenUrlCrossRefPubMed
    33. 34.↵
      1. Mayer JA
      . Promoting sun safety among US postal service letter carriers: impact of a 2-year intervention. Am J Public Health 2007;97:559–65.
      OpenUrlCrossRefPubMed
    34. 35.↵
      1. Zwirn E,
      2. Muehlenkord A
      . Using media, multimedia, and technology rich learning environment in teaching in nursing. Third edition. Philadelphia, PA: Saunders WB; 2009.
    35. 36.↵
      1. Tetroe JM
      . What does it mean to transform knowledge into action in falls prevention research? Perspectives from the Canadian Institutes of Health Research. J Safety Res 2011;42:423–6.
      OpenUrlCrossRefPubMed
    36. 37.↵
      1. Straus SE
      . Defining knowledge translation. Canadian Med Assoc J 2009;181:165–8.
      OpenUrl
    37. 38.↵
      1. Graham ID
      . Lost in knowledge translation: time for a map? J Contin Educ Health Prof 2006;26:13–24.
      OpenUrlCrossRefPubMed
    38. 39.↵
      1. Bernhardt JM
      . Tailoring messages and design in a Web-based skin cancer prevention intervention. Int Electron J Health Educ 2001;4:290–7.
      OpenUrl
    39. 40.↵
      1. Heckman CJ
      . Beliefs and intentions for skin protection and UV exposure in young adults. Am J Health Behav 2011;35:699.
      OpenUrlPubMed
    40. 41.↵
      1. Walkosz BJ
      . Increasing sun protection in winter outdoor recreation. Am J Prev Med 2008;34:502–9.
      OpenUrlCrossRefPubMed
    41. 42.↵
      1. Mermelstein R,
      2. Cohen S,
      3. Lichtenstein E,
      4. Baer JS,
      5. Kamarck T
      . Social support and smoking cessation and maintenance. J Consult Clin Psychol 1986;54:447–53.
      OpenUrlCrossRefPubMed
    42. 43.↵
      1. Glanz K,
      2. Yaroch AL,
      3. Dancel M,
      4. Saraiya M,
      5. Crane LA,
      6. Buller DB,
      7. et al.
      Measures of sun exposure and sun protection practices for behavioral and epidemiologic research. Arch Dermatol 2008;144:217–22.
      OpenUrlCrossRefPubMed
    43. 44.↵
      1. Oh SS,
      2. Mayer JA,
      3. Lewis EC,
      4. Slymen DJ,
      5. Sallis JF,
      6. Elder JP,
      7. et al.
      Validating outdoor workers' self-report of sun protection. Prev Med 2004;39:798–803.
      OpenUrlCrossRefPubMed
    44. 45.↵
      1. Lowe B,
      2. Kroenke K,
      3. Grafe K
      . Detecting and monitoring depression with a two-item questionnaire (PHQ-2). J Psychosom Res 2005;58:163–71.
      OpenUrlCrossRefPubMed
    45. 46.↵
      1. Mukerji SS,
      2. Duffy SA,
      3. Fowler KE,
      4. Khan M,
      5. Ronis DL,
      6. Terrell JE
      . Comorbidities in head and neck cancer: agreement between self-report and chart review. Otolaryngol Head Neck Surg 2007;136:536–42.
      OpenUrlCrossRefPubMed
    46. 47.↵
      1. Chiolero A,
      2. Wietlisbach V,
      3. Ruffieux C,
      4. Paccaud F,
      5. Cornuz J
      . Clustering of risk behaviors with cigarette consumption: a population-based survey. Prev Med 2006;42:348–53.
      OpenUrlCrossRefPubMed
    47. 48.↵
      NIH. NIH Science of Behavior Change. Bethesda, MD: NIH; 2009.
    48. 49.↵
      1. Schuit AJ,
      2. van Loon AJ,
      3. Tijhuis M,
      4. Ocke M
      . Clustering of lifestyle risk factors in a general adult population. Prev Med 2002;35:219–24.
      OpenUrlCrossRefPubMed
    49. 50.↵
      1. Pérez-Ríos M
      . Fagerstrom test for nicotine dependence vs heavy smoking index in a general population survey. BMC Public Health 2009;9:493.
      OpenUrlCrossRefPubMed
    50. 51.↵
      1. Saunders JB,
      2. Aasland OG,
      3. Babor TF,
      4. de la Fuente JR,
      5. Grant M
      . Development of the alcohol use disorders identification test (AUDIT): WHO collaborative project on early detection of persons with harmful alcohol consumption–II. Addiction 1993;88:791–804.
      OpenUrlCrossRefPubMed
    51. 52.↵
      1. Willett WC,
      2. Sampson L,
      3. Stampfer MJ,
      4. Rosner B,
      5. Bain C,
      6. Witschi J,
      7. et al.
      Reproducibility and validity of a semiquantitative food frequency questionnaire. Am J Epidemiol 1985;122:51–65.
      OpenUrlCrossRefPubMed
    52. 53.↵
      1. Norman A,
      2. Bellocco R,
      3. Bergstrom A,
      4. Wolk A
      . Validity and reproducibility of self-reported total physical activity–differences by relative weight. Int J Obes Relat Metab Disord 2001;25:682–8.
      OpenUrlCrossRefPubMed
    53. 54.↵
      1. Hays RD,
      2. Martin SA,
      3. Sesti AM,
      4. Spritzer KL
      . Psychometric properties of the medical outcomes study sleep measure. Sleep Med 2005;6:41–4.
      OpenUrlCrossRefPubMed
    54. 55.↵
      1. Buller DB,
      2. Berwick M,
      3. Lantz K,
      4. Buller MK,
      5. Shane J,
      6. Kane I,
      7. et al.
      Smartphone mobile application delivering personalized, real-time sun protection advice: a randomized clinical trial. JAMA Dermatol 2015;151:497–504.
      OpenUrl
    55. 56.↵
      1. Dennis LK,
      2. Vanbeek MJ,
      3. Beane Freeman LE,
      4. Smith BJ,
      5. Dawson DV,
      6. Coughlin JA
      . Sunburns and risk of cutaneous melanoma: does age matter? A comprehensive meta-analysis. Ann Epidemiol 2008;18:614–27.
      OpenUrlCrossRefPubMed
    56. 57.↵
      1. Warthan MM,
      2. Sewell DS,
      3. Marlow RA,
      4. Warthan ML,
      5. Wagner RF Jr.
      . The economic impact of acute sunburn. Arch Dermatol 2003;139:1003–6.
      OpenUrlPubMed
    57. 58.↵
      1. Stepanski BM,
      2. Mayer JA
      . Solar protection behaviors among outdoor workers. J Occup Environ Med 1998;40:43–8.
      OpenUrlCrossRefPubMed
    58. 59.↵
      1. Glanz K,
      2. McCarty F,
      3. Nehl EJ,
      4. O'Riordan DL,
      5. Gies P,
      6. Bundy L,
      7. et al.
      Validity of self-reported sunscreen use by parents, children, and lifeguards. Am J Prev Med 2009;36:63–9.
      OpenUrlCrossRefPubMed
    59. 60.↵
      1. Shih ST,
      2. Carter R,
      3. Sinclair C,
      4. Mihalopoulos C,
      5. Vos T
      . Economic evaluation of skin cancer prevention in Australia. Prev Med 2009;49:449–53.
      OpenUrlCrossRefPubMed
    60. 61.↵
      1. Hirst NG,
      2. Gordon LG,
      3. Scuffham PA,
      4. Green AC
      . Lifetime cost-effectiveness of skin cancer prevention through promotion of daily sunscreen use. Value Health 2012;15:261–8.
      OpenUrlPubMed
    PreviousNext
    Back to top
    Cancer Epidemiology Biomarkers & Prevention: 27 (8)
    August 2018
    Volume 27, Issue 8
    • Table of Contents
    • Table of Contents (PDF)
    • Editorial Board (PDF)

    Sign up for alerts

    View this article with LENS

    Open full page PDF
    Article Alerts
    Sign In to Email Alerts with your Email Address
    Email Article

    Thank you for sharing this Cancer Epidemiology, Biomarkers & Prevention article.

    NOTE: We request your email address only to inform the recipient that it was you who recommended this article, and that it is not junk mail. We do not retain these email addresses.

    Enter multiple addresses on separate lines or separate them with commas.
    The Sun Solutions Intervention for Operating Engineers: A Randomized Controlled Trial
    (Your Name) has forwarded a page to you from Cancer Epidemiology, Biomarkers & Prevention
    (Your Name) thought you would be interested in this article in Cancer Epidemiology, Biomarkers & Prevention.
    CAPTCHA
    This question is for testing whether or not you are a human visitor and to prevent automated spam submissions.
    Citation Tools
    The Sun Solutions Intervention for Operating Engineers: A Randomized Controlled Trial
    Sonia A. Duffy, Stephanie V. Hall, Alai Tan, Andrea H. Waltje, Samantha A. Cooper and Carolyn J. Heckman
    Cancer Epidemiol Biomarkers Prev August 1 2018 (27) (8) 864-873; DOI: 10.1158/1055-9965.EPI-17-1023

    Citation Manager Formats

    • BibTeX
    • Bookends
    • EasyBib
    • EndNote (tagged)
    • EndNote 8 (xml)
    • Medlars
    • Mendeley
    • Papers
    • RefWorks Tagged
    • Ref Manager
    • RIS
    • Zotero
    Share
    The Sun Solutions Intervention for Operating Engineers: A Randomized Controlled Trial
    Sonia A. Duffy, Stephanie V. Hall, Alai Tan, Andrea H. Waltje, Samantha A. Cooper and Carolyn J. Heckman
    Cancer Epidemiol Biomarkers Prev August 1 2018 (27) (8) 864-873; DOI: 10.1158/1055-9965.EPI-17-1023
    del.icio.us logo Digg logo Reddit logo Twitter logo CiteULike logo Facebook logo Google logo Mendeley logo
    • Tweet Widget
    • Facebook Like
    • Google Plus One

    Jump to section

    • Article
      • Abstract
      • Introduction
      • Materials and Methods
      • Results
      • Discussion
      • Disclosure of Potential Conflicts of Interest
      • Disclaimer
      • Authors' Contributions
      • Acknowledgments
      • References
    • Figures & Data
    • Info & Metrics
    • PDF
    Advertisement

    Related Articles

    Cited By...

    More in this TOC Section

    • Early-Life Risk Factors for Breast Cancer
    • Sugary Drink Consumption and Colorectal Cancer Risk
    • HPV Testing in Self-samples and Urine
    Show more Research Articles
    • Home
    • Alerts
    • Feedback
    • Privacy Policy
    Facebook   Twitter   LinkedIn   YouTube   RSS

    Articles

    • Online First
    • Current Issue
    • Past Issues

    Info for

    • Authors
    • Subscribers
    • Advertisers
    • Librarians

    About Cancer Epidemiology, Biomarkers & Prevention

    • About the Journal
    • Editorial Board
    • Permissions
    • Submit a Manuscript
    AACR logo

    Copyright © 2021 by the American Association for Cancer Research.

    Cancer Epidemiology, Biomarkers & Prevention
    eISSN: 1538-7755
    ISSN: 1055-9965

    Advertisement