Background: Human papillomavirus (HPV) vaccination rates in the United States remain low and lag behind other recommended adolescent vaccines. Studies evaluating the association of geographic and area-level characteristics with HPV vaccination rates provide a valuable resource for public health planning.

Method: We used the Rochester Epidemiology Project data linkage system to ascertain HPV vaccination rates between 2010 and 2015 in a 7-county region of southern Minnesota. Geocoded individual patient data were spatially linked to socioeconomic data from the American Community Survey at the census block group level. Bayesian hierarchical logistic regression was used to model incident vaccination rates, adjusting for individual- and area-level sociodemographic characteristics, and geolocation. Geolocation was modeled as an approximated Gaussian field using a Stochastic Partial Differential Equations approach. All models were estimated using Integrated Nested Laplace Approximations.

Results: In adjusted models, increasing age and female sex were associated with increased HPV vaccination. Lower socioeconomic status was associated with decreased rates of initiation [adjusted odds ratio (AOR); 95% confidence interval = 0.90 (0.86–0.95)], completion of the second dose [AOR = 0.88 (0.83–0.93)], and completion of the third dose [AOR = 0.85 (0.80–0.92)]. Geographic spatial analysis demonstrated increased odds of vaccination for the eastern region and in the greater Rochester metropolitan area, showing significant spatial variation not explained by individual level characteristics and ACS block group-level data.

Conclusions: HPV vaccination rates varied geographically and by individual and geographically indexed sociodemographic characteristics.

Impact: Identifying geographic regions with low HPV vaccination rates can help target clinical and community efforts to improve vaccination rates. Cancer Epidemiol Biomarkers Prev; 26(4); 533–40. ©2017 AACR.

See all the articles in this CEBP Focus section, “Geospatial Approaches to Cancer Control and Population Sciences.”

Despite the availability of safe and effective vaccines to prevent human papillomavirus (HPV)-related cancers, a significant proportion of the eligible population remains unvaccinated. National rates of HPV vaccination remain low and lag behind other vaccinations recommended for adolescents (1). Data from the 2015 U.S. National Immunization Survey (NIS-Teen) indicate only small gains in population coverage over prior years, with 62.8% of females ages 13 to 17 years having received the first dose in the 3-dose series, and 41.9% having received 3 or more doses (1). In that same year, among males the same age, only 49.8% had received the first dose and only 28.1% had received 3 or more doses (1).

A growing body of research has identified patient, parental, and health care provider characteristics that are associated with HPV vaccination (2). For example, differences in HPV vaccination initiation and completion rates have been noted by race and socioeconomic status (3–7). Data from NIS-Teen reveal higher rates of the HPV vaccination among Hispanic adolescents compared with non-Hispanic white adolescents, and among adolescents living below the poverty level compared with adolescents living at or above the poverty level (1). NIS-Teen data also indicate higher HPV vaccine rates among non-Hispanic Black and American Indian/Alaska Native adolescents compared with non-Hispanic white adolescents (1). Health care provider recommendation, vaccination reminder/recall systems, and clinician knowledge of HPV vaccination are also associated with higher rates of vaccination (2).

The concept of place has always been considered an important factor in the study of epidemiology dating as far back as the 1800s with the discovery of the transmission of cholera by John Snow (8). The study of place effects on health has recently reemerged in the literature, with significant evidence of the impact that geographic variation has on disease- and health-related behavior (9). Social epidemiologists in particular have routinely used place for studies of socioeconomic status (SES) and health outcomes (10). With the use of more sophisticated geographic methods and multilevel modeling, researchers have elucidated important associations between SES and the context of neighborhoods, leading to a deeper understanding of the causes of social stratification and health disparities (11). As more healthcare systems move toward population health management models, health services researchers have an opportunity to systematically link area-level data to electronic health records (EHR). Prior studies have used this approach to evaluate the impact of geographic or area-level characteristics on HPV vaccination rates (3–7, 12, 13). Identification of geographic variation in HPV vaccination and associated variation in SES can inform health systems and public health practitioners of disparities in healthcare delivery.

To inform local clinical and public health efforts, we examined the association of both individual- and area-level characteristics measured at the census block group level with HPV vaccination rates derived from a population-based medical records data linkage system. Thus, the primary aim of our study was to identify whether individual- and area-level sociodemographic and geographic variation in HPV vaccination rates exists and, if so, ascertain whether geographic variability in rates persists after controlling for sociodemographic characteristics.

We used the Rochester Epidemiology Project (REP) data linkage system to ascertain rates of HPV vaccination between 2010 and 2015 in a 7-county region of southern MN. The REP infrastructure, a data linkage system that captures virtually all healthcare utilization in Olmsted County MN since 1966, has recently expanded to a 27-county region of southern MN and western WI (14–16). The dates of healthcare visits are linked to address information, and this information has been used to define residency at any given point in time (REP Census; ref. 16). We have compared the population counts obtained by the REP Census with the counts obtained by the US Census and found variability across the 27-county region. Specifically, population coverage in the REP compared with the U.S. Census counts varies from 21.4% in Brown County to 99.9% in Olmsted County. The following 7 Minnesota counties have sufficient coverage to ascertain population-based estimates: Wabasha, Olmsted, Waseca, Steele, Freeborn, Dodge, and Mower (Fig. 1); the lowest coverage rate in this 7-county region is 92.0% with an average coverage rate of 98.5 %.

Figure 1.

A visual display of the Minnesota and Wisconsin counties represented in the 27-county expanded REP region. The seven counties included in this study are shaded in green.

Figure 1.

A visual display of the Minnesota and Wisconsin counties represented in the 27-county expanded REP region. The seven counties included in this study are shaded in green.

Close modal

HPV vaccination data

We used REP computer programs to pull all current procedure terminology (CPT) codes corresponding to HPV vaccination (90649, 90650, and 90651) delivered prior to July 1, 2015, to children and adolescents ages 9 to 14 years living in the 7-county region on January 1, 2015 (resident at any time in 2014). Data on HPV vaccinations at all sites were available from 2010 to 2015; therefore, we limited our analysis to those who would have been ages 9 to 14 years to ensure we were able to fully capture their vaccination history because teens older than 14 years may have initiated the vaccine prior to 2010. Vaccine series initiation was defined as having received at least one dose of the HPV vaccine by June 30, 2015. We also assessed receipt of two, three, or more doses of the HPV vaccine with appropriate spacing by June 30, 2015. Appropriate vaccine spacing was defined according to the Advisory Committee on Immunization Practices (ACIP) recommendations that were in place during our study period wherein the second dose must be administered at least 24 days after the first dose and the third at least 12 weeks after the second dose, and at least 24 weeks after the first dose, using the ACIP approved minimal intervals allowing a 4-day grace period for each dose (17–19). Additional individual-level data were also collected on age, sex, and race/ethnicity.

American Community Survey data

Each patient's geolocation (latitude and longitude) was calculated by taking administrative address records and linking them to the TIGER/Line address range shapefile provided by the U.S. Census (20). Geocoded patient data were then spatially joined to census block group allowing the linkage of individual patient records with publicly available data at the census block group level from the American Community Survey (ACS; ref. 18). Using 5-year estimates from the 2014 ACS (2010–2014), we created geographic factors for each census block group in our region to capture area-level estimates of the following: (i) median household income in the past 12 months (in 2014 inflation-adjusted dollars), (ii) proportion of population ages 25 years and older with less than or equal to a high school degree (or equivalent), (iii) proportion of population unemployed 16 years and over in the labor force, (iv) proportion of population on Medicaid/medical assistance, (v) proportion of population living below the poverty level in the past 12 months, (vi) racial composition (proportion of nonwhite), and (vii) block group population density.

Analysis

Descriptive results on individual-level data were summarized with univariate statistics (mean and standard deviation for continuous variables; n and % for categorical variables). Census block group data (ACS) were summarized by presenting n and % of binary cutoffs based on national/state benchmarks. Rates for HPV vaccination were summarized at the individual and area levels. Area-level vaccination rates were estimated by dividing the number of individuals in each block group who received 1, 2, or 3 or more doses of the vaccination series by the study population residing in that block group. Completion rate was calculated as a percentage of total eligible population, not as a percentage of those who initiated, which is often reported. Area-level rates were aggregated by ACS data with benchmark cutoffs.

To assess the spatial variation, the association between neighborhood/area-level effects (block group ACS public data) and individual characteristics, we implemented a multilevel spatial logistic regression model consisting of fixed and random effects with Bayesian inference using Integrated Nested Laplace Approximation (INLA; refs. 21–23). The outcome (1, 2, or 3 or more doses of the HPV vaccination series) was modeled as a binomial response (see Supplementary Appendix for model and computational details). All geographic factors were transformed into census block group ranks and, for purposes of interpretation, modeled to assess the change in initiation and completion of the HPV vaccine series for each quartile increase in the measure. Median income was modeled on a decreasing scale (higher ranks correspond to lower median income) and population density was modeled on a decreasing scale (higher ranks correspond to lower population density). Exploratory factor analysis was used to summarize the six geographic factors. Principal component analysis, with promax rotation, identified two composite factors from the rank-based measures. The first factor corresponded to a set of variables associated with low SES: Low median income, high percent unemployment and high percent non-college education, high Medicaid insurance, and high poverty. The second factor, which was marginally significant, was associated with low population density and high white race, and weakly associated with high non-college education. However, we found population density exhibited nonlinear behavior; to account for this, we categorized block-level population density as a binary variable according to the U.S. Census Bureau definition of urban as population density greater than 1,000 people per square mile (urban) versus the alternative (rural). We included this rural/urban variable and percent non-white individually in our final model rather than the second composite factor. To give a consistent interpretation, the first factor was transformed and modeled into block group ranks and modeled for each quartile increase in the measure. Point estimates of the marginal posterior distributions are presented as odds ratios (OR) with 95% credible intervals (CI; ref. 24).

To visualize the residual spatial variation, the posterior means of the random effects of vaccination (first, second, or third dose) were mapped. The random effects were transformed from the log-odds scale to the odds ratio scale and the maps are interpreted as estimates of the residual spatial variation in the odds of vaccination relative to the overall average odds of vaccination after adjusting for the individual-level and block group-level covariates. All analyses were performed using ArcGIS 10.1 (geocoding and geographic linkage), SAS 9.4 (data cleaning and management), and R version 3.2 (statistical analysis and figure creation). All INLA analyses were performed with the R-INLA package in R (version 0.0-1455098891).

The analysis of existing clinical data through the REP and integration with ACS data was approved by the Mayo Clinic and Olmsted Medical Center IRBs.

Geocoding yielded a 90.8% match rate resulting in a study population of 15,003 residents. Table 1 characterizes the population of children and adolescents ages 9 to 14 years in our region using individual-level data (n = 15,003) derived from their linked electronic medical records, and Table 2 characterizes the public data at the block group level (n = 251) from the ACS. The mean age of our population was 11.7 years; nearly half of the population (48.8%) was female; and the majority of the population (71.1%) was white. Nearly half (48.2%) of the block groups in our region were rural; and 22.7% of block groups had 15% or greater households with incomes below the federal poverty level (FPL).

Table 1.

Baseline data for individual-level characteristics

Individual factorsTotal1st Dose (initiation)2nd Dose3rd Dose
Total, N (%) 15,003 4,066 (27.1%) 2,544 (17.0%) 1,524 (10.1%) 
Mean age (SD) 11.7 (1.3) 12.4 (1.12) 12.5 (1.08) 12.6 (1.04) 
Sex 
 Female 7,315 (48.8%) 2,207 (54.3%) 1,452 (57.1%) 895 (58.7%) 
 Males 7,688 (51.2%) 1,859 (45.7%) 1,092 (42.9%) 629 (41.3%) 
Race/ethnicity 
 White 10,662 (71.1%) 2,925 (71.9%) 1,867 (73.4%) 1,140 (74.8%) 
 Black 1,046 (7.0%) 319 (7.85%) 176 (6.92%) 93 (6.1%) 
 Asian 632 (4.2%) 199 (4.89%) 127 (4.99%) 88 (5.77%) 
 Hispanic 1,427 (9.5%) 350 (8.61%) 217 (8.53%) 120 (7.87%) 
 Other/unknowna 1,236 (8.2%) 273 (6.71%) 157 (6.17%) 83 (5.45%) 
Individual factorsTotal1st Dose (initiation)2nd Dose3rd Dose
Total, N (%) 15,003 4,066 (27.1%) 2,544 (17.0%) 1,524 (10.1%) 
Mean age (SD) 11.7 (1.3) 12.4 (1.12) 12.5 (1.08) 12.6 (1.04) 
Sex 
 Female 7,315 (48.8%) 2,207 (54.3%) 1,452 (57.1%) 895 (58.7%) 
 Males 7,688 (51.2%) 1,859 (45.7%) 1,092 (42.9%) 629 (41.3%) 
Race/ethnicity 
 White 10,662 (71.1%) 2,925 (71.9%) 1,867 (73.4%) 1,140 (74.8%) 
 Black 1,046 (7.0%) 319 (7.85%) 176 (6.92%) 93 (6.1%) 
 Asian 632 (4.2%) 199 (4.89%) 127 (4.99%) 88 (5.77%) 
 Hispanic 1,427 (9.5%) 350 (8.61%) 217 (8.53%) 120 (7.87%) 
 Other/unknowna 1,236 (8.2%) 273 (6.71%) 157 (6.17%) 83 (5.45%) 

aOf the 1,236 patients with other/unknown race, 541 were missing race data.

Table 2.

Baseline data for area-level characteristics (n = 251 block groups)

Block group-level dataTotal, N (%)1st Dose (initiation)a, mean (SD)2nd Dosea, mean (SD)3rd Dosea, mean (SD)
Total 251 24% (12%) 15% (9%) 9% (7%) 
Median income ≥$57,210 126 (50.1%) 27% (11%) 17% (9%) 11% (7%) 
<$57,210 125 (49.9%) 21% (12%) 13% (8%) 7% (6%) 
Unemployed >5% 105 (41.8%) 23% (12%) 14% (9%) 8% (7%) 
≤5% 146 (58.2) 25% (12%) 15% (8%) 9% (6%) 
≤ High school ≥30% 181 (72.1%) 21% (11%) 12% (8%) 7% (6%) 
<30% 70 (27.9%) 34% (9%) 22% (7%) 14% (6%) 
Uninsured ≥10% 64 (25.5%) 22% (12%) 14% (9%) 8% (7%) 
<10% 187 (74.5%) 25% (12%) 15% (9%) 9% (7%) 
Medicaid insured ≥15% 77 (37%) 22% (12%) 13% (9%) 7% (7%) 
<15% 174 (63%) 25% (12%) 16% (9%) 9% (7%) 
Ruralb 121 (48.2%) 23% (12%) 14% (9%) 8% (7%) 
Not rural 130 (51.8%) 25% (12%) 15% (9%) 9% (7%) 
Household income below FPL≥15% 57 (22.7%) 23% (13%) 13% (9%) 7% (7%) 
<15% 194 (77.3%) 25% (12%) 15% (9%) 9% (7%) 
Nonwhite >20% 36 (14.3%) 28% (12%) 17% (8%) 9% (6%) 
≤20% 215 (85.7%) 24% (12%) 14% (9%) 9% (7%) 
Block group-level dataTotal, N (%)1st Dose (initiation)a, mean (SD)2nd Dosea, mean (SD)3rd Dosea, mean (SD)
Total 251 24% (12%) 15% (9%) 9% (7%) 
Median income ≥$57,210 126 (50.1%) 27% (11%) 17% (9%) 11% (7%) 
<$57,210 125 (49.9%) 21% (12%) 13% (8%) 7% (6%) 
Unemployed >5% 105 (41.8%) 23% (12%) 14% (9%) 8% (7%) 
≤5% 146 (58.2) 25% (12%) 15% (8%) 9% (6%) 
≤ High school ≥30% 181 (72.1%) 21% (11%) 12% (8%) 7% (6%) 
<30% 70 (27.9%) 34% (9%) 22% (7%) 14% (6%) 
Uninsured ≥10% 64 (25.5%) 22% (12%) 14% (9%) 8% (7%) 
<10% 187 (74.5%) 25% (12%) 15% (9%) 9% (7%) 
Medicaid insured ≥15% 77 (37%) 22% (12%) 13% (9%) 7% (7%) 
<15% 174 (63%) 25% (12%) 16% (9%) 9% (7%) 
Ruralb 121 (48.2%) 23% (12%) 14% (9%) 8% (7%) 
Not rural 130 (51.8%) 25% (12%) 15% (9%) 9% (7%) 
Household income below FPL≥15% 57 (22.7%) 23% (13%) 13% (9%) 7% (7%) 
<15% 194 (77.3%) 25% (12%) 15% (9%) 9% (7%) 
Nonwhite >20% 36 (14.3%) 28% (12%) 17% (8%) 9% (6%) 
≤20% 215 (85.7%) 24% (12%) 14% (9%) 9% (7%) 

aMean block group rate of HPV vaccination and its SD.

bPopulation density <1,000 people per square mile.

Overall, 4,066 (27.1%) of children and adolescents initiated the vaccine series, 2,544 (17.0%) completed the second dose, and 1,524 (10.1%) completed the third dose (calculated as a percentage of the total population, not just those who initiated). There was variation at the block group level in vaccination rates across the entire region (Fig. 2). The strongest difference in block group vaccination rates across ACS data was found between groups with differences in education levels. Block groups with high levels of less than high school education had lower levels of initiation and completion of the vaccine compared with block groups with lower levels of less than high school education (initiation: 21% vs. 34%; completion 7% vs. 14%). Across the 7 counties, the rate of 1 dose ranged from 11.7% to 33.8%, the rate of completion of the second dose ranged from 6.3% to 22.0%, and the rate of completion of the third dose ranged from 2.5% to 13.7%. Additionally, of the 2,544 children who received a second dose under the ACIP guidelines that were in place during the time of our study, 821 would have met the newly released criteria of being age 9 to 14 years and having at least 5 months between the first and second vaccination.

Figure 2.

The block group-level rates of HPV vaccination across the 27-county expanded REP region. Rates for HPV vaccine initiation and completion represent the number of individuals in each block group who initiated or completed the vaccination series, divided by the corresponding population residing in each block group.

Figure 2.

The block group-level rates of HPV vaccination across the 27-county expanded REP region. Rates for HPV vaccine initiation and completion represent the number of individuals in each block group who initiated or completed the vaccination series, divided by the corresponding population residing in each block group.

Close modal

Results of the multilevel spatial logistic regression model to evaluate factors associated with HPV vaccine initiation are summarized in Table 3. In adjusted models, all of the individual-level characteristics were associated with the vaccination rates. Specifically, increasing age and female sex were associated with increased vaccination rates, while black race was associated with decreased rates of receiving the second and third doses. At the geographic level, many of the variables that indicate low SES were also associated with decreased rates of initiation and completion (Table 3). These variables were combined into a low SES composite score for use in the adjusted models. The lower SES composite score was associated with decreased odds of HPV initiation [adjusted OR (95% credible interval)] = 0.90 (0.86, 0.95), completion of the second dose [AOR = 0.88 (0.83, 0.93)] and completion of the third dose [AOR = 0.85 (0.80, 0.92)]. Finally, we found that living in a rural block group was associated with increased odds of initiation even after adjustment and that increasing % nonwhite population was associated with increased odds of vaccination (Table 3).

Table 3.

Multilevel spatial logistic regression modelsa for HPV vaccination

1st Dose (initiation)2nd Dose3rd Dose
Variable (reference level)Unadjusted OR (95% CI)Adjusted OR (95% CI)b,cUnadjusted OR (95% CI)Adjusted OR (95% CI)b,cUnadjusted OR (95% CI)Adjusted OR (95% CI)b,c
Age 1.89 (1.83–1.96) 1.89 (1.83–1.96) 1.90 (1.83–1.98) 1.91 (1.83–1.98) 2.00 (1.91–2.11) 2.00 (1.90–2.11) 
Sex (male) 
 Female 1.37 (1.27–1.48) 1.41 (1.30–1.53) 1.51 (1.39–1.65) 1.55 (1.42–1.71) 1.59 (1.42–1.77) 1.62 (1.44–1.81) 
Race/ethnicity (white) 
 Black 0.99 (0.86–1.15) 1.01 (0.86–1.19) 0.81 (0.68–0.96) 0.82 (0.68–0.99) 0.70 (0.55–0.88) 0.71 (0.54–0.90) 
 Asian 0.93 (0.78–1.12) 0.94 (0.77–1.13) 0.91 (0.74–1.12) 0.91(0.73–1.13) 1.01 (0.79–1.29) 1.03 (0.78–1.32) 
 Hispanic 0.91 (0.79–1.04) 0.99 (0.86–1.15) 0.89 (0.76–1.04) 0.99 (0.83–1.17) 0.82 (0.67–1.00) 0.90 (0.73–1.11) 
 Other/unknown 0.78 (0.67–0.90) 0.77 (0.66–0.90) 0.71 (0.59–0.85) 0.70 (0.58–0.85) 0.64 (0.50–0.81) 0.64 (0.50–0.82) 
Block-level variables 
 Decreasing Median Incomed 0.91 (0.88–0.95) — 0.88 (0.84–0.92) — 0.83 (0.79–0.88) — 
 % Unemployedd 0.99 (0.96–1.03) — 1.00 (0.96–0.92) — 1.00 (0.94–1.06) — 
 % with ≤ high school educationd 0.89 (0.84–0.93) — 0.86 (0.81–0.90) — 0.81 (0.75–0.87) — 
 % Uninsuredd 0.93 (0.90–0.97) — 0.93 (0.89–0.97) — 0.92 (0.87–0.98) — 
 % Medicaid insuredd 0.95 (0.92–0.99) — 0.92 (0.88–0.96) — 0.90 (0.86–0.95) — 
 % with household income in povertyd 0.96 (0.92–.99) — 0.93 (0.89–0.97) — 0.90 (0.86–0.95) — 
 Low SES composite factord 0.92 (0.89–0.95) 0.90 (0.86–0.95) 0.90 (0.86–0.93) 0.88 (0.83–0.93) 0.86 (0.81–0.91) 0.85 (0.80–0.92) 
 Rural status (urban) e 1.15 (1.04–1.27) 1.12 (1.01–1.24) 1.17 (1.05–1.30) 1.11 (0.99–1.24) 1.21 (1.03–1.40) 1.14 (0.98–1.32) 
 % Nonwhited 1.01 (0.97–1.06) 1.09 (1.03–1.15) 1.02 (0.97–1.08) 1.13 (1.06–1.20) 1.02 (0.95–1.10) 1.14 (1.05–1.24) 
1st Dose (initiation)2nd Dose3rd Dose
Variable (reference level)Unadjusted OR (95% CI)Adjusted OR (95% CI)b,cUnadjusted OR (95% CI)Adjusted OR (95% CI)b,cUnadjusted OR (95% CI)Adjusted OR (95% CI)b,c
Age 1.89 (1.83–1.96) 1.89 (1.83–1.96) 1.90 (1.83–1.98) 1.91 (1.83–1.98) 2.00 (1.91–2.11) 2.00 (1.90–2.11) 
Sex (male) 
 Female 1.37 (1.27–1.48) 1.41 (1.30–1.53) 1.51 (1.39–1.65) 1.55 (1.42–1.71) 1.59 (1.42–1.77) 1.62 (1.44–1.81) 
Race/ethnicity (white) 
 Black 0.99 (0.86–1.15) 1.01 (0.86–1.19) 0.81 (0.68–0.96) 0.82 (0.68–0.99) 0.70 (0.55–0.88) 0.71 (0.54–0.90) 
 Asian 0.93 (0.78–1.12) 0.94 (0.77–1.13) 0.91 (0.74–1.12) 0.91(0.73–1.13) 1.01 (0.79–1.29) 1.03 (0.78–1.32) 
 Hispanic 0.91 (0.79–1.04) 0.99 (0.86–1.15) 0.89 (0.76–1.04) 0.99 (0.83–1.17) 0.82 (0.67–1.00) 0.90 (0.73–1.11) 
 Other/unknown 0.78 (0.67–0.90) 0.77 (0.66–0.90) 0.71 (0.59–0.85) 0.70 (0.58–0.85) 0.64 (0.50–0.81) 0.64 (0.50–0.82) 
Block-level variables 
 Decreasing Median Incomed 0.91 (0.88–0.95) — 0.88 (0.84–0.92) — 0.83 (0.79–0.88) — 
 % Unemployedd 0.99 (0.96–1.03) — 1.00 (0.96–0.92) — 1.00 (0.94–1.06) — 
 % with ≤ high school educationd 0.89 (0.84–0.93) — 0.86 (0.81–0.90) — 0.81 (0.75–0.87) — 
 % Uninsuredd 0.93 (0.90–0.97) — 0.93 (0.89–0.97) — 0.92 (0.87–0.98) — 
 % Medicaid insuredd 0.95 (0.92–0.99) — 0.92 (0.88–0.96) — 0.90 (0.86–0.95) — 
 % with household income in povertyd 0.96 (0.92–.99) — 0.93 (0.89–0.97) — 0.90 (0.86–0.95) — 
 Low SES composite factord 0.92 (0.89–0.95) 0.90 (0.86–0.95) 0.90 (0.86–0.93) 0.88 (0.83–0.93) 0.86 (0.81–0.91) 0.85 (0.80–0.92) 
 Rural status (urban) e 1.15 (1.04–1.27) 1.12 (1.01–1.24) 1.17 (1.05–1.30) 1.11 (0.99–1.24) 1.21 (1.03–1.40) 1.14 (0.98–1.32) 
 % Nonwhited 1.01 (0.97–1.06) 1.09 (1.03–1.15) 1.02 (0.97–1.08) 1.13 (1.06–1.20) 1.02 (0.95–1.10) 1.14 (1.05–1.24) 

Abbreviation: CI, confidence interval.

aBayesian spatial logistic model modeling log odds of initiating the HPV vaccination series.

bPoint estimates of the marginal posterior distribution– presented as ORs and 95% CIs.

cAdjusted for age, sex, race, low SES, rural status, and % nonwhite.

dORs represent the change in HPV vaccine initiation/completion for each quartile increase in the measure unless otherwise specified as a decreasing measure.

ePopulation density <1,000 people per square mile.

Figure 3 displays the spatial variation of vaccination rates across the 7-county region, representing the odds of vaccination relative to the overall average odds of vaccination after adjustment for the individual-level and block group-level covariates. Residual spatial variation, beyond what was explained by the individual factors and ACS block group-level factors, was observed. The increased odds of vaccination were observed for the eastern counties and clustered around larger cities, showing large spatial variation not explained by individual-level characteristics and ACS block group-level data.

Figure 3.

Estimates from the posterior means of the random effects (⁠|{{{\bf \xi }}_i}$|⁠) of initiation and completion of the second and third dose of the HPV vaccine series. The random effects were transformed from the log-odds scale to the OR scale and can be interpreted as an estimate of the spatial variation in the odds of initiation or completion relative to the overall average odds of initiation or completion even after adjusting for the individual-level and block group-level covariates.

Figure 3.

Estimates from the posterior means of the random effects (⁠|{{{\bf \xi }}_i}$|⁠) of initiation and completion of the second and third dose of the HPV vaccine series. The random effects were transformed from the log-odds scale to the OR scale and can be interpreted as an estimate of the spatial variation in the odds of initiation or completion relative to the overall average odds of initiation or completion even after adjusting for the individual-level and block group-level covariates.

Close modal

Using patient-level data geocode matched to publicly available data from the ACS, we characterized HPV vaccination initiation and completion rates following a fixed cohort of adolescents eligible for the HPV vaccination and identified sociodemographic and geographic variation in incident vaccination rates. As expected, observed rates of incident vaccination among this eligible cohort were lower than national prevalence rates reported from NIS-Teen data (1). Additionally, the lower rates of vaccination observed in our cohort are likely a result of our focus on a slightly younger age group (9–14 years) compared with NIS-Teen (13–17 years).

Consistent with national estimates, we observed a greater likelihood of vaccination among females compared with males (1). The higher rates observed among females is not surprising, given that the HPV vaccine was initially recommended in 2007 for females with subsequent marketing to females (25). The vaccine was not recommended to boys until the end of 2011 (25). Poor uptake among females and evolving science supporting the recommendation for males led to more recent marketing efforts emphasizing the cancer risks for males and promoting vaccination for males which may have an impact on uptake (25). Research is encouraged to track trends in HPV vaccination by sex and to evaluate efforts to promote adoption of the vaccine by males.

We also observed a greater likelihood of vaccination among older compared with younger adolescents. This finding may be driven, at least in part, by our inclusion of 9- and 10-year-olds in our analyses. Recommendations from ACIP for HPV vaccination include permissive language for offering the vaccine to children as young as 9 years of age (25). In prior research, we identified initiation and completion of the HPV vaccine among patients as young as 9 years of age in our region as well as a greater likelihood of on-time (by 13.5 years) and timely (by 15 years of age) HPV vaccine series completion among patients who initiated the series at a younger age (26). This research, coupled with evidence of superior immune response to the HPV vaccine in younger children (27–29), led to a clinical practice change in 2014 for much of the region; specifically, a recommendation was put forth within the clinical practices in our catchment region to offer the HPV vaccine starting at age 9. The Rochester region had been practicing routine initiation of the 3 dose series at 9 years of age since 2006. Thus, 9- and 10-year-olds were included in analyses to ensure complete capture of the relevant population.

Lower vaccination rates were found in urban areas, but we found that this was attenuated when other factors were taken into account. Although seemingly counterintuitive given the residual spatial variation and block group rates showing greater vaccination in the greater Rochester metropolitan area, two considerations are important to note: First, we found that in Olmsted county the highest rates of vaccination tended to be in the areas, although technically labeled as rural, near city central whereas lower rates were observed in the city center. Second, areas of urban crowding were associated with lower SES as well. Given the population distribution of our region, we were not able to effectively model a suburban type model based on population density alone, indicating that our rural variable contains elements of suburban and rural residents.

Contrary to recently published NIS-Teen data (1), we did not observe higher rates of vaccination among Hispanics and blacks in our population. In fact, we observed significantly lower rates of completion among blacks, compared with whites. Surprisingly, however, after adjusting for all individual- and block-level characteristics, block areas with higher percentages of nonwhite residents had higher HPV vaccination rates than areas with lower levels of nonwhite residents. This seeming contradiction in our area-level association was explained largely by the greater Rochester Metropolitan area. Adjusted for all other factors, this area tended to have block groups with higher levels of nonwhite residents.

Examination of the block group-level rates of vaccination and the modeled residual spatial random effect conveys large-scale differences by geographic location in HPV vaccination. With the model, there was up to 3 times greater likelihood of vaccination in the Rochester metropolitan region radiating out to the more suburban and rural areas within the eastern half of the region. The western region, however, which tended to have smaller and less racially and ethnically diverse populations, had lower initiation and completion rates.

In our geographic region, we were able to uncover substantial regional variation in HPV vaccination that was not completely explained by data routinely collected in the electronic health record (EHR). In a recent report, the Institute of Medicine stressed the importance of integrating social and behavioral information with data available through the EHR as a means to inform population health management efforts, identify more effective treatments for individuals, and link social factors to disease processes, access, utilization, and quality of life (30). Given the relative paucity of high-quality self-reported data in the EHR, publicly available geocoded data from the ACS could provide benefits to healthcare delivery systems through identification of populations at risk.

A unique contribution of our analysis to the existing literature is in our linkage and simultaneous examination of the impact of individual-level variables collected through administrative data and area-level socioeconomic variables collected through large-scale publicly available survey data in a well-defined fixed cohort representative of the source population. This approach further underscores the importance of place in determining health outcomes. We found our composite, area-level measure of socioeconomic status to be significantly associated with vaccination, even after controlling for individual-level variables known to be associated with vaccination. We observed that children and adolescents who lived in areas of low SES were less likely to get vaccinated. This finding is counter to recently published data from NIS-Teen data that revealed higher rates of HPV vaccine series completion among adolescents living below poverty compared with those living above poverty (13). Considerable variation in the association between HPV vaccination rates and socioeconomic status has been observed in prior research (3–7).

Several factors may influence observed associations between socioeconomic status and HPV vaccination; in particular, we found key differences centered on the measurement of SES and the geographic unit of analysis. There is also variation in how socioeconomic status is defined and measured across studies. In our study, we used a composite measure that included median income, percent unemployment, education, Medicaid insurance status and poverty metrics to capture overall socioeconomic status. Prior studies have examined some of these variables individually, but not as a composite measure, which may account for observed differences in our study and prior studies. Furthermore, while several prior studies use survey sampling methods to estimate the association between SES and prevalent HPV vaccination, we estimated HPV vaccination incidence in a well-defined fixed cohort representative of the source population using administrative data. In a recent analysis, Boakye and colleagues found good concordance between parent self-report and provider records for HPV vaccination (7). However, the effects of non-response bias, recall bias, length of time from vaccination until survey administration, survey mode and social desirability bias may still play a role in estimating HPV vaccination where the usage of administrative data minimizes this bias (7). Chao and colleagues conducted a study similar to our own in a Health Maintenance Organization population of females 9 to 26 and found a positive association between neighborhood income levels and rates of HPV vaccination (3).

Another factor that may influence the observed association between socioeconomic status and HPV vaccination is the unit of analysis or geographic area of analysis. A dramatic example of this comes from Pruitt and Schootman's assessment of HPV vaccination prevalence at the county and state levels using data from the Behavioral Risk Factor Surveillance System and the U.S. Census; this analysis simultaneously revealed a negative association between poverty and vaccination rates at the state level and a positive association between poverty and vaccination rates at the county level. The authors suggest that greater allocation of resources at the county level through the vaccine for children program may have led to the association between greater poverty and higher vaccination rates observed at the county level. This phenomenon for differences observed when conducting analyses at varying geographic levels is referred to as the modifiable area unit problem (MAUP) wherein inferences drawn from data aggregated to a particular geographic region may change when the same data is aggregated to different geographic parameters (31). Krieger and colleagues have demonstrated MAUP by comparing data of SES and mortality aggregated at the block group, tract, and the zip code (32). Specifically, they demonstrated that SES gradients were detected at the block group and tract where zip code measures for several outcomes detected no association or associations counter to what was found at the lower levels of geography.

Identification of area-level factors associated with lower levels of HPV vaccination can inform efforts to target community and clinical interventions to improve access in areas characterized by greater need. Furthermore, by using spatial models, we were able to find areas of relatively lower odds of HPV vaccination not explained by demographics or measured area-level factors. Understanding the spatial distribution of vaccination patterns can inform efforts to target clinical sites within the geographic regions with lower than average odds of HPV vaccination to better understand current practices and opportunities for clinical and community interventions.

Potential limitations of our study include lack of self-reported data on education, employment status, and insurance status, which tend not to be easily accessible in administrative data of primary care clinics. However, we were able to pull census block group-level data to capture additional measures of socioeconomic status as measures of “place” to ascertain the impact of place on health-related behavior. This conceptualization guards against the risk of ecological fallacy. We were not able to capture access to primary care at either the area level or individual level. However, public data available from the Behavioral Risk Factor Surveillance System suggest that at least among adults, there is limited variability in access to primary care across the 7 counties. Furthermore, to be included in the REP, each person must have a medical record in at least one of the participating clinical entities, ensuring some basic level of access across our cohort.

Data on HPV vaccinations at all sites was available only from 2010 to 2015; therefore, we limited our analysis to those ages 9 to 14 years to ensure adequate capture of their vaccination history. Furthermore, the majority of clinical practices contributing data to our analyses began offering the HPV vaccine to boys in May 2010; however, consistent recommendations for routine vaccination for eligible males across all participating sites did not occur until after the publication of the ACIP recommendation in December of 2011. However, we adjust for sex in our analysis and follow a fixed cohort of eligible patients over time so the impact of differences in recommendations for males and females on our results is likely minimal.

Patients whose addresses could not be geocoded but whose county was known (n = 1,529, 9.25%) were more likely to not to reside in the most populous county of Olmsted and the greater Rochester Metropolitan area. However, as a sensitivity analysis, we modeled whether a patient was more likely to get vaccinated given they were geocoded adjusting for their county of residence; we found no differences in HPV vaccination, indicating that geocoded patients were representative of other patients residing in the same county. Lastly, estimates from the ACS have sampling error and therefore our quartile measures are subject to measurement error. However, we ran a Monte Carlo simulation (results not shown) on the ACS variables assessing the association with HPV (initiation or completion). We found very little variation (typically 3%–5%) across the simulations with no differences in statistical significance, making our method of ranking and factor analysis robust to measurement error.

Despite these limitations, this work will inform our efforts to improve HPV vaccination rates by identifying populations and geographic areas in our health system's catchment region that may benefit most from implementation of evidence-based strategies to increase acceptance of HPV vaccine by parents and adolescents, improve access to the HPV vaccine, and reduce missed clinical opportunities to vaccinate. This work also serves as a model for other health systems to evaluate delivery of preventive services, such as HPV vaccination, within the geographic regions that they serve. By assessing geographic variation, identifying disparities, and considering the neighborhood context in which patients develop disease and utilize healthcare, health systems can conceptualize and implement interventions with a multilevel approach for better individual and population health.

R.M. Jacobson reports other commercial research support from Safety Review Committee, Merck & Co., HPV vaccine post-licensure study. No potential conflicts of interest were disclosed by the other authors.

Conception and design: L.J. Finney Rutten, P.M. Wilson, R.M. Jacobson, J.L. St. Sauver

Development of methodology: L.J. Finney Rutten, P.M. Wilson, R.M. Jacobson, J.L. St. Sauver

Acquisition of data (provided animals, acquired and managed patients, provided facilities, etc.): D.J. Jacobson, R.M. Jacobson

Analysis and interpretation of data (e.g., statistical analysis, biostatistics, computational analysis): L.J. Finney Rutten, P.M. Wilson, D.J. Jacobson, R.M. Jacobson, J.L. St. Sauver

Writing, review, and/or revision of the manuscript: L.J. Finney Rutten, P.M. Wilson, D.J. Jacobson, A.A. Agunwamba, C. Radecki Breitkopf, R.M. Jacobson, J.L. St. Sauver

Administrative, technical, or material support (i.e., reporting or organizing data, constructing databases): P.M. Wilson, D.J. Jacobson

Study supervision: L.J. Finney Rutten

1.
Reagan-Steiner
S
,
Yankey
D
,
Jeyarajah
J
,
Elam-Evans
LD
,
Curtis
CR
,
MacNeil
J
, et al
National, regional, state, and selected local area vaccination coverage among adolescents aged 13–17 years - United States, 2015
.
MMWR Morb Mortal Wkly Rep
2016
;
65
:
850
8
.
2.
Holman
DM
,
Benard
V
,
Roland
KB
,
Watson
M
,
Liddon
N
,
Stokley
S
. 
Barriers to human papillomavirus vaccination among US adolescents: a systematic review of the literature
.
JAMA Pediatr
2014
;
168
:
76
82
.
3.
Chao
C
,
Velicer
C
,
Slezak
JM
,
Jacobsen
SJ
. 
Correlates for human papillomavirus vaccination of adolescent girls and young women in a managed care organization
.
Am J Epidemiol
2010
;
171
:
357
67
.
4.
Tsui
J
,
Gee
GC
,
Rodriguez
HP
,
Kominski
GF
,
Glenn
BA
,
Singhal
R
, et al
Exploring the role of neighborhood socio-demographic factors on HPV vaccine initiation among low-income, ethnic minority girls
.
J Immigr Minor Health
2013
;
15
:
732
40
.
5.
Pruitt
SL
,
Schootman
M
. 
Geographic disparity, area poverty, and human papillomavirus vaccination
.
Am J Prev Med
2010
;
38
:
525
33
.
6.
Trogdon
JG
,
Ahn
T
. 
Geospatial patterns in human papillomavirus vaccination uptake: evidence from uninsured and publicly insured children in North Carolina
.
Cancer Epidemiol Biomarkers Prev
2015
;
24
:
595
602
.
7.
Adjei Boakye
E
,
Tobo
BB
,
Osazuwa-Peters
N
,
Mohammed
KA
,
Geneus
CJ
,
Schootman
M
. 
A comparison of parent- and provider-reported human papillomavirus vaccination of adolescents
.
Am J Prev Med
2016
Nov 24. [Epub ahead of print]
.
8.
Snow
J
. 
On the mode of communication of cholera
.
London, United Kingdom
:
John Churchill
; 
1855
.
9.
Auchincloss
AH
,
Gebreab
SY
,
Mair
C
,
Diez Roux
AV
. 
A review of spatial methods in epidemiology, 2000–2010
.
Annu Rev Public Health
2012
;
33
:
107
22
.
10.
Krieger
N
. 
Historical roots of social epidemiology: socioeconomic gradients in health and contextual analysis
.
Int J Epidemiol
2001
;
30
:
899
900
.
11.
Roux
AVD
,
Mair
C
. 
Neighborhoods and health
.
Biol Disadv
2010
;
1186
:
125
45
.
12.
Nelson
EJ
,
Hughes
J
,
Oakes
JM
,
Pankow
JS
,
Kulasingam
SL
. 
Geospatial patterns of human papillomavirus vaccine uptake in Minnesota
.
BMJ Open
2015
;
5
:
e008617
.
13.
Henry
KA
,
Stroup
AM
,
Warner
EL
,
Kepka
D
. 
Geographic factors and human papillomavirus (HPV) vaccination Initiation among adolescent girls in the United States
.
Cancer Epidemiol Biomarkers Prev
2016
;
25
:
309
17
.
14.
Kurland
LT
,
Molgaard
CA
. 
The patient record in epidemiology
.
Sci Am
1981
;
245
:
54
63
.
15.
Melton
LJ
 III
. 
History of the rochester epidemiology project
.
Mayo Clin Pro
1996
;
71
:
266
74
.
16.
St. Sauver
JL
,
Grossardt
BR
,
Yawn
BP
,
Meton
LJ
,
Rocca
WA
. 
Using a medical records-linkage system to enumerate a dynamic population over time: the Rochester Epidemiology Project
.
Am J Epidemiol
2011
;
173
:
1059
68
.
17.
Centers for Disease Control and Prevention (CDC)
. 
FDA licensure of bivalent human papillomavirus vaccine (HPV2, Cervarix) for use in females and updated HPV vaccination recommendations from the advisory committee on immunization practices (ACIP)
.
MMWR Morb Mortal Wkly Rep
2010
;
59
:
626
9
.
18.
Reagan-Steiner
S
,
Yankey
D
,
Jeyarajah
J
,
Elam-Evans
LD
,
Singleton
JA
,
Curtis
CR
, et al
National, regional, state, and selected local area vaccination coverage among adolescents aged 13-17 Years–United States, 2014
.
MMWR Morb Mortal Wkly Rep
2015
;
64
:
784
92
.
19.
Centers for Disease Control and Prevention (CDC)
. 
Human papillomavirus vaccination coverage among adolescent girls, 2007-2012, and postlicensure vaccine safety monitoring, 2006-2013 - United States
.
MMWR Morb Mortal Wkly Rep
2013
;
62
:
591
5
.
20.
United States Census Bureau
.
TIGER/Line shapefiles 2014 technical documentation
.
Available from
: https://www2.census.gov/geo/pdfs/maps-data/data/tiger/tgrshp2014/TGRSHP2014_TechDoc.pdf/.
21.
Lindgren
F
,
Rue
H
. 
Bayesian spatial modelling with R-INLA
.
J Stat Soft
2015
;
63
:
1
25
.
22.
Lindgren
F
,
Rue
H
,
Lindstrom
J
. 
An explicit link between Gaussian fields and Gaussian Markov random fields: the SPDE approach (with discussion)
.
J Royal Statist Soc
2011
;
73
:
423
98
.
23.
Rue
H
,
Martino
S
,
Chopin
N
. 
Approximate bayesian inference for latent Gaussian models using integrated nested Laplace approximations (with discussion)
.
J Royal Stat Soc
2009
;
71
:
319
92
.
24.
Bolstad
WM
.
Introduction to Bayesian Statistics
.
Hoboken, NJ
:
John Wiley & Sons, Inc
; 
2004
.
25.
Markowitz
LE
,
Dunne
EF
,
Saraiya
M
,
Lawson
HW
,
Chesson
H
,
Unger
ER
. 
Quadrivalent human papillomavirus vaccine: recommendations of the advisory committee on immunization practices (ACIP)
.
MMWR Morb Mortal Wkly Rep
2007
;
56
:
1
24
.
26.
St Sauver
JL
,
Rutten
LJ
,
Ebbert
JO
,
Jacobson
DJ
,
McGree
ME
,
Jacobson
RM
. 
Younger age at initiation of the human papillomavirus (HPV) vaccination series is associated with higher rates of on-time completion
.
Prev Med
2016
;
89
:
327
33
.
27.
Block
SL
,
Nolan
T
,
Sattler
C
,
Barr
E
,
Giacoletti
KE
,
Marchant
CD
, et al
Comparison of the immunogenicity and reactogenicity of a prophylactic quadrivalent human papillomavirus (types 6, 11, 16, and 18) L1 virus-like particle vaccine in male and female adolescents and young adult women
.
Pediatrics
2006
;
118
:
2135
45
.
28.
Giuliano
AR
,
Lazcano-Ponce
E
,
Villa
L
,
Nolan
T
,
Marchant
C
,
Radley
D
, et al
Impact of baseline covariates on the immunogenicity of a quadrivalent (types 6, 11, 16, and 18) human papillomavirus virus-like-particle vaccine
.
J Infect Dis
2007
;
196
:
1153
62
.
29.
Reisinger
KS
,
Block
SL
,
Lazcano-Ponce
E
,
Samakoses
R
,
Esser
MT
,
Erick
J
, et al
Safety and persistent immunogenicity of a quadrivalent human papillomavirus types 6, 11, 16, 18 L1 virus-like particle vaccine in preadolescents and adolescents: a randomized controlled trial
.
Pediatr Infect Dis J
2007
;
26
:
201
9
.
30.
Institute of Medicine
.
Capturing social and behavioral domains and measures in electronic health records: phase 2.
Washington, DC
:
The National Academies Press
; 
2014
.
31.
Waller
LA
,
Gotway
CA
.
Applied Spatial Statistics for Public Health Data
.
Hoboken, NJ
:
John Wiley & Sons, Inc.
; 
2004
.
32.
Krieger
N
,
Chen
JT
,
Waterman
PD
,
Soobader
MJ
,
Subramanian
SV
,
Carson
R
. 
Geocoding and monitoring of US socioeconomic inequalities in mortality and cancer incidence: does the choice of area-based measure and geographic level matter? The Public Health Disparities Geocoding Project
.
Am J Epidemiol
2002
;
156
:
471
82
.