CEBP Meeting Calendar Advances in Breast Cancer Research
HOME HELP FEEDBACK SUBSCRIPTIONS ARCHIVE SEARCH TABLE OF CONTENTS
Cancer Research Clinical Cancer Research
Cancer Epidemiology Biomarkers & Prevention Molecular Cancer Therapeutics
Molecular Cancer Research Cancer Prevention Research
Cancer Prevention Journals Portal Cancer Reviews Online
Annual Meeting Education Book Meeting Abstracts Online

Cancer Epidemiology Biomarkers & Prevention 16, 2118, October 1, 2007. doi: 10.1158/1055-9965.EPI-07-0123
© 2007 American Association for Cancer Research

This Article
Right arrow Abstract Freely available
Right arrow Full Text (PDF)
Right arrow Alert me when this article is cited
Right arrow Alert me if a correction is posted
Services
Right arrow Similar articles in this journal
Right arrow Similar articles in PubMed
Right arrow Alert me to new issues of the journal
Right arrow Download to citation manager
Right arrow reprints & permissions
Citing Articles
Right arrow Citing Articles via HighWire
Right arrow Citing Articles via Google Scholar
Google Scholar
Right arrow Articles by Schenck, A. P.
Right arrow Articles by Ransohoff, D. F.
Right arrow Search for Related Content
PubMed
Right arrow PubMed Citation
Right arrow Articles by Schenck, A. P.
Right arrow Articles by Ransohoff, D. F.
Related Collections
Right arrow Behavioral Science
Right arrow Behavioral Science: Interventions: Behavioral, Pharmacologic, Pharmacogenetic

Data Sources for Measuring Colorectal Endoscopy Use Among Medicare Enrollees

Anna P. Schenck1, Carrie N. Klabunde2, Joan L. Warren2, Sharon Peacock1, William W. Davis3, Sarah T. Hawley4, Michael Pignone5 and David F. Ransohoff6

1 The Carolinas Center for Medical Excellence, Cary, North Carolina; 2 Health Services and Economics Branch, Applied Research Program, Division of Cancer Control and Population Sciences, National Cancer Institute, Bethesda, Maryland; 3 Statistical Research and Applications Branch, Surveillance Research Program, Division of Cancer Control and Population Sciences, National Cancer Institute, Rockville, Maryland; 4 Division of General Medicine, University of Michigan, Ann Arbor, Michigan; 5 Department of Medicine and Cecil Sheps Center for Health Services Research and 6 Departments of Medicine and Epidemiology, University of North Carolina at Chapel Hill, Chapel Hill, North Carolina

Requests for reprints: Anna P. Schenck, The Carolinas Center for Medical Excellence, 100 Regency Forest, Suite 200, Cary, NC 27511-8598. Phone: 919 380-9860; Fax: 919-380-7637. E-mail: aschenck{at}ncqio.sdps.org


    Abstract
 Top
 Abstract
 Background
 Materials and Methods
 Results
 Discussion
 Appendix. Identification of...
 References
 
Background: Estimates of colorectal cancer test use vary widely by data source. Medicare claims offer one source for monitoring test use, but their utility has not been validated. We compared ascertainment of sigmoidoscopy and colonoscopy between three data sources: self reports, Medicare claims, and medical records.

Materials and Methods: The study population included Medicare enrollees residing in North Carolina (n = 561) who had participated in a telephone survey on colorectal cancer tests. Medicare claims were obtained for the 5 years preceding the survey (January 1, 1998 to December 31, 2002). Information about sigmoidoscopy and colonoscopy procedures conducted in physician offices were abstracted from medical records. Sensitivity, specificity, positive predictive value, negative predictive value, agreement, and {kappa} statistics were calculated using the medical record as the gold standard. Agreement on specific procedure type and purpose was also assessed.

Results: Agreement between claim and medical record regarding whether an endoscopic procedure had been done was high (over 90%). Agreement between self report and medical record and between self report and claim was good (79% and 74%, respectively). All three data sources adequately distinguished the type of procedure done. None of the data sources showed reliable levels of agreement regarding procedure purpose (screening or diagnostic).

Conclusion: Medicare claims can provide accurate information on whether a patient has undergone colorectal endoscopy and may be more complete than physician medical records. Medicare claims cannot be used to distinguish screening from diagnostic tests. Recognizing this limitation, researchers who use Medicare claims to assess rates of colorectal testing should include both screening and diagnostic endoscopy procedures in their analyses. (Cancer Epidemiol Biomarkers Prev 2007;16(10):2118–27)


    Background
 Top
 Abstract
 Background
 Materials and Methods
 Results
 Discussion
 Appendix. Identification of...
 References
 
Colorectal cancer is a leading cause of cancer hospitalization in the Medicare population, creating a substantial burden on the Medicare program (1). Effective screening modalities that may lead to prevention of colorectal cancer through excision of adenomas exist (2, 3). Since 1998, Medicare has covered colorectal cancer screening as a benefit for enrollees 50 years and older. Yet, studies show that colorectal cancer screening rates in the United States, including among Medicare beneficiaries, are low. However, exactly how low depends on the data source used to measure them (4-8).

Accurate measurement of colorectal cancer screening would enhance the ability of health professionals, policy makers, and researchers to monitor adherence with guidelines and better target and evaluate intervention efforts. There is a lack of agreement as to the ideal data source for assessing colorectal cancer screening. On the one hand, there is evidence that rates based on self-reported sigmoidoscopy (9-11) and colonoscopy (9) overestimate screening use relative to medical records. Other studies, however, have shown self reports to produce accurate recall of sigmoidoscopy (12, 13) and colonoscopy test use (12). Similarly, although medical records are considered by many to provide the "gold standard" for measuring care, procedures may be missing from the medical record if they were conducted outside of the ordering physician's office (9), were misfiled, or were poorly documented (14). Administrative claims data may overestimate or underestimate test use, depending on whether diagnostic or screening tests are included and how a screening test is defined (15). Although prior studies have reported colorectal cancer test rates from Medicare claims (16-18), the use of claims to measure colorectal cancer screening is challenging (15) and their accuracy as a data source for measuring colorectal cancer test use in the Medicare population has not been documented. One recent study found high concordance between administrative data and medical records for colonoscopy, but Medicare claims were not assessed (14). Moreover, previous studies have found Medicare claims to underestimate mammography tests (19, 20).

Additional challenges in measuring colorectal cancer screening are presented by the variety of tests available, each with different recommended intervals for repeating the test. In a given population, it is impossible to determine whether people have been screened according to guidelines if there is confusion about whether a person had a sigmoidoscopy, which should be repeated every 5 years, or a colonoscopy, which should be repeated every 10 years. Similarly, if there is confusion about whether a test was conducted for diagnostic or screening purposes, measurement of the effectiveness of policy changes or interventions to increase screening will be less than precise.

In this study, we compare the use of colorectal endoscopy (i.e., sigmoidoscopy and colonoscopy) ascertained by three data sources: self reports, Medicare claims, and medical records. Although we were interested in the ability of each data source to precisely capture the occurrence of a procedure, the primary aim of this study was to assess the validity of Medicare claims for measuring colorectal endoscopy use. In addition, we examine the ability of these data sources to accurately distinguish the type (i.e., sigmoidoscopy versus colonoscopy) and purpose (i.e., screening versus diagnostic) of the procedure done.


    Materials and Methods
 Top
 Abstract
 Background
 Materials and Methods
 Results
 Discussion
 Appendix. Identification of...
 References
 
This study uses data collected by The Carolinas Center for Medical Excellence, the Quality Improvement Organization for Medicare in North and South Carolina. The study was conducted under the statutory authority (42 CFR part 480) of the Medicare Health Care Quality Improvement Program and used accepted procedures for the confidential treatment of personal health information (21). In 2000, The Carolinas Center for Medical Excellence was funded by the Centers for Medicare and Medicaid Services to develop and evaluate interventions designed to increase colorectal cancer test use among Medicare enrollees. The National Cancer Institute provided additional funding to support evaluation of the interventions. Telephone surveys were conducted in 2001 and 2002 with samples of Medicare enrollees in North and South Carolina as part of the evaluation. A summary of the interventions and findings, as well as both survey instruments, can be found at The Carolinas Center for Medical Excellence site.7

Population
The eligible population for the validation study were the North Carolina respondents to the 2002 survey. The group included African American and White Fee for Service Medicare enrollees between 50 and 80 years who resided in any of 10 urban counties in North Carolina. Figure 1 summarizes the steps used to create the study sample. Survey respondents (n = 1001) had been randomly selected from two subgroups: individuals who had received selected mailings encouraging them to be tested for colorectal cancer and individuals who were not sent these mailings. We limited inclusion in the validation study to survey respondents without prior colorectal cancer who were between 55 and 80 years at the time of the survey. This step ensured eligibility for colorectal cancer screening during a 5-year look-back period. To facilitate inclusion of information from medical records, eligible participants were also restricted to those for whom a treating physician could be identified, either from Medicare claims or the survey (n = 877).


Figure 1
View larger version (13K):
[in this window]
[in a new window]
[Download PPT slide]
 
Figure 1. Selection of study population for validation study of colorectal cancer endoscopy in the Medicare population.

 
For the 877 eligible persons, their Medicare claims for colorectal cancer tests and self-reported test use were examined to determine "presumptive" testing status. Respondents were "presumed" tested if they had a claim for a sigmoidoscopy or colonoscopy or a self report of either test within the previous 2 years. We stratified our study group on presumptive test status in an attempt to increase the likelihood of obtaining medical records with testing information. We used a 2-year window for the stratification in recognition of the potential for recall bias on the part of survey respondents. The potential study population included 574 Medicare enrollees with evidence of prior testing and 303 enrollees without recent testing. To achieve a desired final sample size of 500 enrollees with prior tests and 100 without, we selected 100% of respondents presumed tested and a sample of respondents (n = 120) without evidence of a test. Medical records were accessed and abstracted for 88% of the sample (n = 609). Reasons why records were not abstracted included physician retirement or death, absence of the patient's record in the office, and physician refusal. Study participants were required to have continuous enrollment in Medicare parts A and B and no health maintenance organization enrollment from entry into Medicare until death or the end of the study window, defined as January 1, 1998 to December 31, 2002, yielding a final study group of 561 Medicare enrollees.

Data Sources
We assessed three data sources: self report from the telephone survey, Medicare data, and medical records. A brief description of each follows.

Telephone Survey. The telephone survey included questions on Medicare beneficiaries' health status, access to care, history of selected health conditions, colorectal cancer risk factors, awareness and knowledge of colorectal cancer test procedures, and colorectal cancer test use. The survey used recommended descriptions of endoscopy procedures and questions about procedure use (22). Survey participants were read the following text:

"Two tests for early signs of colon cancer involve a tube with a light on it that the doctor inserts into the rectum. For a sigmoidoscopy, only part of the colon is checked and the patient is fully awake. Sigmoidoscopy is usually performed in a doctor's office. For a colonoscopy, the entire colon is checked. The colonoscopy is sometimes done in a hospital, the patient gets medication to make them sleepy and someone must drive them home after the test."

After the description, respondents were asked, for each procedure type, if they had heard of the procedure, had ever had the procedure, and, if so, when their most recent procedure was conducted. They were asked to identify the purpose of the procedure (as part of a check up or because of a problem), as well as the name and address of their primary care provider and the name and address of the physician who conducted their most recent sigmoidoscopy or colonoscopy.

Medicare Data. For survey respondents, Medicare in-patient, physician and hospital out-patient, claims were obtained for a 5-year period, January 1, 1998 to December 31, 2002. These claims were reviewed to identify any bills for sigmoidoscopy or colonoscopy, as well as the unique physician identifier number for the referring and performing physicians associated with these procedures.

We also used Medicare claims to identify a primary care provider for study participants who did not report this information on the survey. We reviewed Medicare claims from all settings for a 2-year period (2001 to 2002) and applied an algorithm developed by the Medicare Health Quality Improvement Program that examines physician specialty and number of visits in a 2-year period to identify a primary care physician (23). We used Medicare enrollment data to identify each beneficiary's demographic characteristics (age, race, sex), dates of Medicare enrollment, type of coverage (part A or part B), and managed care enrollment. Coverage and managed care participation were available on a month-by-month basis to allow determination of precise coverage windows. In addition, we collected information on each beneficiary's eligibility for assistance with Medicare premiums and copayments, the state buy-in program for low-income individuals.

Medical Record. Between June 2004 and May 2005, we abstracted data on sigmoidoscopy and colonoscopy procedures conducted between January 1, 1998 to December 31, 2002 from the medical record maintained at the physician's office. A comprehensive medical record abstraction tool was developed to capture endoscopy use. The tool was modeled after one previously used by one of the authors (S.T.H.; ref. 24). Medical record abstractors, all of whom were nurses, were trained on the electronic abstraction tool and data dictionary using test records. The abstraction tool was then pretested using respondents identified for study inclusion (n = 40). The abstraction tool and data dictionary were modified after the pretest to clarify items found difficult to abstract. Records included in the pretest were reabstracted for inclusion in the study. Once abstractors were in the field, repeat abstraction of medical records by a second abstractor was done on 10% of the medical records throughout the study to assess reliability and monitor data quality. Interrater reliability of 90% and above was achieved throughout the abstraction.

We used a hierarchical approach to identify the appropriate physician office for abstraction. The medical record from the primary care provider was the first record of choice. If the primary care provider identified from the survey could be located, that record was accessed. If the response to the survey question was missing or unusable, or the enrollee-identified primary care provider could not be located, the medical record from the physician identified by the claims algorithm was accessed. Medicare enrollees may undergo endoscopy without referral from a primary care provider. Thus, if the abstracted record from the primary care provider did not include information about endoscopy, we used Medicare claims to determine whether an endoscopy had been done and identify the physician who had done the procedure. For these patients (n = 68), the medical record from the performing physician recorded on the most recent colorectal endoscopic procedure claim was also abstracted.

Before visiting a physician's office, a letter describing the study and The Carolinas Center for Medical Excellence authority to access medical records was mailed to physicians. Follow-up telephone calls to physician offices requested permission to visit the office and abstract medical record information directly into a laptop computer. We obtained detailed information on up to two sigmoidoscopy and two colonoscopy procedures. Additional information abstracted from the medical record included practice-based information (type of practice, number of physicians in the practice, whether the practice used electronic medical records), patient visit information (date of last visit and last well check-up), and patient medical conditions (colorectal cancer risk factors and related conditions). A copy of the abstraction tool is available from the corresponding author (A.P.S.).

Definitions of Endoscopy
Survey respondents were classified as having a procedure during the study window if they reported a sigmoidoscopy within the past 4 years or a colonoscopy within the past 5 years. The look-back period for sigmoidoscopy is shorter than the study period because the telephone survey was designed to capture Medicare colorectal cancer screening coverage intervals for average risk enrollees, defined as every 4 years for sigmoidoscopy. Respondents who reported either a sigmoidoscopy or colonoscopy within the study window were classified as having had an endoscopy procedure. Procedures conducted "as part of a routine exam or check up" were classified as screening; those conducted "because of a health problem" were classified as diagnostic.

From Medicare claims, diagnostic and screening endoscopy procedures were identified using International Classification of Diseases (9th edition) and Healthcare Common Procedure Coding System codes (see Appendix for the codes used). Enrollees with claims for procedures done between January 1, 1998 and December 31, 2002 were classified as having been tested with the type of endoscopy represented on the claim. Persons were classified as undergoing a screening endoscopy if the claim included a Healthcare Common Procedure Coding System code for a procedure designated as screening.

Endoscopy procedures were identified in the medical record from procedure reports, office visit or progress notes, consultations, flow sheets, and letters. In the event that the patient had undergone more than one procedure, the total number of endoscopy procedures done between January 1, 1998 and December 31, 2002 was abstracted. Details collected for the two most recent procedures of each type included date, performing provider name, reason the procedure was done, and procedure results. Enrollees were classified as having had a sigmoidoscopy or colonoscopy if either procedure was documented in the medical record as having occurred on a date within the study window. Procedures were classified as screening if the medical record indicated the test was conducted for screening or as part of a well-adult physical. Procedures conducted for any other reason were classified as diagnostic.

A number of colorectal endoscopy procedures identified in the medical record had no date for the procedures recorded (n = 138, 32% of all procedures identified). However, following the data abstraction instructions and using other evidence in the medical record, our abstractors determined that the procedure occurred during the study window (January 1, 1998 to December 31, 2002). Procedures without exact dates were included in analyses only if the patient was enrolled during the entire study window to assure that Medicare coverage was in place at the time of the procedure.

Analyses
An analytic dataset was created to combine medical record data with Medicare data and survey responses. Information was linked across sources at the person level. We used descriptive statistics to assess participant and office characteristics and the prevalence of colorectal endoscopy by each data source. {chi}2 tests were used to assess differences in demographic characteristics of the study group compared with those eligible but not included in the study and to compare differences of endoscopy use rates by demographic characteristic within each data source, with P < 0.05 as evidence of statistical significance.

For the comparisons involving self report (survey to medical record and survey to claim), we calculated the report-to-records ratio as a measure of net bias in the self report (25, 26). This follows a recommendation from Vernon and colleagues (27) that encourages the quantification of bias in the use of self-reported cancer screening behaviors. The report-to-records ratio was calculated by dividing the number of persons who reported they had the test on the survey by the number of person who actually received the test according to the "gold" standard source (either the medical record or the claim; ref. 27).

We measured concordance among data sources by assessing the sensitivity, specificity, positive predictive value and negative predictive value of endoscopy status from self report and claims data when compared with the medical record (28). We calculated agreement, {kappa} statistics, and 95% confidence intervals using standard methods (29). Whereas the medical record is commonly considered the gold standard for information about medical testing, we considered that, for a procedure, such as endoscopy, there might be cases wherein beneficiaries underwent procedures not reported to the primary care provider and the Medicare claim may be considered definitive. Therefore, we also compared concordance of the medical record and self report to the Medicare claims. We used the {kappa} statistic and the benchmarks suggested by Landis and Koch (30) to assess the strength of agreement. These analyses were conducted at the person level for sigmoidoscopy, colonoscopy, and endoscopy (either sigmoidoscopy or colonoscopy). Our assessment of concordance among data sources examined whether the procedure occurred during the study window.

To assess agreement regarding the type and purpose of the procedure, we used data for participants who had a single type of procedure in the "gold" source that "matched" in one or more of the other data sources. Procedures were considered to "match" if they were conducted within ±30 days of each other. Procedures occurring outside this window were excluded (8% of procedures).

All reported analysis results were unweighted. However, we constructed sample weights to reflect the overall study population (n = 1001) and sampling shown in Fig. 1. We compared weighted and unweighted results to judge the robustness of the primary conclusions. Weighted and unweighted measures of agreement between the data sources differed by <3% in all cases. We report unweighted results for two reasons. First, the overall population was itself a sample and not necessarily representative of the North Carolina Medicare population. Second, for some comparisons, the number of subjects with tests was small so that the use of the statistical weights increased the variance of the estimate substantially.

We considered the possibility for the need to adjust for clustering by physician offices. We present results without adjustment for clustering because, although the variance and hence the length of confidence intervals for estimates of concordance would increase with adjustment for clustering, the effect on these results would be minimal due to the large number of physician offices where medical records were abstracted and the limited number of offices with multiple records per office.


    Results
 Top
 Abstract
 Background
 Materials and Methods
 Results
 Discussion
 Appendix. Identification of...
 References
 
Study Participants and their Physicians
Of the 561 participants in the study, 89% were 65 years or older, and 61% were females (Table 1 ). Almost half of the group, 47%, had more than high school education. Eligible participants included in the study were less likely to be African American and more likely to have higher educational attainment. Abstractions were conducted at 269 physician offices (Table 2 ). The physicians included in the medical record abstraction were identified primarily from the information provided in the survey, although in 35% of the cases, the medical record abstracted was from a physician not identified by the participant (data not shown). The majority of offices visited for record abstraction were primary care practices. Most practices were small, with 62% either solo or comprising two to five physicians. The majority of medical records accessed were paper-based, with only 11% of records accessed in electronic format. In the medical record abstraction, data were obtained on 429 procedures, likely an underestimate of total endoscopy utilization during the study window because detailed data were only collected for the two most recent procedures of each type. Based on the record abstraction, 20% of participants had more than one endoscopy procedure during the 5-year study period.


View this table:
[in this window]
[in a new window]

 
Table 1. Characteristics of Medicare enrollees included in validation study, 2002

 

View this table:
[in this window]
[in a new window]

 
Table 2. Characteristics of physician offices included in the medical record abstraction for validation study

 
Prevalence of Endoscopy Use by Data Source
The colorectal cancer test use rates observed among study participants were low in all three data sources (Table 3 ). The rates obtained from self report and Medicare claims were comparable for sigmoidoscopy (23% versus 22%), colonoscopy (38% versus 35%), and endoscopy (50% versus 45%), although the rates from self report were somewhat higher in each case. For colonoscopy, use rates from medical records were comparable with those obtained by claims and survey. In contrast, sigmoidoscopy rates were substantially lower in medical records than in claims or self report. Looking across all data sources, the percentages of the sample with evidence of sigmoidoscopy or colonoscopy in any source were 36% and 50%, respectively (data not shown).


View this table:
[in this window]
[in a new window]

 
Table 3. Prevalence of colorectal endoscopy use by study participants (n = 561) by data source

 
Significant variation in sigmoidoscopy test use was seen across regions of the state in all data sources (Table 3). Self-reported colonoscopy rates varied significantly by race, education level, and Medicaid eligibility status. Claim-based and medical record–based rates of colonoscopy use were not significantly associated with participant characteristics.

Bias observed in the self-reported data, as measured by the report-to-records ratio, was higher for comparisons of the survey and medical record than for the survey to claims and higher for sigmoidoscopy than colonoscopy. The report-to-records ratio for sigmiodoscopy was 1.9 for the survey to medical record comparisons and 1.2 for the survey to claims comparisons. The report-to-records ratio for colonoscopy was 1.1 in both survey to medical records and survey to claims comparisons.

Concordance between Data Sources
Concordance between the data sources as to whether the study participant had a colorectal endoscopic procedure was better for Medicare claims to the medical record than either the survey to the medical record or the survey to claims (Table 4 ). Sensitivity and specificity of Medicare claims for measuring sigmoidoscopy and colonoscopy exceeded 90%. Negative predictive value and agreement for sigmoidoscopy and colonoscopy measured by claims also exceeded 90%. The positive predictive value of claims to capture sigmoidoscopy was lower (65%), indicating there were more claims for sigmoidoscopy tests than were found in the medical record. {kappa} statistics for sigmoidoscopy represent "substantial agreement" (0.72) and for colonoscopy are considered "almost perfect agreement" (0.89). Agreement between the claim and medical record was not improved by combining both procedures into a single category of endoscopy, although the positive predictive value was higher than that seen for sigmoidoscopy, likely due to the fact that many of the study participants with a claim for sigmoidoscopy, but no evidence of the test in the medical record, had both a claim and medical record documentation for a colonoscopy procedure.


View this table:
[in this window]
[in a new window]

 
Table 4. Measures of concordance for colorectal endoscopy use by Medicare claims, medical records, and self report

 
Comparisons of medical record and claim when the claim was designated as the "gold standard" showed similar results for colonoscopy and endoscopy. However, the sensitivity statistic for sigmoidoscopy was substantially lower (65%), again reflecting the fact that this study population had more claims for sigmoidoscopy than were found in the medical records.

Concordance between self report and medical record for sigmoidoscopy, colonoscopy, and endoscopy was lower than for the claim to medical record comparison. Sensitivity ranged from 56% to 74% and agreement from 69% to 79%. {kappa} statistics for these comparisons represent "fair agreement." Comparison of self report to claim also revealed lower agreement than the claim to medical record comparisons. Sensitivity was 43% for sigmoidoscopy, 69% for colonoscopy, and 73% for endoscopy. Again, the {kappa} statistics for these comparisons indicated agreement in the "fair" (for sigmoidoscopy and endoscopy) to "moderate" (for colonoscopy) range. Agreement between data sources as to the type of endoscopic procedure conducted (i.e., sigmoidoscopy or colonoscopy) was good (Table 5 ). Claim and medical record agreed 93% of the time, self report and medical record agreed 82% of the time, and claim and self report agreed 77% of the time. In contrast, agreement between data sources as to the purpose of the test (i.e., screening versus diagnostic) was poor in all comparisons: 52% for claim to medical records, 65% for self report to medical record, and 29% for claim to self report.


View this table:
[in this window]
[in a new window]

 
Table 5. Agreement regarding type and purpose of colorectal endoscopy for Medicare claims, medical records, and self report

 

    Discussion
 Top
 Abstract
 Background
 Materials and Methods
 Results
 Discussion
 Appendix. Identification of...
 References
 
This report is the first study to compare Medicare claims, medical records, and self report as data sources for measuring colorectal endoscopy use in the Medicare population. We undertook this study primarily to answer the question of whether Medicare claims can be used to measure colorectal cancer test use. Our findings support the validity of Medicare claims as a data source for measuring colorectal endoscopy. There was substantial agreement between claims and medical records in ascertaining colorectal endoscopy use, with agreement better for colonoscopy than sigmoidoscopy. The fact that the concordance for colonoscopy is greater than for sigmoidoscopy may be due to factors related to the study protocol rather than to higher accuracy of data for colonoscopy per se. For this study, if we had a claim for a test but no evidence of it in the medical record, we accessed procedure reports from the performing physician for the most recent procedure. Since few enrollees will have a sigmoidoscopy after a colonoscopy, this meant our second data collection generally occurred in gastroentrologists offices, where colonoscopies were done. However, because other researchers have reported better agreement for colonoscopy than sigmoidoscopy in comparisons of self report and medical record, the precise reason for the better concordance is not known (31).

Our data showed more procedure use in Medicare claims than in medical records, for both sigmoidoscopy and colonoscopy. We believe this is due to the fact that Medicare is the primary payer for most enrollees, yet most enrollees have more than one physician. The medical record has been defined by others as the "gold standard" for information about colorectal endoscopy use (10, 12). However, to be a gold standard, the medical record should contain comprehensive information about all services. We found many instances in which primary care provider records contained information indicating that a colorectal endoscopy procedure had been done, but no supporting documentation, such as a procedure report, making it difficult to identify precisely when a procedure had been done. In this study, we found that of the 252 of beneficiaries who had an endoscopy recorded in Medicare claims, 19% had no evidence of the procedure in the primary care provider's record, and additional work was needed to locate the doctor who did the procedure and abstract the correct medical record. Whereas it is possible that the procedures reported on Medicare claims were never done, we think it is more likely that the information on the primary care providers records are incomplete. An earlier study that compared eye procedures identified from Medicare claims with the medical records of ophthalmologists found that 99% of the procedures reported on the claims were validated on the medical record (32). Based on our results, we believe that Medicare claims provide a more complete picture of colorectal endoscopy use than can be found in any single or even multiple physician office records, suggesting that claims may actually be the preferred data source for measuring colorectal endoscopy use in the fee-for-service Medicare population.

Despite the utility of the Medicare data to measure colorectal endoscopy use, our results suggest that claims cannot be used to distinguish screening from diagnostic procedures. The inability of Medicare claims to distinguish screening procedures likely reflects policies regarding coding and reimbursement. Medicare's coverage policy states that if, during the course of a screening colonoscopy, a lesion or growth that results in a biopsy or removal of the growth is detected, the procedure should be coded as diagnostic rather than screening. Thus, procedures conducted for the purpose of screening may be reported by the patient or recorded in the medical record as screening, but coded in the claims as diagnostic. The inability to accurately distinguish diagnostic and screening procedures in the Medicare claims has significance for researchers who use these data to measure screening rates. Studies that limit the claims to only those with a screening code will miss close to half of all procedures reported as screening in the medical record. Studies that include both diagnostic and screening codes on claims to assess screening will overestimate true screening rates. However, inclusion of all endoscopies can provide a benchmark of the number of Medicare beneficiaries who have ever had an endoscopy. In studies that include all endoscopies, the term "testing" in lieu of screening may more accurately reflect what is being reported.

Whereas the primary focus of our analysis was the ability of Medicare claims to measure colorectal endoscopy, our study provides insight into the utility of other sources of information about endoscopy use. We found that test use rates based on enrollee survey responses were higher than those based on medical record or claims data. We also observed differentially higher rates of self-reported colonoscopy by race, which has been found by Fiscella and colleagues (33). Whether the higher use rates obtained through survey represent an overestimate, as suggested by others (9-11), or accurately reflect test use perhaps from times not covered by the claim or medical record is unknown. We also showed that all three data sources (self report, claims, and medical records) accurately distinguish the type of procedure done (sigmoidoscopy versus colonoscopy).

A few methodologic considerations of our study should be recognized. First, the process we used to identify the appropriate medical records for our study group may have resulted in some errors of assignment. Whereas it would not have been possible to abstract a chart for a patient if he/she had never seen a selected physician; it would have been possible to abstract a chart from the wrong physician because patients may have more than one physician who serve as the primary care provider, especially over a 5-year period. However, we attempted to correct such mismatches by abstracting a second record from the performing physician if no evidence of an endoscopic procedure was found when it was expected based on self report or claims. Agreement between data sources may have been higher had this study been conducted in an integrated health care system wherein communication between physicians performing procedures and those providing primary care are enhanced by shared medical records or electronic data systems. A second limitation of this study is that the data come from a single state. Test use and communication patterns of physicians may be different in other parts of the country. Finally, these analyses were restricted to fee-for-service Medicare enrollees. The extent to which the results might be generalized to other states may depend on the state proportion of Medicare enrollees covered under managed care plans. At the time of this study, North Carolina had a small percentage of the Medicare population enrolled in managed care plans (5%). However, nationally, the percentage of the Medicare population covered under such plans was about 13% and varied from state to state (34).

This study provides an important contribution to the literature on validation of data sources for colorectal cancer tests. Unlike most validation studies that are conducted in managed care or a single provider setting, our study was conducted in a nonintegrated system, thereby providing insights into the type of concordance that exists in community settings, wherein the majority of Medicare enrollees receive care (34).

The community-based approach to this study also allows the results to be used to inform cancer screening and early detection practice. The fact that information about endoscopy procedures done by another provider is not always found in the primary care physician's medical records is problematic. How can primary care physicians know when to recommend a colorectal cancer test if procedure reports are not sent to them and the date of the last procedure is not recorded in the medical record? The burden falls on the patient to accurately recall when the last test was completed, which is especially concerning given the 5-year to 10-year intervals recommended for routine screening with endoscopy. Unlike other preventives services, such as mammography or flu shots, that can be "associated" with a yearly event like a birthday, remembering due dates for colorectal endoscopy can be complicated. And, for Medicare reimbursement, the interval between tests must be exact (for average risk enrollees, at least 47 months following the month of the last covered screening sigmoidoscopy and 119 months following the month of the last covered screening colonoscopy). An earlier study found that patient reports of invasive procedures had high agreement with the medical record, with some telescoping of the time of the procedure (35).

There is considerable interest in the use of electronic health records along with optimism that information technology will enhance preventive care. However, emphasis must be placed not only on promoting the use of electronic health records but also on assuring portability of electronic health information and interoperability across electronic health record systems so that information about preventive services, such as colorectal cancer screening conducted by one physician will be accessible to other physicians in different offices, caring for the same patient. Furthermore, since the proportion of offices using electronic records was quite small, at least at the time of our study in North Carolina, approaches to communicating screening information across practices that are not dependent on electronic health records are also needed. A policy requiring physicians who perform an endoscopy procedure to report the results of the procedure to the patient's primary care provider would enhance the ability of primary care providers to appropriately counsel their patients on the need for colorectal cancer tests. The Mammography Quality Standards Act provides a model for such an approach (36).

Finally, colorectal cancer care is very costly to Medicare (over $3.5 billion dollars in 1996; ref. 37). Prevention of colorectal cancer through regular endoscopy could reduce the cost to Medicare of colorectal cancer treatment. To ensure that patients receive appropriate screening, the Centers for Medicare and Medicaid Services could consider using claims to help physicians identify persons who need colorectal cancer screening.


    Appendix. Identification of colorectal endoscopy procedures in Medicare claims
 Top
 Abstract
 Background
 Materials and Methods
 Results
 Discussion
 Appendix. Identification of...
 References
 


View this table:
[in this window]
[in a new window]

 
 
Abbreviations: ICD, International Classification of Diseases (9th edition); HCPCS, Healthcare Common Procedure Coding System.


    Acknowledgments
 
The analyses upon which this publication is based were done under contract no. 500-02-NC03 (Utilization and Quality Control Peer Review Organization for the State of North Carolina). We thank Jim Coan of Center for Medicare and Medicaid Services for project management support.


    Footnotes
 
Grant support: Centers for Medicare and Medicaid Services and National Cancer Institute interagency agreement Y1-PC-1007.

The costs of publication of this article were defrayed in part by the payment of page charges. This article must therefore be hereby marked advertisement in accordance with 18 U.S.C. Section 1734 solely to indicate this fact.

7 http://www.thecarolinascenter.org/mrnc_web/data/crcproject.aspx Back

Received 2/ 8/07; revised 6/ 8/07; accepted 8/ 1/07.


    References
 Top
 Abstract
 Background
 Materials and Methods
 Results
 Discussion
 Appendix. Identification of...
 References
 

  1. Dicker RC, Han LF, Macone JJ. Quality of Care Surveillance Using Administrative Data, 1996 Quality Resume, No. 2. Baltimore (MD): Health Care Financing Administration; 1998.
  2. U S. Preventive Services Task Force. Screening for colorectal cancer: recommendations and rationale. Ann Intern Med 2002;137:129–31.[Abstract/Free Full Text]
  3. Smith RA, Cokkinides V, Eyre HJ. American Cancer Society guidelines for the early detection of cancer, 2003. CA Cancer J Clin 2003;53:27–43.[Abstract/Free Full Text]
  4. Breen N, Wagener DK, Brown ML, David WW, Ballard-Barbash R. Progress in cancer screening over a decade: results of cancer screening from the 1987, 1992 and 1998 National Health Interview surveys. J Natl Cancer Inst 2001;93:1704–13.[Abstract/Free Full Text]
  5. Trends in screening for colorectal cancer-United States, 1997 and 1999. Morb Mortal Wkly Rep 2001;50:162–6.[Medline]
  6. Hiatt RA, Klabunde C, Breen N, Swan J, Ballard-Barbash R. Cancer screening practices from National Health Interview surveys: past present and future. J Natl Cancer Inst 2002;94:1837–46.[Abstract/Free Full Text]
  7. Engelman KK, Ellerbeck MD, Ahluawalia JS, Nazir N, Velasco A. Fecal occult blood test use by kansas medicare beneficiaries. Prev Med 2001;33:622–6.[CrossRef][Medline]
  8. Medicare. Few Beneficiaries Use Colorectal Cancer Screening and Diagnostic Services, GAO/T-HEHS-00–68, March, 2000.
  9. Hall IH, Van Den Eeden SK, Tolsma DD, et al. Testing for prostate and colorectal cancer: comparison of self-report and medical record audit. Prev Med 2004;39:27–35.[CrossRef][Medline]
  10. Hiatt RA, Perez-Stable EJ, Quesenberry C, Sabogal F, Otero-Sabogal R, McPhee S. Agreement between self-reported early cancer detection practices and medical audits among Hispanic and Non-Hispanic White health plan members in Northern California. Prev Med 1995;24:278–85.[CrossRef][Medline]
  11. Gordon NP, Hiatt RA, Lampert DI. Concordance of self-reported data and medical record audit for six cancer screening procedures. J Natl Cancer Inst 1993;85:566–70.[Abstract/Free Full Text]
  12. Baier M, Calonge N, Cutter G, et al. Validity of self-reported colorectal cancer screening behavior. Cancer Epidemiol Biomarkers Prev 2000;9:229–32.[Abstract/Free Full Text]
  13. Montano DE, Phillips WR. Cancer screening by primary care physicians: a comparison of rates obtained from physician self-report, patient survey, and chart audit. Am J Public Health 1995;85:795–800.[Abstract/Free Full Text]
  14. Cooper GS, Schultz L, Simpkins J, Lafata JE. The utility of administrative data for measuring adherence to cancer surveillance care guidelines. Med Care 2007;45:66–72.[CrossRef][Medline]
  15. Freeman JL, Klabunde CN, Schussler N, Warren JL, Virnig BA, Cooper GS. Measuring breast, colorectal and prostate cancer screening with Medicare claims data. Medical Care 2002; 40[supplement]:IV-36-IV-42.
  16. Ko CW, Krueter W, Baldwin LM. Effect of Medicare coverage on use of invasive colorectal cancer screening tests. Arch Int Med 2002;162:2581–6.[Abstract/Free Full Text]
  17. Richards RJ, Reker DM. Racial differences in use of colonoscopy, sigmoidoscopy and barium enema in Medicare beneficiaries. Digest Dis Sci 2002;47:2715–9.[Medline]
  18. Ko CW, Krueter W, Baldwin LM. Persistent demographic differences in colorectal cancer screening utilization despite Medicare reimbursement. BMC Gastroenterol 2005;5:10–7.[CrossRef][Medline]
  19. May DS, Trontell AE. Mammorgraphy use by elderly women: a methodological comparison of two national data sources. Ann Epidemiol 1998;8:439–44.[CrossRef][Medline]
  20. Mouchawar J, Byers T, Warren M, Schluter WW. The sensitivity of Medicare billing claims data for monitoring mammography use by elderly women. Med Care Res Rev 2004;61:116–27.[Abstract/Free Full Text]
  21. National Cancer Institutes, Human Subjects Protections Education for Research Teams. Available from: http://cme.cancer.gov/c01/toc.php, accessed 08/09/2006.
  22. Vernon SW, Meissner H, Klabunde C, et al. Measures for ascertaining use of colorectal cancer screening in behavioral, health services, and epidemiological research. Cancer Epidemiol Biomarkers Prev 2004;13:898–905.[Free Full Text]
  23. Outpatient Data Reports: October 2003 Diabetes and Breast Cancer Screening Performance and Provider Profiles. Technical Documentation, Appendix A. Outpatient Data QIOSC, Iowa Foundation for Medical Care, October 2003.
  24. Hawley ST, Vernon SW, Levin B, Vallejo B. Prevalence of colorectal cancer screening in a large medical organization. Cancer Epidemiol Biomarkers Prev 2004;13:314–9.[Abstract/Free Full Text]
  25. Brown JB, Adams ME. Patients as reliable reporters of the medical care process. Med Care 1992;30:400–11.[Medline]
  26. Warnecke RB, Sudman S, Johnson TP, O'Rourke D, Davis AM, Jobe JB. Cognitive aspects of recalling and reporting health-related events: papanicolau smears, clinical breast examinations and mammograms. Am J Epidemiol 1997;146:982–92.[Abstract/Free Full Text]
  27. Vernon SW, Briss PA, Trio JA, Warnecke RB. Some methodologic lesions learned from cancer screening research. Cancer 2004;101:1131–45.[CrossRef][Medline]
  28. Hennekens CH, Burring JE. Epidemiology in Medicine. In: Mayrent SL, editor. Boston (MA): Little, Brown and Company; 1987.
  29. Fleiss JL. Statistical Methods for Rates and Proportions, 2nd ed. Wiley Series in Probability and Mathematical Statistics. NY (NY): John Wiley & Sons; 1981.
  30. Landis JR, Koch GG. The measurement of observer agreement for categorical data. Biometrics 1977;33:159–74.[CrossRef][Medline]
  31. Madlensky L, McLaughlin J, Goel V. A comparison of self-reported colorectal cancer screening with medical records. Cancer Epidemiol Biomarkers Prev 2003;12:656–9.[Abstract/Free Full Text]
  32. Javitt JC, McBean AM, Sastry SS, DiPaolo F. Accuracy of coding in Medicare part B claims. Cataract as a case study. Arch Opthalmol 1993;111:605–7.[Abstract/Free Full Text]
  33. Fiscella K, Holt K, Meldrum S, Franks P. Disparities in preventive procedures: comparisons of self-report and Medicare claims data. BMC Health Serv Res 2006;6:122.[CrossRef][Medline]
  34. Program Information on Medicare, Medicaid, SCHIP and Other Programs of the Center for Medicare & Medicaid Services CMS, June 2002. Available from: www.cms.hhs.gov/TheChartSeries/downloads/sec3b_p.pdf, accessed on 6/4/2007.
  35. Tisnado DM, Adams JL, Liu H, et al. What is the concordance between the medical record and patient self-report as data sources for ambulatory care? Med Care 2006;44:132–40.[CrossRef][Medline]
  36. Mammography Quality Standards Act. Available from: http://www.fda.gov/CDRH/MAMMOGRAPHY/mqsa-act.html. Accessed on 6/4/2007.
  37. Brown ML, Riley GF, Schussler N, Etzioni R. Estimating health care costs related to cancer treatment from SEER-Medicare data. Med Care 2002;40:IV-104–17.



This article has been cited by other articles:


Home page
ANN INTERN MEDHome page
J. L. Warren, C. N. Klabunde, A. B. Mariotto, A. Meekins, M. Topor, M. L. Brown, and D. F. Ransohoff
Adverse Events After Outpatient Colonoscopy in the Medicare Population
Ann Intern Med, June 16, 2009; 150(12): 849 - 857.
[Abstract] [Full Text] [PDF]


Home page
Cancer Epidemiol. Biomarkers Prev.Home page
M. Pignone, T. L. Scott, L. A. Schild, C. Lewis, R. Vazquez, and K. Glanz
Yield of Claims Data and Surveys for Determining Colon Cancer Screening among Health Plan Members
Cancer Epidemiol. Biomarkers Prev., March 1, 2009; 18(3): 726 - 731.
[Abstract] [Full Text] [PDF]


Home page
Cancer Epidemiol. Biomarkers Prev.Home page
J. J. Fenton, R. J. Reid, L.-M. Baldwin, J. G. Elmore, D. S.M. Buist, and P. Franks
Influence of Primary Care Use on Population Delivery of Colorectal Cancer Screening
Cancer Epidemiol. Biomarkers Prev., February 1, 2009; 18(2): 640 - 645.
[Abstract] [Full Text] [PDF]


Home page
Cancer Epidemiol. Biomarkers Prev.Home page
J. M. Ferrante, P. Ohman-Strickland, K. A. Hahn, S. V. Hudson, E. K. Shaw, J. C. Crosson, and B. F. Crabtree
Self-report versus Medical Records for Assessing Cancer-Preventive Services Delivery
Cancer Epidemiol. Biomarkers Prev., November 1, 2008; 17(11): 2987 - 2994.
[Abstract] [Full Text] [PDF]


Home page
Cancer Epidemiol. Biomarkers Prev.Home page
A. P. Schenck, C. N. Klabunde, J. L. Warren, S. Peacock, W. W. Davis, S. T. Hawley, M. Pignone, and D. F. Ransohoff
Evaluation of Claims, Medical Records, and Self-report for Measuring Fecal Occult Blood Testing among Medicare Enrollees in Fee for Service
Cancer Epidemiol. Biomarkers Prev., April 1, 2008; 17(4): 799 - 804.
[Abstract] [Full Text] [PDF]


Home page
Cancer Epidemiol. Biomarkers Prev.Home page
R. Bastani, B. A. Glenn, A. E. Maxwell, P. A. Ganz, C. M. Mojica, and L. C. Chang
Validation of Self-reported Colorectal Cancer (CRC) Screening in a Study of Ethnically Diverse First-Degree Relatives of CRC Cases
Cancer Epidemiol. Biomarkers Prev., April 1, 2008; 17(4): 791 - 798.
[Abstract] [Full Text] [PDF]


This Article
Right arrow Abstract Freely available
Right arrow Full Text (PDF)
Right arrow Alert me when this article is cited
Right arrow Alert me if a correction is posted
Services
Right arrow Similar articles in this journal
Right arrow Similar articles in PubMed
Right arrow Alert me to new issues of the journal
Right arrow Download to citation manager
Right arrow reprints & permissions
Citing Articles
Right arrow Citing Articles via HighWire
Right arrow Citing Articles via Google Scholar
Google Scholar
Right arrow Articles by Schenck, A. P.
Right arrow Articles by Ransohoff, D. F.
Right arrow Search for Related Content
PubMed
Right arrow PubMed Citation
Right arrow Articles by Schenck, A. P.
Right arrow Articles by Ransohoff, D. F.
Related Collections
Right arrow Behavioral Science
Right arrow Behavioral Science: Interventions: Behavioral, Pharmacologic, Pharmacogenetic


HOME HELP FEEDBACK SUBSCRIPTIONS ARCHIVE SEARCH TABLE OF CONTENTS
Cancer Research Clinical Cancer Research
Cancer Epidemiology Biomarkers & Prevention Molecular Cancer Therapeutics
Molecular Cancer Research Cancer Prevention Research
Cancer Prevention Journals Portal Cancer Reviews Online
Annual Meeting Education Book Meeting Abstracts Online