Obtaining complete medical record information can be challenging and expensive in breast cancer studies. The current literature is limited with respect to the accuracy of self-report and factors that may influence this. We assessed the agreement between self-reported and medical record breast cancer information among women from the Ontario site of the Breast Cancer Family Registry. Women aged 20–69 years diagnosed with incident breast cancer 1996–1998 were identified from the Ontario Cancer Registry, sampled on age and family history. We calculated kappa statistics, proportion correct, sensitivity, specificity, and positive and negative predictive values and conducted unconditional logistic regression to examine whether characteristics of the women influenced agreement. The proportions of women who correctly reported having received a broad category of therapy (hormone therapy, chemotherapy, radiation, or surgery) as well as sensitivity and specificity were above 90%, and the kappa statistics were above 0.80. The specific type of hormonal or chemotherapy was reported with low-to-moderate agreement. Aside from recurrence, no factors were consistently associated with agreement. Thus, most women were able to accurately report broad categories of treatment but not necessarily specific treatment types. The finding of this study can aid researchers in the use and design of self-administered treatment questionnaires.
Medical records are considered the gold standard in regards to obtaining accurate information pertaining to breast cancer diagnosis, treatment, and prognosis. However, this method of data collection can be very time consuming and labor intensive. Obtaining complete longitudinal treatment information for individuals over long periods of time can be challenging and expensive, particularly when conducting large population-based studies of breast cancer patients. With an increasing focus on epidemiological studies of prognosis and survivorship in breast cancer, clinical data collection is a methodological issue of rising importance.
Self-reported treatment questionnaires may be a more feasible option in some cases; however, few studies have examined the accuracy of self-reported breast cancer treatment and fewer have considered factors potentially influencing accuracy. To our knowledge, only four studies have specifically examined the accuracy of self-reported breast cancer treatment to date [
Breast cancer patients included in this analysis were women recruited into the OFBCR. The OFBCR is one of six registries in the Breast CFR, an international collaboration of academic and research institutions located in the United States, Canada, and Australia designed to examine the genetic, environmental, and lifestyle factors associated with breast cancer [
In Ontario, women aged 20 to 69 diagnosed with breast cancer between the calendar years of 1996 and 1998 were identified from the population-based Ontario Cancer Registry and recruited between 1996 and 2000 using a sampling strategy incorporating age, ethnicity, and family history of cancer to enrich the registry with genetically predisposed individuals [
Using the sampling strategy described above, physicians gave permission to contact 7,662 women of 8,448 women who were identified with incident breast cancer diagnosed between 1996 and 1998. Of these women, 4,962 women completed the Family History Questionnaire (described in the following), and 2,399 women were eligible and willing to proceed. After excluding women for whom blood samples and permission to access medical records were not available (note that in some cases it was because the women had died rather than refused) and those with a prior cancer diagnosis or distant metastases at diagnosis, 1082 women were eligible for the current study, of which 939 had a first diagnosis of unilateral breast cancer with medical record and treatment questionnaire data available for analysis. The selection of the study sample has been previously described in detail [
The self-administered Treatment Questionnaire gathered information regarding aspects of treatment for breast or ovarian cancer. It consists of questions that address stage (whether the cancer was only in the breast or breast and lymph glands or had spread to other sites), the type of initial breast cancer treatments received, and whether recurrence has occurred. Each item related to treatment first asked whether the broad category of treatment was received (e.g., “did you have hormonal therapy for this breast cancer”), and then for those who responded “yes,” more specific questions regarding the details of the treatment were asked (e.g., “please list medicines if known”). The question on recurrence asked “has the cancer come back (recurred) after the treatments listed above?”.
The mailed Family History Questionnaire gathered information regarding previous cancer diagnoses in the women, their parents, siblings, children, and any other relatives, and family history was reviewed over the telephone with a genetic counselor. All cancers, except nonmelanoma skin cancers and cervical carcinoma
Clinical and treatment data were abstracted from the patient’s medical records at each clinic using standard data collection forms. Data collected included the method and date of diagnosis, clinical stage, type of surgical treatment, whether or not radiation treatment was given, dates and types of hormonal therapies, and dates and types of chemotherapy administration. All data were reviewed, verified, and coded centrally by the research nurse coordinator and an oncologist [
Agreement analysis was conducted with analysis restricted to the most common types of treatment reported in both the Treatment Questionnaire and in the medical records. Women who had start dates for hormonal therapy, chemotherapy, and surgery were coded as having received the therapy in question, while women without respective start dates were coded as not having received the therapy (based on the assumption that a start date indicated that a prescribed treatment was actually administered). Any treatment that occurred after the completion date of a woman’s respective treatment questionnaire was coded as not having occurred (since it would have occurred after self-report). For radiation therapy, no treatment dates were available to us in the study database; accordingly we could not determine whether any treatments occurred after the treatment questionnaire completion date. Thus, analysis regarding radiation therapy was conducted excluding women with breast cancer recurrence at the time of questionnaire completion (based on medical record abstraction) since it is likely that this was the only situation where radiation might have occurred following the questionnaire, which was completed at least a year after diagnosis. In regards to whether women could accurately report the specific type of hormonal therapy or chemotherapy medication they received (alone and/or in combination with other medications), agreement analysis was restricted to only those women who were coded as having received the respective broader category of treatment (i.e., hormonal therapy or chemotherapy).
Agreement between self-reported treatment and breast cancer recurrence and medical records was first assessed by calculating the kappa statistic, which takes chance agreement into account. Next, using medical records as the gold standard, agreement was also analyzed by calculating
Lastly, unconditional logistic regression analysis was conducted to examine the influence of the following on agreement: age at breast cancer diagnosis (continuous), recall period (continuous), education level, marital status, alcohol consumption (continuous), smoking behavior, first-degree family history of breast or ovarian cancer, menopausal status at diagnosis, breast cancer recurrence, and place of birth. In regards to place of birth, women were categorized as having been born in an English or non-English speaking country which was meant to serve as a proxy for proficiency in English. Logistic regression analysis was conducted to examine the factors associated with agreement for the broad categories of hormonal therapy, chemotherapy, and radiation, and, as suggested by Lipstiz et al. (2003) [
Descriptive statistics are displayed in Table
Characteristics of the study population of women with breast cancer from questionnaire information.
Subjects included in analysis ( |
||
---|---|---|
No. | % | |
Age at diagnosis (years) | ||
20–29 | 13 | 1.4 |
30–39 | 139 | 14.8 |
40–49 | 342 | 36.4 |
50–59 | 315 | 33.6 |
60–69 | 130 | 13.8 |
Range | 23–69 | |
Mean (Std) | 48.7 (9.19) | |
Median | 49.0 | |
Year of breast cancer diagnosis | ||
1996 | 282 | 30.0 |
1997 | 329 | 35.1 |
1998 | 328 | 34.9 |
Recall period (years) | ||
1–5 | 896 | 95.4 |
>5 | 43 | 4.6 |
Mean (Std) | 3.0 (1.2) | |
Median | 3.0 | |
Marital status | ||
Married/living as married | 734 | 78.2 |
Widowed/divorced/separated/never married | 205 | 21.8 |
Educational status | ||
High school or less | 358 | 38.3 |
Some vocational/technical/college/university | 334 | 35.8 |
Bachelor or graduate degree | 242 | 25.9 |
Missing | 5 | n/a |
Born in English speaking country | ||
Yes | 825 | 88.1 |
No | 111 | 11.9 |
Missing | 3 | n/a |
Ethnic background | ||
White | 901 | 96.5 |
Other | 31 | 3.3 |
Don't know | 2 | 0.2 |
Missing | 5 | n/a |
Have you ever consumed alcohol?1 | ||
Yes | 462 | 49.4 |
No | 474 | 50.6 |
Missing | 3 | n/a |
Number of drinks per week | ||
0 | 495 | 52.7 |
1–4 | 218 | 23.2 |
5–9 | 145 | 15.4 |
10–19 | 55 | 5.9 |
20–29 | 16 | 1.7 |
30–39 | 9 | 1.0 |
40–49 | 1 | 0.1 |
Have you ever smoked?2 | ||
Yes | 473 | 50.4 |
No | 465 | 49.6 |
Missing | 1 | n/a |
Smoking status2 | ||
Current smoker | 187 | 19.9 |
Former smoker | 280 | 29.8 |
Never smoker | 465 | 49.5 |
Don’t know | 6 | 0.8 |
Missing | 1 | n/a |
Breast cancer recurrence | ||
Yes | 50 | 5.3 |
No | 889 | 84.7 |
First degree relative with history of breast or ovarian cancer | ||
Yes | 341 | 36.3 |
No | 598 | 63.7 |
Menopausal status at diagnosis | ||
Pre-menopausal | 520 | 55.4 |
Post-menopausal | 248 | 26.4 |
Unknown—on menopausal hormone therapy | 59 | 6.3 |
Unknown—hysterectomy | 104 | 11.1 |
Missing | 8 | 0.8 |
1More than 1 drink per week on average for a period of at least 6 months.
2Refers to cigarette smoking.
Comparison of treatment, recurrence, and menopausal information obtained from medical records and self-administered questionnaire in women with breast cancer.
From medical records | From treatment questionnaire | ||||
---|---|---|---|---|---|
Frequency ( |
Percent (%) | Frequency ( |
Percent (%) | ||
Hormone given | Hormone taken | ||||
No | 426 | 45.4 | No | 434 | 46.8 |
Yes | 513 | 54.6 | Yes | 491 | 52.9 |
Tamoxifen | Tamoxifen | ||||
Yes | 468 | 91.2 | Yes | 441 | 89.8 |
No | 45 | 8.8 | No | 50 | 10.2 |
Megestrol | Megestrol | ||||
Yes | 16 | 3.1 | Yes | 5 | 1.0 |
No | 497 | 96.9 | No | 486 | 99.0 |
Anastrozole | Anastrozole | ||||
Yes | 67 | 13.1 | Yes | 16 | 3.3 |
No | 446 | 86.9 | No | 475 | 96.7 |
MA12 | MA12 | ||||
Yes | 22 | 4.3 | Yes | 5 | 1.0 |
No | 491 | 95.7 | No | 486 | 99.0 |
Don’t know | 0 | 0 | Don’t know | 3 | 0.3 |
Missing | 0 | 0 | Missing | 11 | n/a |
Chemotherapy given | Chemotherapy taken | ||||
No | 439 | 46.8 | No | 408 | 43.7 |
Yes | 500 | 53.2 | Yes | 525 | 56.3 |
Epirubicin | Epirubicin | ||||
Yes | 188 | 37.6 | Yes | 113 | 21.5 |
No | 312 | 62.4 | No | 412 | 78.5 |
Doxorubicin | Doxorubicin | ||||
Yes | 148 | 29.6 | Yes | 84 | 16.0 |
No | 352 | 70.4 | No | 441 | 84.0 |
Methotrexate | Methotrexate | ||||
Yes | 213 | 42.6 | Yes | 121 | 23.0 |
No | 287 | 57.4 | No | 404 | 77.0 |
Cyclophosphamide | Cyclophosphamide | ||||
Yes | 495 | 99.0 | Yes | 307 | 58.5 |
No | 5 | 1.0 | No | 218 | 41.5 |
Fluorouracil | Fluorouracil | ||||
Yes | 430 | 86.0 | Yes | 260 | 49.5 |
No | 70 | 14.0 | No | 265 | 50.5 |
Docetaxel | Docetaxel | ||||
Yes | 59 | 11.8 | Yes | 5 | 0.9 |
No | 441 | 88.2 | No | 520 | 99.1 |
Don’t know | 0 | 0.0 | Don’t know | 0 | 0.0 |
Missing | 0 | n/a | Missing | 6 | n/a |
Radiation given | Radiation taken | ||||
No | 223 | 23.8 | No | 209 | 22.4 |
Yes | 712 | 76.2 | Yes | 724 | 77.6 |
Don’t know | 0 | 0.0 | Don’t know | 0 | 0.0 |
Missing | 4 | n/a | Missing | 6 | n/a |
Surgery given | Received surgery | ||||
No | 3 | 99.9 | No | 3 | 99.7 |
Yes | 936 | 0.1 | Yes | 933 | 0.3 |
Don’t know | 0 | 0.0 | Don’t know | 0 | 0.0 |
Missing | 0 | n/a | Missing | 3 | n/a |
Mastectomy | Mastectomy | ||||
Yes | 289 | 30.7 | Yes | 288 | 30.7 |
No | 650 | 69.3 | No | 651 | 69.3 |
Lumpectomy | Lumpectomy | ||||
Yes | 645 | 68.7 | Yes | 695 | 74.0 |
No | 294 | 31.3 | No | 244 | 26.0 |
Other treatment | Other treatment | ||||
No | 929 | 99.9 | No | 215 | 22.9 |
Yes | 0 | 0.0 | Yes | 727 | 77.1 |
Don’t know | 1 | 0.1 | Don’t know | 0 | 0.0 |
Missing | 9 | n/a | Missing | 0 | n/a |
Breast cancer recurrence | Breast cancer recurrence | ||||
No | 889 | 94.7 | No | 865 | 93.4 |
Yes | 50 | 5.3 | Yes | 61 | 6.6 |
Don’t know | 0 | 0.0 | Don’t know | 0 | 0.0 |
Missing | 0 | n/a | Missing | 13 | n/a |
Menopausal status | Menopausal status | ||||
Premenopausal | 520 | 55.4 | Premenopausal | 518 | 55.2 |
Postmenopausal | 248 | 26.4 | Postmenopausal | 242 | 25.8 |
Unknown/missing | 171 | 18.2 | Unknown/missing | 179 | 19.0 |
Agreement between medical records and self-reported treatment is summarized in Table
Agreement analysis1 comparing information from self-administered questionnaires with medical record information in 939 women with breast cancer.
Proportion correct (%) |
Sensitivity (%) | Specificity (%) | PPV (%) | NPV (%) | Kappa | |
---|---|---|---|---|---|---|
Hormone therapy | 92.6 | 93.2 | 95.0 | 95.7 | 92.2 | 0.88 |
Chemotherapy | 93.6 | 97.2 | 96.6 | 92.4 | 96.6 | 0.88 |
Radiation treatment2 | 98.3 | 99.8 | 96.4 | 99.00 | 99.5 | 0.97 |
Surgery | 99.0 | 99.7 | — | 99.7 | — | — |
Breast cancer recurrence | 94.8 | 75.5 | 97.3 | 60.7 | 98.6 | 0.65 |
Menopausal status3 | 95.6 | — | — | — | — | 0.89 |
Menopausal status4 | 83.0 | 0.71 | ||||
Hormonal medication | ||||||
Tamoxifen | 89.9 | 91.1 | 80.9 | 97.3 | 54.8 | 0.60 |
Megestrol | 97.9 | 31.2 | 100.0 | 100.0 | 97.9 | 0.47 |
Anastrozole | 89.8 | 17.6 | 99.1 | 75.0 | 89.2 | 0.25 |
MA12 | 95.7 | 54.5 | 97.5 | 48.0 | 98.9 | 0.49 |
Chemotherapy medication | ||||||
Cyclophosphamide | 55.4 | 56.6 | 40.5 | 91.9 | 7.3 | −0.01 |
Flurouracil | 60.2 | 55.2 | 79.8 | 91.5 | 31.1 | 0.22 |
Methotrexate | 77.0 | 49.3 | 95.1 | 86.9 | 74.2 | 0.48 |
Epirubicin | 82.4 | 54.7 | 97.4 | 92.0 | 78.9 | 0.57 |
Doxorubicin | 83.5 | 48.3 | 96.9 | 85.7 | 83.1 | 0.52 |
Docetaxel | 89.4 | 6.7 | 99.8 | 80.0 | 89.5 | 0.11 |
Surgery | ||||||
Mastectomy | 99.8 | 96.2 | 99.5 | 96.5 | 98.3 | 0.95 |
Lumpectomy | 93.4 | 99.1 | 97.5 | 91.9 | 97.5 | 0.84 |
1Agreement analysis was conducted excluding unknown and missing responses.
2Agreement analysis for radiation therapy was conducted excluding women with breast cancer recurrence (according to medical records).
3Calculated excluding unknown and missing information (i.e. treating menopausal status as a 2-level variable of premenopausal and postmenopausal).
4Calculated including unknown and missing information (i.e. treating menopausal status as a 3-level variable of premenopausal, postmenopausal, and unknown/missing. Unknown/missing information that match between medical records and treatment questionnaire data are treated as in agreement).
Overall the proportion of women who correctly reported having received a broad category of therapy (hormone therapy, chemotherapy, radiation, or surgery) was above 90% for each therapy. Sensitivity and specificity along with positive and negative predictive values were also above 90%, and the kappa statistic was above 0.80 for each category, with the exception of surgery, which is likely attributed to the low number of women who did not have surgery for their breast cancer. Since the kappa statistic takes chance agreement into account, limited variability increases the likelihood that agreement is due to chance alone. Furthermore, there was moderate agreement between medical records and self-reported information regarding whether women experienced breast cancer recurrence or not. Although 94.8% of women correctly reported whether they experienced breast cancer recurrence, sensitivity was only 75.5%, indicating that a quarter of the women experienced breast cancer recurrence according to their medical records but did not report so. In regards to menopausal status, using the more conservative results (including unknown responses and treating menopausal status as a 3-level variable), there was 83.0% agreement between medical records and self-report and a kappa statistic of 0.71 (95% CI: 0.67, 0.75). No other agreement statistics are applicable as there is no clear gold standard.
Women were able to report with low-to-moderate agreement the specific type of hormonal therapy or chemotherapy they received. The proportion of women who correctly reported whether or not they received the specific type of hormonal therapy was above 89% for each medication, while specificity was above 97% for each medication. Sensitivity was high for tamoxifen, however, approximately 69%, 82%, and 46% of women who received megestrol, anastrozole and those who were part of the MA12 trial, respectively, received these medications according to their medical records but did not self-report so. The kappa statistics also demonstrated low-to-moderate agreement for all medications.
In regards to chemotherapy, women could report with low-to-moderate agreement the specific type of medication they received. Specificity was high for all medications with the exception of cyclophosphamide (40.5%), while sensitivity was approximately 50% for each medication with the exception of docetaxel (6.7%), indicating that approximately half of the women who received a given medication according to their medical records did not self-report receiving the medication in question. The kappa statistic also demonstrated low-to-moderate agreement for each medication. In general, it appears as though agreement was lower for the medications commonly used in combination therapies (i.e., cyclophosphamide, methotrexate, and fluorouracil), indicating that women may experience greater difficulty identifying a medication they received in combination with other drugs in comparison to medications they received alone. And lastly, women were able to accurately report whether they received a mastectomy or a lumpectomy with excellent agreement on all statistics calculated.
As demonstrated by Tables
Odds ratios (ORs) and 95% confidence intervals (CIs) for factors potentially associated with agreement between questionnaire and medical record information for broad categories of treatment, menopausal status and specific types of hormonal therapy in 939 women with breast cancer.
Hormonal therapy |
Chemotherapy |
Radiation therapy2 | Menopuasal status |
Tamoxifen |
Megestrol | Anastrozole |
|
---|---|---|---|---|---|---|---|
OR1 (95% CI) | OR1 (95% CI) | OR1 (95% CI) | OR1 (95% CI) | OR1 (95% CI) | OR1 (95% CI) | OR1 (95% CI) | |
Age at diagnosis1 | 1.02 (0.98, 1.06) | 1.02 (0.98, 1.06) | 1.04 (0.91, 1.20) |
|
1.04 (0.99, 1.09) | 1.03 (0.91, 1.16) | 1.01 (0.96, 1.05) |
Recall period1 | 0.88 (0.73, 1.06) | 0.93 (0.77, 1.14) | 1.12 (0.71, 1.76) | 0.96 (0.85, 1.08) | 1.04 (0.82, 1.31) | 1.79 (0.82, 3.92) | 1.17 (0.91, 1.50) |
Marital status (yes versus no) |
|
1.37 (0.72, 2.60) | 0.47 (0.10, 2.16) |
|
1.02 (0.51, 2.06) | 0.46 (0.05, 4.21) | 1.35 (0.71, 2.58) |
English speaking (yes versus no) |
1.26 (0.60, 2.64) | 1.55 (0.74, 3.25) | 1.99 (0.52, 7.61) | 0.03 (0.57, 1.51) | 0.92 (0.35, 2.42) | 1.26 (0.12, 12.98) | 1.37 (0.58, 3.22) |
Breast Cancer Recurrence (yes versus no) |
|
|
— | 1.50 (0.71, 3.20) |
|
|
|
Family history (yes versus no) |
0.88 (0.51, 1.50) | 0.86 (0.49, 1.52) | 3.64 (0.79, 16.75) | 1.11 (0.81, 1.52) | 1.13 (0.60, 2.14) | 1.45 (0.30, 6.94) | 1.40 (0.74, 2.62) |
Alcohol consumption1 | 1.01 (0.96, 1.06) | 1.00 (0.96, 1.05) | 1.04 (0.91, 1.20) | 0.99 (0.96, 1.01) | 0.98 (0.93, 1.03) | 0.97 (0.87, 1.08) | 1.01 (0.95, 1.06) |
Education level | |||||||
Bachelor/graduate | 1.00 | 1.00 | 1.00 | 1.00 | 1.00 | 1.00 | 1.00 |
High school | 1.42 (0.75, 2.68) | 0.52 (0.24, 1.12) | 1.27 (0.30, 5.42) | 0.84 (0.56, 1.27) | 1.29 (0.60, 2.79) | 0.86 (0.12, 5.97) | 1.14 (0.52, 2.50) |
Some vocational/college | 1.64 (0.85, 2.68) | 0.57 (0.27, 1.21) | 1.07 (0.28, 4.08) | 0.74 (0.49, 1.12) | 1.14 (0.53, 2.43) | 1.30 (0.19, 9.15) | 0.77 (0.37, 1.62) |
Smoking status | |||||||
Never | 1.00 | 1.00 | 1.00 | 1.00 | 1.00 | 1.00 | 1.00 |
Current | 0.86 (0.44, 1.68) | 1.27 (0.58, 2.76) | 0.72 (0.16, 3.20) |
|
0.98 (0.46, 2.11) | 0.14 (0.01, 1.70) | 0.74 (0.34, 1.62) |
Former | 1.25 (0.67, 2.32) | 0.77 (0.42, 1.41) | 0.51 (0.16, 1.68) | 0.77 (0.54, 1.10) | 1.80 (0.84, 3.83) | 0.11 (0.01, 1.05) | 0.69 (0.35, 1.33) |
Menopausal status | |||||||
Premenopausal | 1.00 | 1.00 | 1.00 | 1.00 | 1.00 | 1.00 | |
Postmenopausal | 0.62 (0.27, 1.43) | 1.21 (0.50, 2.94) | 0.24 (0.05, 1.27) | — | 0.35 (0.13, 0.95) | 0.74 (0.06, 8.93) | 0.54 (0.21, 1.41) |
Unknown | 0.61 (0.28, 1.32) | 1.27 (0.55, 2.92) | 1.50 (0.16, 14.00) | 0.30 (0.12, 0.70) | 1.07 (0.08, 13.73) | 0.63 (0.26, 1.52) |
1Variables were treated as continuous variables.
2Odds ratio (OR) adjusted for all other variables included in the table.
3Agreement analysis for radiation therapy was conducted excluding women with breast cancer recurrence (according to medical records).
Odds ratios (ORs) and 95% confidence intervals (CIs) for factors potentially associated with agreement between questionnaire and medical record information for specific types of chemotherapy medication in 939 women with breast cancer.
Cyclophosphamide | Fluorouracil | Methotrexate | Epirubicin | Doxorubicin | Docetaxel | |
---|---|---|---|---|---|---|
OR1 (95% CI) | OR1 (95% CI) | OR1 (95% CI) | OR1 (95% CI) | OR1 (95% CI) | OR1 (95% CI) | |
Age at diagnosis1 |
|
|
|
0.99 (0.96, 1.03) | 0.96 (0.92, 1.00) | 1.01 (0.96, 1.06) |
Recall period1 |
|
|
0.88 (0.75, 1.03) | 0.92 (0.77, 1.11) | 0.84 (0.71, 1.00) | 1.31 (0.97, 1.76) |
Marital status (yes versus no) | 0.74 (0.46, 1.20) | 0.78 (0.48, 1.27) | 0.78 (0.45, 1.38) | 0.84 (0.45, 1.57) | 0.84 (0.45, 1.56) | 1.64 (0.79, 3.42) |
English speaking (yes versus no) | 1.98 (1.05, 3.73) | 1.18 (0.97, 2.34) | 1.47 (0.76, 2.85) |
|
0.76 (0.33, 1.75) | 1.59 (0.59, 4.31) |
Breast cancer recurrence (yes versus no) | 0.81 (0.40, 1.64) | 0.59 (0.29, 1.19) | 0.88 (0.40, 1.93) | 0.63 (0.29, 1.37) |
|
|
Family history (yes versus no) | 0.95 (0.63, 1.44) | 1.09 (0.72, 1.65) | 1.02 (0.64, 1.64) | 1.10 (0.65, 1.88) | 0.88 (0.52, 1.48) | 1.42 (0.68, 2.98) |
Alcohol consumption1 | 1.01 (0.97, 1.05) | 1.02 (0.98, 1.06) | 1.05 (1.00, 1.11) | 1.03 (0.97, 1.08) | 1.00 (0.96, 1.05) |
|
Education level | ||||||
Bachelor/graduate | 1.00 | 1.00 | 1.00 | 1.00 | 1.00 | 1.00 |
High school |
|
|
0.87 (0.47, 1.58) | 0.56 (0.28, 1.12) | 0.75 (0.39, 1.48) | 0.91 (0.36, 2.27) |
Some vocational/college | 0.68 (0.42, 1.11) | 0.67 (0.41, 1.10) | 1.02 (0.58, 1.82) | 0.56 (0.29, 1.05) | 0.99 (0.51, 1.90) | 0.56 (0.25, 1.27) |
Smoking status | ||||||
Never | 1.00 | 1.00 | 1.00 | 1.00 | 1.00 | 1.00 |
Current | 0.66 (0.39, 1.11) | 0.83 (0.50, 1.39) |
|
1.50 (0.75, 3.02) |
|
0.64 (0.27, 1.48) |
Former | 1.02 (0.65, 1.60) | 1.19 (0.76, 1.87) | 0.95 (0.56, 1.62) | 1.19 (0.68, 2.09) | 0.76 (0.42, 1.38) | 0.75 (0.36, 1.53) |
Menopausal status | ||||||
Premenopausal | 1.00 | 1.00 | 1.00 | 1.00 | 1.00 | 1.00 |
Postmenopausal | 0.73 (0.36, 1.49) | 0.96 (0.47, 1.94) | 0.84 (0.38, 1.84) | 0.86 (0.35, 2.14) | 1.05 (0.43, 2.53) | 0.62 (0.19, 2.03) |
Unknown | 1.60 (0.88, 2.91) | 1.63 (0.89, 2.97) | 1.48 (0.73, 2.99) | 1.09 (0.51, 2.33) | 1.64 (0.75, 3.59) | 1.54 (0.53, 4.71) |
1Variables were treated as continuous variables.
2Odds ratio (OR) adjusted for all other variables included in the table.
Furthermore, although no other factors were consistently associated with agreement pertaining to accurately reporting broad categories of treatment, or specific types of hormonal therapy medications received, older age at diagnosis, longer periods of recall, being born in a non-English-speaking country (in comparison to a non-English-speaking country), increased alcohol consumption, having a high-school education (in comparison to a bachelor degree), and being a current smoker (in comparison to a nonsmoker) were associated with worse agreement for some specific types of chemotherapy medications. In regards to agreement between menopausal status from a subsequent questionnaire and medical records, agreement was lower among older women, married women, and among current smokers (OR = 0.92, 95% CI: 0.91, 0.94, OR = 0.69, 95% CI: 0.40, 0.87, and OR = 0.63, 95% CI: 0.42, 0.96 for age at diagnosis, being married, and current smoking, resp.).
This study demonstrates that accuracy of self-reported treatment compared to medical records was high for most broad categories of treatment received (i.e., hormonal therapy, chemotherapy, and radiation). The low specificity and kappa statistic for surgery reporting are likely due to the fact that very few women did not receive surgery for their breast cancer. In regards to menopausal status at time of diagnosis, agreement between medical records and self-report information was also relatively high. Women were only able to report whether they experienced breast cancer recurrence or not with moderate accuracy. We also observed that agreement was moderate for some, but not all, types of treatment received within the broad categories of treatment (i.e., the type of hormonal therapy and chemotherapy received). The results of this study are generally consistent with previous research which also identified that women are able to accurately recall some important details pertaining to their treatment [
We also found that women had the greatest difficulty reporting the type of chemotherapy received, specifically for medications commonly used in combination therapies (i.e., cyclophosphamide, methotrexate, and fluorouracil). Furthermore, agreement for the specific type of therapy given within the broad categories of treatment appeared to be higher for questions including prompts. For example, in regards to surgery, women were asked to specify whether they received a lumpectomy or a mastectomy, whereas in questions pertaining to the details of hormonal therapy and chemotherapy received, the open-ended instructions of “please list medicines if known” were given. Accordingly, future questionnaires designed to assess self-reported treatment history may want to consider adding prompts to aid recall, specifically when women are being asked to report on treatments that may include combination therapies. Although there are disadvantages associated with adding prompts (i.e., they may deter respondents from considering responses that are not already presented), at the very least further research is warranted to examine which approach encourages more accurate reporting of specific therapies received.
In regards to the factors associated with agreement, women with breast cancer recurrence were less likely to report having received hormonal therapy, chemotherapy, all types of specific hormonal therapy medications, and the chemotherapy medications doxorubicin and docetaxel. This finding is consistent with a previous study conducted by Phillips et al. (2005), who found women with breast cancer recurrence at the time of questionnaire administration were less likely to report correctly on most questions (aside from chemotherapy treatment) [
No other factors were consistently associated with better agreement; however, older age at diagnosis, longer recall period, being born in a non-English-speaking country (in comparison to an English-speaking country), increased alcohol consumption, having a high-school education (in comparison to a bachelor degree), and being a current smoker (in comparison to a nonsmoker) were all associated with worse accuracy when reporting some specific types of chemotherapy medication. In regards to education level, alcohol consumption, and smoking status, it is possible these factors may indicate lower socioeconomic status.
Strengths of this study include a large sample size of women recruited from a sample of women initially identified from a population-based cancer registry. Furthermore, although four studies have previously examined the accuracy of self-reported breast cancer treatment, only three of these studies used medical records as the gold standard when assessing agreement, and only two of these studies examined potential factors associated with agreement. To our knowledge, this study is also the first study to examine agreement between menopausal status recorded in medical records at the time of diagnosis and retrospective assessment of menopausal status from a structured questionnaire.
There are several limitations to this study. Medical records may not always be an appropriate gold standard. For example, a prescription may have been given but was not retrieved in the current collection of medical records or the medication may not have actually been taken, although this is less likely with treatments given in a clinic setting such as radiation or most chemotherapy. However, agreement is still high despite this possibility. Furthermore, a Swedish prospective cohort study also confirmed the validity of self-reporting current hormonal therapy using a 7-day personal diary as the gold standard [
In conclusion, the results of this study demonstrate that women can accurately report important details regarding their breast cancer treatment, even, in some cases, for more specific questions pertaining to the details of treatment within the broader categories of hormonal therapy, chemotherapy, and surgery. Accordingly, self-report appears to be an inexpensive method of data collection pertaining to broad categories of cancer treatment, if not always specific drugs, and a feasible alternative to medical record abstraction in large epidemiological studies of breast cancer patients where intensive medical record abstraction may not be possible.
The authors declare that they have no competing interests.
This work was supported by the National Cancer Institute, National Institutes of Health under RFA no. CA-06-503 and through cooperative agreements with members of the Breast Cancer Family Registry (BCFR) and Principal Investigators, including Cancer Care Ontario (U01 CA69467). The content of this paper does not necessarily reflect the views or policies of the National Cancer Institute or any of the collaborating centers in the BCFR, nor does mention of trade names, commercial products, or organizations imply endorsement by the US Government or the BCFR. The authors also wish to thank the members of the Ontario Cancer Genetics Network and the staff and participants of the OFBCR.