Methods
A two-group, experimental, longitudinal design was used to compare women who were assigned randomly to the intervention group ( n = 67) or to an attention control group ( n = 70) at baseline within 48 hours after surgery and 1, 3, and 6 months after surgery. These time intervals were selected to represent critical transitions in recovery along the illness trajectory, including the first 100 days of the existential plight triggered by the diagnosis ( Weisman & Worden, 1976 ).
From December 2003 to June 2006, recruitment took place at an urban teaching hospital associated with a comprehensive cancer center. Inclusion criteria were: (a) a suspected primary diagnosis of ovarian cancer following abdominal surgery; (b) prognosis of at least 6 months; (c) discharged from hospital with an order to initiate chemotherapy; (d) 21 years of age or older; and (e) living within the State of Connecticut. All subjects received their initial care on inpatient surgical units at an academic medical center in the Northeast.
The study was approved by the Institutional Review Boards at Yale University School of Nursing and the participating hospital. At daily gynecological oncology rounds, a staff nurse identified patients who met inclusion criteria and subsequently approached patients about their willingness to learn more about the study. The Project Director then met with eligible patients in the hospital to obtain consent and administer baseline questionnaires. Once baseline data were completed, the sealed envelope technique was used to randomize patients into the intervention or attention control group. Block randomization was done by the statistician using random tables in groups of six, and only the Project Director had knowledge of the sequence within a specific block. The intervention staff for both groups was blinded to group assignment, as well as the research assistants who interviewed patients to complete their self-report questionnaires.
The specialized nursing intervention was designed to target specific problems within each phase of the illness trajectory. The intervention consisted of 18 contacts by an oncology APN during the first 6 months after hospital discharge. These contacts occurred in patients' homes or by telephone: two contacts per week the first 30 days and one contact every other week through 180 days. Initial contacts over the first month were more intensive to prevent and monitor postoperative complications. Subsequent contacts were bimonthly to ensure stabilization. The APN's primary objective was to assist patients in developing and maintaining self-management skills, facilitate their active participation in decisions affecting their treatment, and monitor and manage their physical and psychological health. The APN's activities included symptom management, counseling, education, direct nursing care, coordination of resources, and referrals ( Hughes, Hodgson, Muller, Robinson, & McCorkle, 2000 ). Intervention strategies were tailored to each patient's needs and personal priorities, and were determined jointly by the APN and patient.
Screening for emotional distress was completed at baseline using the Distress Thermometer for the entire sample ( Roth et al., 1998 ). Women in the intervention group who scored four or greater on the scale, indicating significant distress, received an evaluation by the psychiatric consultation liaison nurse (PCLN). Based on the PCLN evaluation, the APN developed a collaborative plan of care targeting the patient's specific emotional needs. Women in the attention control group who indicated emotional distress received usual care from the medical social worker assigned to the gynecological service.
All patients in the study, regardless of randomization assignment, received the Symptom Management Toolkit, a health education manual with information about intervention strategies to address 16 symptoms commonly experienced postsurgically or with chemotherapy. The Toolkit contains descriptions for each symptom and includes etiology, strategies for management, and advice about when to call the oncologist ( Given, Given, & Espinosa, 2003 ).
The attention control intervention consisted of 9 contacts by a research assistant during the 6 months. The research assistant's objective was to instruct patients on use of the Toolkit and facilitate proposed strategies. Patients whose concerns extended beyond the purview of the Toolkit were encouraged to call their oncologists.
The research assistant's initial contact took place in the patient's home. Subsequent contacts were via telephone; weekly the first month followed by monthly calls through the remaining 5 months ( Table 1 ).
Health care utilization was measured as the number of inpatient admissions and outpatient visits, including emergency room visits, oncology outpatient visits, and primary care visits as reported by the patients at each of their intervention contacts. A medical record review to document healthcare utilization was done following the patients' 6-month enrollment in the study, but not all subjects received follow-up care at the cancer center. In addition, the documentation of outpatient visits was incomplete. A 95% agreement was obtained between the self-report data and the medical record review for hospitalizations and emergency room visits on the 123 participants treated at the cancer center. Therefore, only self-report data was used to include the additional 22 participants treated at network affiliate hospitals.
Patient demographic and clinical information was self-reported and collected at baseline using an investigator-developed form. Four standardized scales with valid and reliable psychometric properties were used to measure quality of life outcomes: depressive symptoms, uncertainty, symptom distress, and physical and mental health.
Depressive symptoms were measured using the 20-item Center for Epidemiological Studies-Depression Scale (CES-D). The total score ranges from 0 to 60, with a score of 16 or more indicating impairment. Original reporting of Cronbach's alpha for the reliability of the CES-D ranged from 0.84 to 0.90 ( Radloff, 1977 ).
Uncertainty was measured using the five items of the unpredictability subscale of the Mishel Uncertainty in Illness Scale. Mishel defines uncertainty as “the person's inability to determine the meaning of illness-related events” and unpredictability is the “lack of contingency between illness and treatment cues and illness outcomes” ( Mishel, 1981 , p. 259). Unpredictability scores range from 5 to 25, with higher scores indicating more uncertainty with respect to unpredictability. The scale has been found to be reliable and stable across multiple populations ( Mishel, 1981 ).
Symptom distress was measured using the Symptom Distress Scale, which contains 13 symptoms commonly experienced by patients with cancer. Total symptom distress is obtained as the unweighted sum of the 13 items, a value that can range from 13 to 65. Both internal consistency and test-retest reliability estimates indicated the scale was reliable ( McCorkle & Young, 1978 ).
Physical and mental health was measured using the Short-Form Health Survey (SF-12), which consists of 12 items representing physical and mental health. Higher scores represent better health status. Test-retest reliability of the physical and mental subscales have been reported as .89 and .76, respectively ( Ware, Kosinski, Turner-Bowker, & Gandek, 2007 ).
Because the clinical trial was not designed to focus on healthcare utilization outcomes in cancer patients, the sample size was not determined for this analysis. Due to a lack of studies testing the APN intervention effect on the healthcare utilization from previous studies, the power analysis for this study could not be conducted. Alternatively, the estimated healthcare utilization and effect sizes between the APN intervention and control groups are provided from the regression models in the result section.
Differences in healthcare utilization between the APN intervention and control groups were examined using regression models with count data. In descriptive analysis, the proportions of zero (no utilization) and the average number of utilization instances were compared by intervention group and the stage of cancer. Healthcare utilization could occur through two phases of decision-making process ( Gerdtham, 1997 ). The first phase represents whether patients have urgent problems to be hospitalized or visit emergency rooms, or whether they decide to visit an oncologist or primary physician. Only a small proportion of patients may have serious or urgent physical problems within 6 months after surgery. The second phase explains how many times those problems reoccur or patients decide to visit physicians repeatedly. The Poisson and negative binomial hurdle models are used to estimate the amount of healthcare utilization with two regression parts incorporating these two portions ( Carmeron & Trivedi, 1998 ). The hurdle models were developed for comparing four types of healthcare utilization using PROC NLMIXED, SAS version 9.1.
The APN intervention group reported higher emotional distress at baseline using the Distress Thermometer than the attention control group. Therefore, in the multivariate analysis using the hurdle model, the effects of the intervention and other covariates on healthcare utilization were tested after controlling for the Distress Thermometer score at baseline. Using the likelihood function, the Akaike Information Criterion (AIC), and the Bayesian Information Criterion (BIC), either the Poisson or negative binomial hurdle model was selected for the final model. To hold the .05 level of significance for these multiple tests, p-values were compared with .0125 (= .05/4) using the Bonferroni correction. Therefore, the probability of falsely concluding significant intervention effects on any of four types of utilization is .05 if the true intervention effects on all outcomes were not significant.
Results
A total of 281 women were identified as eligible to participate in the study. Sixty-two were lost to follow-up, primarily because they were not scheduled for chemotherapy, or they were scheduled for treatment at another center. Of the remaining 219 women, 149 enrolled (68%). The main reasons for refusal to consent included unwillingness to take on one more thing ( n = 18), not interested ( n = 15), family refused ( n = 14), patient too ill ( n = 12), involved in another study ( n = 6), requiring extra nursing care ( n = 4), and fear of research ( n = 1). Four enrolled subjects were excluded due to lack of complete data at baseline; the final sample consisted of 145 women ( Figure 1 ). Among those 145 women, there were 121 women who had complete information at Wave 2, Wave 3, and Wave 4. Therefore the sample size for this analysis was 121 women with three waves of follow-up data (363 observations); 62 were from the attention control group and 59 from the intervention group. 1
Patient characteristics in intervention and attention control groups were similar ( Table 2 ). The recurrent patients were about 25%. Fifty-eight percent had a primary diagnosis of ovarian cancer; 32% of the patients were diagnosed at an early stage. The average cost of medical expenditures the month before surgery was about $9,500. The mean comorbidity index was 2.9 diseases ( Satariano, Ragheb, & Depuis, 1989 ).
Differences in individual characteristics and the baseline quality of life scales between the two groups were examined using t-tests. Patients who were assigned to the APN intervention were more likely to have less physical function, more symptom distress, more depressive symptoms, and more uncertainty at baseline compared to those assigned to the attention control group. Other individual characteristics were not significantly different between the groups.
The proportion of no hospitalizations and outpatient visits and the average number of these health care utilization instances by the intervention and the cancer stage are shown in Table 3 . Among individuals who reported at least one visit, patients receiving the APN intervention (2.75±2.03) tended to have fewer primary care visits compared to those in the attention control group (3.59±4.66). Within a month after hospital discharge, no significant difference in healthcare utilization was seen between the groups. Patients with late-stage cancer reported more hospitalizations. Greater average hospitalizations were observed in patients with late-stage cancer compared to those with early-stage cancer.
The effects of an APN intervention on four types of healthcare utilization were examined using the hurdle model after controlling for baseline distress thermometer scores and other covariates ( Table 4 ). The regression of nonzero counts includes the covariate coefficients to estimate the mean amount of healthcare utilization, whereas the regression of zero counts represents the coefficients to estimate the probability of no utilization. Because there was no inflation of zero counts in oncology outpatient visits, a general negative binomial model without the regression of zero counts was used for oncology visits. Patients who received the APN intervention reported fewer primary care visits (beta = −0.59±0.16, p = .0003). The intervention effect was significant for primary care visits at the .05 level of significance using the Bonferroni correction.
Patients who had early-stage cancer were more likely to have a problem that required hospitalization (beta = 1.91±0.55, p = .0007). Older patients were associated with fewer number of hospitalizations than younger patients (beta = -0.03, SE = 0.01, p = .0422). There were no other significant covariates associated with emergency room visits. Women with greater uncertainty reported more oncology outpatient visits. Women with high emotional distress, better physical function, and more uncertainty tended not to use their primary care physicians, but women with greater depressive symptoms had significantly more visits to their primary care providers at the .05 level.
Using the estimated mean number of healthcare utilization from the models, effect sizes were estimated in four types of healthcare utilization. These effect sizes were adjusted for differences in baseline health outcomes between the intervention groups. Fairly small effect sizes were estimated in hospitalizations (effect size = 0.01) and oncology outpatient visits (effect size = 0.07). However, a relatively large effect size of 0.36 was estimated in emergency room and primary care visits. The estimated emergency visits effect size is larger in the APN intervention (APN = 0.38 vs. Attention control = 0.28), whereas primary care visits was estimated more frequently in the attention control group (APN = 1.58 vs. Control = 2.45).
Observed distributions of healthcare utilization (emergency room visits and primary care visits) and estimated distribution from the hurdle models are shown in Figures 2 and 3 . The estimated distributions from the hurdle model show a fairly good fit for the observed utilization. That is, the hurdle models successfully represent the large number of no utilization, which cannot be fitted using general regression models.
Discussion
A 6-month intervention provided by oncology APNs was tested to see if it would produce lower healthcare utilization by women treated for ovarian cancer after surgery compared to women who received a symptom management educational intervention only. Almost 63% of women in both groups were not hospitalized and over 76% were not admitted to the emergency room over the 6 months after surgery. However, for the subsample of women who used healthcare services, there were no differences in hospitalizations between the two groups. In addition, there were no differences in oncology outpatients visits between the two groups. These two findings were expected because the women were managed by a single group of gynecological surgeons who also monitored the women for their chemotherapy treatments. The protocols were well-established and most of the hospitalizations and oncology outpatient visits were scheduled for treatment and were not urgent visits. The practice of gynecological oncology surgeons treating women with chemotherapy is standard in this specialization and may have been an important factor in the significant reduction of depressive symptoms and improved mental health in both groups. Results of the quality of life outcomes are reported elsewhere ( McCorkle et al., 2009 ).
In the subsample of high users, there was a trend ( p = .0852) in the number of emergency room visits between the two groups; the intervention group visited more often. This trend towards more emergency room visits was not surprising given that the intervention provided by the APNs included instructing patients to go there when they reported experiencing symptoms needing urgent medical care after hours. The APNs recognized symptoms related to wound infections, bleeding, and bowel obstructions that could not be managed at home. This subsample of women who went to the emergency room were younger, were receiving aggressive chemotherapy, and had greater numbers of comorbidities requiring close surveillance.
The main finding of this study was a significant difference in the number of primary care visits between the two groups. Women in the attention control group went to their primary care providers more often than the intervention group. The women in the attention control group who required more visits reported more depressive symptoms and better physical health than the APN intervention group. Since the number of women with emotional distress and comorbid conditions were equal at baseline across the two groups, it seems reasonable that the interventions provided by the APNs in conjunction with the PCLN assisted those women with depressive symptoms, whereas the attention control group sought additional help through their primary care providers. This is an important finding since neither group had additional hospitalizations.
The findings underscore that the most effective cancer care requires a practice home for each patient. This home can be housed within medical oncology or primary care, depending on the circumstances (e.g. geographical variations, insurance). The home requires that one practice team holds itself accountable to patients to guide and support patients along the cancer-care continuum. Primary care providers are key in the management of patients for their ongoing health maintenance, but they may think they do not have adequate information to answer cancer patients' questions. Oncology providers can serve as the practice home, if patients are referred to oncology upon suspicion or confirmation of a diagnosis. Ideally, through coordination of care with primary care physicians, oncology providers can ensure that patients' general preventative needs are met and comorbid conditions, including mental health conditions, are well-managed ( McCorkle et al., in press ).
There are a number of important limitations to be considered when interpreting the findings. These results are based on women undergoing surgery and chemotherapy for ovarian cancer and may not be applicable to people with other cancers. Also, the sample was recruited from one comprehensive cancer center at an academic facility in the Northeast, and treatments may vary by geographical regions and community settings. Data were limited to self-report questionnaires and need to be validated with other approaches. The healthcare utilization variables measured were also self-report accounts by the women and measured at varied times by both groups. These data, instead of medical record review data, are reported because not all subjects received ongoing care at the same institution and access to their medical records was not obtained for the full sample; therefore, the self-report data were more complete. Finally, the number of subjects who reported healthcare utilization was small; additional research is needed with a larger sample.
The current findings advance the understanding of healthcare services used by women while they are receiving chemotherapy for ovarian cancer. These findings highlight the need for healthcare providers representing various disciplines to coordinate services across specialties, especially for women who have high emotional distress or depressive symptoms, and who are younger. The significance of the findings regarding the presence of depressive symptoms in women who were high users of healthcare services is important for all physicians and other healthcare providers caring for women receiving cancer treatment. The transition of patients from hospital to outpatient care and from surgical services to medical oncology is a time of high uncertainty and needs to be recognized as a priority in ensuring quality care ( Institute of Medicine, 2008 ).
Yancik, Ganz, Varricchio, and Conley (2001) have noted that little is known about the effect of comorbid conditions on cancer and cancer treatment. They have advocated for the development of systems to identify and monitor comorbid conditions at the time of diagnosis and over time. This will become even more apparent as people continue to live longer with the increased likelihood of developing cancer alongside age-related comorbid conditions, including mental health conditions. Aziz (2006) expands this recommendation to survivorship in that quality care includes systems to manage, treat, and prevent comorbidities. Multidisciplinary partnerships should begin at diagnosis, continue during treatment and throughout follow-up, and not be limited to survivorship care at the completion of treatment. Effective symptom management and recognition by clinicians of the patient's prediagnostic comorbid conditions are critical factors to be considered in the management of these women. In this study, APNs provided the essential monitoring of patients' emotional distress along with physical and psychosocial interventions to ensure recovery after surgery and during chemotherapy treatment.
Certainly the use of APNs to monitor and manage patient symptoms during cancer treatment may increase the appropriate use of emergency room services because patients were encouraged to seek the urgent care they needed. Such interventions may decrease the use of primary care services, because more everyday concerns are met by APNs in oncology outpatient settings. As a result, such interventions may save healthcare dollars in hospitalizations and increase spending in other areas. The evidence signals the need for additional research to test the effects of various models of care that can bridge between two worlds – the fragmented, poorly coordinated healthcare system and the complex biopsychosocial needs of cancer patients and their families during cancer treatment ( Cheung, Neville, Cameron, Cooke, & Earle, 2009 ).
The committee for the IOM report (2008) developed a model for effective delivery of psychosocial services that includes coordination among specialties. Key aspects of the model were: (a) identifying physical and psychosocial health needs, (b) linking patients and families to services they need, (c) supporting patients and families as they manage the illness, (d) coordinating psychosocial and biomedical care, and (e) following up on the delivery of care to determine effectiveness, and making modifications as needed. The findings underscore the committee's recommendations, but the challenge is to identify strategies for implementing models of care for facilitating patients' coordination and management across specialties that address the whole patient and then determining how to make them cost-effective.
Text is read by the "Ask this paper" AI Q&A widget below.
Extraction quality varies by source — PMC NXML preserves structure
cleanly, OA-HTML may include some navigation residue, and OA-PDF can
have broken hyphenation. The publisher copy
(via DOI)
is the canonical version.