PMCCPMCCPMCC

Search tips
Search criteria 

Advanced

 
Logo of jpmMary Ann Liebert, Inc.Mary Ann Liebert, Inc.JournalsSearchAlerts
Journal of Palliative Medicine
 
J Palliat Med. 2012 September; 15(9): 1027–1036.
PMCID: PMC3422053

Determination of Cutpoints for Low and High Number of Symptoms in Patients with Advanced Cancer

Stephanie Gilbertson-White, R.N., Ph.D.,1 Bradley E. Aouizerat, Ph.D., M.A.S.,1 Thierry Jahan, M.D.,2 Steven M. Paul, Ph.D., Claudia West, R.N., M.S.,1 Karen Schumacher, R.N., Ph.D.,3 Marylin J. Dodd, R.N., Ph.D.,1 Michael Rabow, M.D.,2 Ahmad H. Abu Raddaha, R.N., M.S.N., Ph.D.,1 and Christine Miaskowski, R.N., Ph.D., FAANcorresponding author1

Abstract

While patients with advanced cancer experience a wide range of symptoms, no work has been done to determine an optimal cutpoint for a low versus a high number of symptoms. Analytic approaches that established clinically meaningful cutpoints for the severity of cancer pain and fatigue provided the foundation for this study. The purpose of this study was to determine the optimal cutpoint for low and high numbers of symptoms using a range of potential cutpoints and to determine if those cutpoints distinguished between the two symptom groups on demographic and clinical characteristics and depression, anxiety, and quality of life (QOL). Patients with advanced cancer (n=110) completed a symptom assessment scale, and measures of depression, anxiety, and QOL. Combinations of cutpoints were tested to yield one- and two-cutpoint solutions. Using analysis of variance for QOL scores, the F-ratio that indicated the highest between-group difference was determined to be the optimal cutpoint between low and high number of symptoms. A cutpoint of ≤12 symptoms (i.e., 0–12 is low, 13–32 is high) was the optimal cutpoint for total number of symptoms. Significant differences in depression, anxiety, and QOL scores validated this cutpoint. Psychological symptoms had higher occurrence rates in the high symptom group. Findings suggest that a threshold exists between a low and a high number of symptoms in patients with advanced cancer. Psychological symptoms were significantly different between patients in the low versus high symptom groups and may play an important role in QOL outcomes in patients with advanced cancer.

Introduction

Serlin and colleagues provided evidence to support the establishment of clinically meaningful cutpoints for mild, moderate, and severe pain in oncology patients.1 Since 1995, several studies refined these cutpoints for acute,2,3 chronic,4 and cancer5 pain and established cutpoints for cancer-related fatigue.6 Cutpoints were created based on the idea that within the symptom experience, symptom severity comprised the internal sensory dimension and interference caused by symptoms comprised the external reactive dimension.1 The nonlinear relationship between severity and interference with function was demonstrated by a statistically significant “jump” in interference scores as symptom severity went from mild to moderate or moderate to severe.15

Clinically meaningful cutpoints have served as a foundation for treatment guidelines. For example, the National Comprehesive Cancer Network used these cutpoints to establish treatment algorithms for cancer pain7 and fatigue management.8 In addition, cutpoints can be used to determine if management strategies are effective.7

Findings from recent reviews suggest that patients with advanced cancer experience numerous concurrent symptoms.9,10 Across 46 studies, 24 different symptoms occurred in ≥20% of the pooled samples. While total number of symptoms was not examined as a factor that contributes to significant decrements in quality of life (QOL), various components of this concept of symptom burden11,12 (e.g., symptom severity13,14 and symptom distress15,16) were associated with significant decreases in functional status and QOL. In addition, symptom assessment is a clinically meaningful proxy for QOL and an extremely reliable patient reported outcome.11,17 Therefore, it is reasonable to suggest that QOL could be used as an outcome to evaluate clinically meaningful cutpoints for low and high number of symptoms in patients with advanced cancer. In addition, given that patients with advanced cancer report more symptoms than patients with earlier-stage disease,9,18 and comprehensive, multidimensional symptom assessment tools may be burdensome for patients and clinicians, the determination of a cutpoint for number of symptoms might have some clinical utility. Routine screening with a symptom checklist could determine a patient's total number of symptoms. Then clinicians could use a low/high cutpoint to identify high-risk patients who warrant more-in-depth assessments and/or more-aggressive symptom management interventions.

Expanding on Serlin and colleagues' idea,1 in this study total number of symptoms was viewed as the sensory dimension of the symptom experience, and QOL was viewed as the reactive dimension. If total number of symptoms has a nonlinear relationship with QOL (as does pain severity and interference), then a significant jump in QOL scores would occur as the total number of symptoms goes from low to high. Said another way, clinically meaningful differences in total number of symptoms would be associated with significant differences in QOL. This hypothesis is supported by clinical observations in which patients with advanced cancer manage relatively well with a “low” number of symptoms. However, when the total number of symptoms crosses some threshold between low and high, various QOL domains are impaired and symptom management interventions are not effective. Therefore, the purposes of this study, in a sample of patients with advanced cancer, were to determine the optimal cutpoint for low and high number of symptoms using a range of potential cutpoints and to determine if those cutpoints distinguished between the symptom groups in any demographic and clinical characteristics as well as in depression, anxiety, and QOL.

Methods

Design and sample

This descriptive study of 110 patients is part of an ongoing randomized clinical trial that will determine the efficacy of two different doses of a psychoeducational intervention to improve cancer pain management. Patients were included if they: were adult oncology outpatients (≥18 years of age) experiencing cancer pain of somatic or visceral origin; were able to read, write, and understand English; agreed to participate and provided written informed consent; had a Karnofsky Performance Status (KPS) score of ≥50; had an average pain intensity score of ≥3.0 on a 0 to 10 numeric rating scale (NRS); had a life expectancy of ≥6 months; and had a telephone line. Patients were excluded if they: had neuropathic cancer pain; had a documented previous or current psychiatric disorder; or were receiving hospice care, in order not to interfere with the pain management program provided by hospice.

Settings

Patients were recruited from a comprehensive cancer center, two veterans' affairs hospitals, and four community-based oncology clinics. They were asked by a clinician at the site about study participation. If the patient was interested, the clinician informed the research nurse, who discussed the study and obtained written informed consent. Questionnaires were completed in patients' homes prior to the onset of the intervention.

Instruments

The Patient Information Questionnaire obtained demographic characteristics and KPS score.19,20 The valid and reliable Self-Administered Comorbidity Questionnaire (SCQ), with scores that range from 0 to 39, provided information on comorbidities.21,22 Medical records were reviewed to obtain information on cancer diagnosis, current treatments, reason for current treatments, and metastatic sites.

The Memorial Symptom Assessment Scale (MSAS) contains a list of 32 physical and psychological symptoms that occur as a result of cancer or its treatment. Patients were asked to indicate whether they had experienced each symptom in the past week (i.e., symptom occurrence). If they had experienced the symptom, they were asked to rate its frequency of occurrence, severity, and distress. MSAS was developed for use with oncology patients23,24 and has established validity in palliative care patients.25

Multidimensional Quality of Life Scale–Cancer Version 2 (MQOLS-CA2) is a 33-item instrument that measures five dimensions of QOL (i.e., psychological well-being, general physical well-being, nutrition, symptom distress, and interpersonal well-being).26,27 Each item is rated on a 0 to 10 NRS with higher scores indicating a better QOL. MQOLS-CA2 has well established validity and reliability.26,27

Measures used to validate cutpoints

The Center for Epidemiologic Studies–Depression (CES-D) scale consists of 20 items selected to represent the major symptoms in the clinical syndrome of depression. Higher scores indicate higher levels of depression. CES-D has well established concurrent and construct validity.28,29

Spielberger State–Trait Anxiety Inventories (STAI-S and STAI-T) each consist of 20 items. Scores can range from 20 to 80. Higher scores indicate greater anxiety. STAI-T measures an individual's predisposition to anxiety determined by his or her personality and estimates how a person generally feels. STAI-S measures an individual's transitory emotional response to a stressful situation. Both inventories have well established validity and reliability.30,31

The Medical Outcomes Study–Short Form (MOS-SF36), a 36-item instrument, is a generic measure of QOL. It consists of eight subscales and two component scores that evaluate important health concepts. Higher scores indicate better QOL.32,33

Data analysis

Data were analyzed using SPSS 18.0 (SPSS Inc., Chicago, IL). Descriptive statistics were used to characterize the sample and the study variables. Symptom occurrence rates were generated for each of the symptoms evaluated on the MSAS. Total number of symptoms was calculated by summing the number of symptoms based on a response on any one of the four dimensions—occurrence, frequency, severity, and distress.

A cutpoint that divided the sample into low and high number of symptoms was created using the analytic strategy of Serlin and colleagues.1 Twelve categorical variables that represented dichotomizing the number of symptoms into low and high using the twelve possible cutpoints between 5 and 16 were created (e.g., 0–5=low, 6–32=high, 0–6=low, 7–32=high, and so on up to 0–16=low, 17–32=high) and related to the five MQOLS-CA2 subscales using multivariate analysis of variance (MANOVA) and to the MQOLS-CA2 total score using analysis of variance (ANOVA). Combinations of cutpoints were tested to yield two cutpoints (three groups) as well as one cutpoint (two groups) solutions. The criterion used to determine the optimal cutpoint groups was the F-ratio for the between-group effect for both the MANOVA and the ANOVA (Table 1). While attempts were made to establish cutpoints for low, medium, and high total number of symptoms, a clear cutpoint between medium and high was not identified. Therefore, the analysis proceeded to determine a single cutpoint solution. Five symptoms was selected as the lower limit and 16 symptoms as the upper limit of testable cutpoints, because no patient reported fewer than 5 symptoms, and 16 symptoms was approximately equal to the mean number of symptoms for the sample.

Table 1.
Results of the Cutpoint Analyses for Total Number of Symptoms Using the Total and Subscale Scores from the Multidimensional Quality of Life Scale–Cancer Version 2

To determine if the optimal cutpoint for the total number of symptoms differed between the low and high symptom groups on demographic and clinical characteristics, independent sample t-tests and χ2 and Kendall's tau analyses were used. Preliminary analyses revealed significant between-groups differences for age and living arrangements. Because only age is associated with depression,34,35 anxiety36 and/or QOL37,38 analyses of covariance (ANCOVA), controlling for age, were used to evaluate for between-group differences in these measures. All calculations used actual values. Adjustments were not made for missing data. Therefore, the cohort for each analysis was dependent on the largest set of complete data between the groups. A p-value of<0.05 was considered statistically significant.

Results

Cutpoint calculations

As shown in Table 1, a cutpoint of ≤12 symptoms (i.e., 0–12 symptoms is low and 13–32 symptoms is high) was the optimal cutpoint, in that it had the largest between-group F-ratios for both the MQOLS-CA2 subscale and total scores. Using ≤12 symptoms as the cutpoint, 60.9% of the sample (n=67) was classified as having a high number of symptoms.

Differences in demographic and clinical characteristics

Consistent with the American Cancer Society's definition of advanced cancer,39 the majority of the patients had metastatic disease (~90%) and their goals of treatment were control or palliation (~96%). Except for age and living arrangements, no differences were found between the low and high symptom groups in any demographic or clinical characteristics (Table 2). Patients in the high symptom group were significantly younger and were less likely to live alone.

Table 2.
Differences in Demographic and Clinical Characteristics between the Low (n=43) and High (n=67) Total Number of Symptom Groups

Differences in symptom occurrence rates

As shown in Table 3, differences were found in the occurrence rates and rank order of the various MSAS symptoms. Pain, lack of energy, feeling drowsy, difficulty sleeping, constipation, lack of appetite, worrying, feeling sad, and difficulty concentrating ranked within the top 12 for both the low and high symptom groups. Numbness/tingling in hands/feet, changes in the way food tastes, and dry mouth were among the top 12 symptoms for the low but not for the high symptom group. In contrast, feeling nervous, feeling irritable, and nausea were in the top 12 for the high but not for the low symptom group. Of note, all four of the psychological symptoms (i.e., feeling sad, worrying, feeling nervous, feeling irritable) were among the top 12 symptoms in the high symptom group.

Table 3.
Differences in the Rank Order of Symptom Occurrence Rates in the Low and High Symptom Groups

With regard to occurrence rates, pain and lack of energy had similar occurrence rates in both symptom groups. For the low symptom group, occurrence rates for the next ten symptoms ranged from as high as 73.2% for feeling drowsy to 36.6% for dry mouth. For the high symptom group, the next 10 highest ranked symptoms had much higher occurrence rates (i.e., 90.9% for feeling sad to 66.7% for nausea).

Differences in depression and anxiety scores

After controlling for age, significant between-group differences were found in two of the four CES-D subscales (somatic and depressed affect) as well as in the total CES-D score (Figure 1A). Patients in the high symptom group reported a higher somatic and depressed affect subscale scores as well as total CES-D score.

FIG. 1A.
Differences in Center for Epidemiologic Studies–Depression (CES-D) subscale and total scores between patients in the low (n=43) and high (n=67) symptom groups.

After controlling for age, significant between-group differences were found in both anxiety scores (Figure 1B). Patients in the high symptom group reported significantly higher state and trait anxiety scores.

FIG. 1B.
Differences in Spielberger State–Trait Anxiety Inventories (STAI) scores between patients in the low (n=43) and high (n=67) symptom groups. All values are plotted as means±standard error of the means after controlling for age (p values, ...

Differences in QOL scores

As expected, after controlling for age, significant between-group differences were found in the total MQOLS-CA2 score as well as in four of the five MQOLS-CA2 subscale (physical, nutrition, symptom distress, and psychological) scores (Figure 2A). Patients in the high symptom group had lower subscale and total MQOLS-CA2 scores.

FIG. 2A.
Differences in Multidimensional Quality of Life Scale–Cancer 2 (MQOLS-CA2) subscale and total quality of life (QOL) scores between patients in the low (n=43) and high (n=67) symptom groups.

After controlling for age, significant between-group differences were found for seven of eight MOS-SF36 subscale scores (physical functioning, bodily pain, general health, vitality, social functioning, role limitations–emotional, and mental health), as well as in the mental component score (Figure 2B). Patients in the high symptom group reported significantly lower MOS-SF36 scores.

FIG. 2B.
Differences in Medical Outcomes Study–Short Form 36 (MOS-SF36) subscale (PF=physical functioning, RP=role limitations–physical, BP=bodily pain, GH=general health, V=vitality, SF=social functioning, RE=role limitations–emotional, ...

Discussion

This study is the first to determine the optimal cutpoint for total number of symptoms in patients with advanced cancer. This finding suggests that the concept of a clinically meaningful cutpoint for symptom severity scores is transferable to total number of symptoms. In this sample, the cutpoint of 12 symptoms successfully differentiated between patients with advanced cancer based on a significant jump in both MQOL-CA2 subscale and total scores.

Validation of 12 symptoms as the optimal cutpoint was supported by significant between-group differences in depression and anxiety scores and in a generic measure of QOL. As shown in Table 4, between-group differences in these scores equate with medium to large effect sizes.40 Previous research suggests that an effect size of 0.2 to 0.5 is considered a minimally important difference and a clinically meaningful difference in QOL measures.4143 Cinical significance goes beyond statistical significance to identify whether a change is large enough to be noticed by the patient.4447 Our findings suggest that when a patient crosses the threshold from 12 to 13 symptoms he or she may notice a decrease in various aspects of QOL.

Table 4.
Effects Sizes for Between-Group Differences (High-Low) in Subscale and Total Scores for the Validation Scales for Depression, Anxiety, and Quality of Life

MQOLS-CA2 total scores in this study were similar to those reported in previous studies of oncology patients.48,49 Overall, patients with advanced cancer appear to have moderate decrements in QOL. However, further research is needed to determine the generalizability of these findings and whether response shifts occur in evaluations of QOL in these patients.50,51

The cutpoint that differentiated between low and high number of symptoms was validated by between-group differences in the rank order of the psychological symptoms on the MSAS. All four psychological symptoms (worrying, feeling sad, feeling nervous, feeling irritable) were among the top 12 symptoms in the high symptom group. In contrast, in the low symptom group, each psychological symptom had a lower overall rank and occurrence rate, and only worrying and feeling sad were in the top 12 symptoms.

CES-D scores for the low and high symptom groups in this study were similar to scores reported by patients with advanced head and neck cancer.52,53 In contrast, higher total CES-D scores were reported by patients with advanced stages of ovarian54 and prostate55 cancer. These inconsistent findings may be attributed to heterogeneity in cancer diagnoses, treatment regimens, and timing of assessments.

Mean state and trait anxiety scores in this study are similar to previous reports of patients with advanced cancer.5658 State anxiety increases in response to physical danger and psychological stress, whereas higher trait anxiety is associated with diagnoses of psycho-neuroticism and/or depression.31,59 The consistent levels of anxiety across studies suggest that patients with advanced cancer may experience acute anxiety from a variety of physical and emotional stressors as well as chronic anxiety associated with depressive symptoms.

In this study, mean MOS-SF36 subscale and component scores for the total sample ranged from 32.1 (±8.8) for the physical component score to 64.8 (±19.8) for the mental health subscale. These scores are similar to those reported in one study,60 lower than scores reported in three studies of patients with advanced cancer,6163 and higher than scores reported in another study64 of patients with advanced cancer. Reasons for these inconsistencies may include differences in studies' definition of advanced cancer, their inclusion and exclusion criteria, and timing of the assessments.

Differences in patients' reports of symptom occurrence and the rank order of the most common symptoms support the between-group differences found for the depression, anxiety, and psychological/mental health domains of the MOS-SF36. The largest effect sizes were found for the mental component and subscale scores related to psychological status (social functioning, vitality, role limitations–emotional, mental health). Emerging evidence suggests that psychological symptoms contribute to decrements in QOL in patients with advanced cancer.6568 For example, higher depression scores were associated with higher symptom severity scores.69 In addition, in a study of cancer patients in their last year of life,68 higher levels of depressive symptoms at enrollment were associated with a worse symptom experience over time. It is not clear if psychological symptoms result in more symptoms or if length of time since diagnosis produces psychological “wear and tear” that results in more psychological and physical symptoms. Furthermore, it is not known if psychological and existential distress increase in patients with advanced cancer as they approach the end of life.70

Several study limitations need to be acknowledged. In this relatively small sample, only one optimal cutpoint for total number of symptoms was found. However, studies with larger samples may identify additional cutpoints. The fairly homogeneous sample of white and well-educated adults, all of whom had pain, limits the generalizability of the findings. However, given that pain was a highly prevalent symptom in both symptom groups, it is unlikely that the results of this study could be attributed only to pain. Finally, it is not possible to separate the effects of cancer and its treatment (e.g., side effects of medications) and the effects of chronic medical conditions on the patients' symptom experience.

Study findings suggest that a threshold exists between low and high number of symptoms in patients with advanced cancer. Additional research is needed to confirm these results and determine if additional cutpoints can be identified. In addition, studies need to determine if the use of cutpoints for total number of symptoms leads to improvements in clinical assessments and more tailored interventions for this vulnerable population. With the movement in health care toward systematizing best practices in an efficient manner, a need exists to develop screening criteria which, even if automated, would assure that the maximum number of patients who are at greatest risk for worse symptom outcomes are recognized with the minimum amount of effort. In the meantime, clinicians can administer a symptom checklist like the MSAS on a routine basis. Patients who report the occurrence of ≥13 symptoms warrant more detailed evaluation and more aggressive symptom management.

Acknowledgments

This work was supported by a grant (CA 116423) from the National Cancer Institute and the National Institute of Nursing Research. Dr. Miaskowski receives support from the American Cancer Society as a Clinical Research Professor. Dr. Aouizerat was funded through National Institutes of Health Roadmap for Medical Research Grant KL2 RR624130. The authors gratefully acknowledge the patients and family caregivers who participated in this research and our many colleagues who assisted with participant recruitment.

Author Disclosure Statement

No conflicting financial interests exist.

References

1. Serlin RC. Mendoza TR. Nakamura Y. Edwards KR. Cleeland CS. When is cancer pain mild, moderate or severe? Grading pain severity by its interference with function. Pain. 1995;61(2):277–284. [PubMed]
2. Jensen MP. Smith DG. Ehde DM. Robinsin LR. Pain site and the effects of amputation pain: Further clarification of the meaning of mild, moderate, and severe pain. Pain. 2001;91(3):317–322. [PubMed]
3. Dihle A. Helseth S. Paul SM. Miaskowski C. The exploration of the establishment of cutpoints to categorize the severity of acute postoperative pain. Clin J Pain. 2006;22(7):617–624. [PubMed]
4. Zelman DC. Dukes E. Brandenburg N. Bostrom A. Gore M. Identification of cut-points for mild, moderate and severe pain due to diabetic peripheral neuropathy. Pain. 2005;115(1–2):29–36. [PubMed]
5. Paul SM. Zelman DC. Smith M. Miaskowski C. Categorizing the severity of cancer pain: further exploration of the establishment of cutpoints. Pain. 2005;113(1–2):37–44. [PubMed]
6. Mendoza TR. Wang XS. Cleeland CS, et al. The rapid assessment of fatigue severity in cancer patients: Use of the Brief Fatigue Inventory. Cancer. 1999;85(5):1186–1196. [PubMed]
7. Swarm R. Abernethy AP. Anghelescu DL, et al. Adult cancer pain. J Natl Compr Canc Netw. 2010;8(9):1046–1086. [PubMed]
8. Berger AM. Abernethy AP. Atkinson A, et al. Cancer-related fatigue. J Natl Compr Canc Netw. 2010;8(8):904–931. [PubMed]
9. Teunissen SC. Wesker W. Kruitwagen C. de Haes HC. Voest EE. de Graeff A. Symptom prevalence in patients with incurable cancer: A systematic review. J Pain Symptom Manage. 2007;34(1):94–104. [PubMed]
10. Gilbertson-White S. Aouizerat BE. Jahan T. Miaskowski C. A review of the literature on multiple symptoms, their predictors, and associated outcomes in patients with advanced cancer. Palliat Support Care. 2011;9(1):81–102. [PubMed]
11. Cleeland CS. Symptom burden: multiple symptoms, their impact as patient-reported outcomes. J Natl Cancer Inst Monogr. 2007;(37):16–21. [PubMed]
12. Gapstur RL. Symptom burden: A concept analysis and implications for oncology nurses. Oncol Nurs Forum. 2007;34(3):673–680. [PubMed]
13. Peters L. Sellick K. Quality of life of cancer patients receiving inpatient and home-based palliative care. J Adv Nurs. 2006;53(5):524–533. [PubMed]
14. Stromgren AS. Sjogren P. Goldschmidt D, et al. A longitudinal study of palliative care: Patient-evaluated outcome and impact of attrition. Cancer. 2005;103(8):1747–1755. [PubMed]
15. McMillan SC. Small BJ. Symptom distress and quality of life in patients with cancer newly admitted to hospice home care. Oncol Nurs Forum. 2002;29(10):1421–1428. [PubMed]
16. Kutner JS. Bryant LL. Beaty BL. Fairclough DL. Time course and characteristics of symptom distress and quality of life at the end of life. J Pain Symptom Manage. 2007;34(3):227–236. [PubMed]
17. Cleeland CS. Farrar JT. Hausheer FH. Assessment of cancer-related neuropathy and neuropathic pain. Oncologist. 2010;15(S2):13–18. [PubMed]
18. Molassiotis A. Zheng Y. Denton-Cardew L. Swindell R. Brunton L. Symptoms experienced by cancer patients during the first year from diagnosis: Patient and informal caregiver ratings and agreement. Palliat Support Care. 2010;8(3):313–324. [PubMed]
19. Karnofsky D. Performance Scale. New York: Plenum Press; 1977.
20. Karnofsky D. Abelmann WH. Craver LV. Burchenal JH. The use of nitrogen mustards in the palliative treatment of carcinoma. Cancer. 1948;1:634–656.
21. MacLean CD. Littenberg B. Kennedy AG. Limitations of diabetes pharmacotherapy: Results from the Vermont Diabetes Information System study. BMC Fam Pract. 2006;7:50. [PMC free article] [PubMed]
22. Smith SK. Zimmerman S. Williams CS. Zebrack BJ. Health status and quality of life among non-Hodgkin lymphoma survivors. Cancer. 2009;115(14):3312–3323. [PMC free article] [PubMed]
23. Portenoy RK. Kornblith AB. Wong G, et al. Pain in ovarian cancer patients: Prevalence, characteristics, and associated symptoms. Cancer. 1994;74(3):907–915. [PubMed]
24. Portenoy RK. Thaler HT. Kornblith AB, et al. Symptom prevalence, characteristics and distress in a cancer population. Qual Life Res. 1994;3(3):183–189. [PubMed]
25. Tranmer JE. Heyland D. Dudgeon D. Groll D. Squires-Graham M. Coulson K. Measuring the symptom experience of seriously ill cancer and noncancer hospitalized patients near the end of life with the memorial symptom assessment scale. J Pain Symptom Manage. 2003;25(5):420–429. [PubMed]
26. Padilla GV. Validity of health-related quality of life subscales. Prog Cardiovasc Nurs. 1992;7(1):13–20. [PubMed]
27. Padilla GV. Ferrell B. Grant MM. Rhiner M. Defining the content domain of quality of life for cancer patients with pain. Cancer Nurs. 1990;13(2):108–115. [PubMed]
28. Radloff LS. The CES-D Scale: A self-report depression scale for research in the general population. Appl Psychol Meas. 1977;1(3):385–401.
29. Sheehan TJ. Fifield J. Reisine S. Tennen H. The measurement structure of the Center for Epidemiologic Studies Depression Scale. J Pers Assess. 1995;64(3):507–521. [PubMed]
30. Spielberger CG. Gorsuch RL. Suchene R. Vagg PR. Jacobs GA. Manual for the State-Anxiety (Form Y): Self Evaluation Questionnaire. Palo Alto, CA: Consulting Psychologists Press; 1983.
31. Kennedy BL. Schwab JJ. Morris RL. Beldia G. Assessment of state and trait anxiety in subjects with anxiety and depressive disorders. Psychiatr Q. 2001;72(3):263–276. [PubMed]
32. Ware JE., Jr. SF-36 health survey update. Spine. 2000;25(24):3130–3139. [PubMed]
33. Ware JE., Jr. Sherbourne CD. The MOS 36-item short-form health survey (SF-36). I. Conceptual framework and item selection. Med Care. 1992;30(6):473–483. [PubMed]
34. Kurtz ME. Kurtz JC. Stommel M. Given CW. Given B. Physical functioning and depression among older persons with cancer. Cancer Pract. 2001;9(1):11–18. [PubMed]
35. Kurtz ME. Kurtz JC. Stommel M. Given CW. Given B. Predictors of depressive symptomatology of geriatric patients with colorectal cancer: A longitudinal view. Support Care Cancer. 2002;10(6):494–501. [PubMed]
36. Kirkova J. Walsh D. Rybicki L, et al. Symptom severity and distress in advanced cancer. Palliat Med. 2010;24(3):330–339. [PubMed]
37. Dodd MJ. Miaskowski C. Paul SM. Symptom clusters and their effect on the functional status of patients with cancer. Oncol Nurs Forum. 2001;28(3):465–470. [PubMed]
38. Wedding U. Rohrig B. Klippstein A. Brix C. Pientka L. Hoffken K. Co-morbidity and functional deficits independently contribute to quality of life before chemotherapy in elderly cancer patients. Support Care Cancer. 2007;15(9):1097–1104. [PubMed]
40. Cohen J. Cohen P. West S. Aiken L. Applied Multiple Regression/Correlation Analysis for the Behavioral Sciences. 3rd. Hillsdale, NJ: Lawrence Erlbaum Associates; 2003.
41. Guyatt GH. Osoba D. Wu AW. Wyrwich KW. Norman GR. Methods to explain the clinical significance of health status measures. Mayo Clin Proc. 2002;77(4):371–383. [PubMed]
42. Norman GR. Sloan JA. Wyrwich KW. Interpretation of changes in health-related quality of life: The remarkable universality of half a standard deviation. Med Care. 2003;41(5):582–592. [PubMed]
43. Osoba D. Rodrigues G. Myles J. Zee B. Pater J. Interpreting the significance of changes in health-related quality-of-life scores. J Clin Oncol. 1998;16(1):139–144. [PubMed]
44. Sloan JA. Aaronson N. Cappelleri JC. Fairclough DL. Varricchio C. Clinical Significance Consensus Meeting Group. Assessing the clinical significance of single items relative to summated scores. Mayo Clin Proc. 2002;77(5):479–487. [PubMed]
45. Sloan JA. Frost MH. Berzon R, et al. The clinical significance of quality of life assessments in oncology: A summary for clinicians. Support Care Cancer. 2006;14(10):988–998. [PubMed]
46. Cella D. Bullinger M. Scott C. Barofsky I. Clinical Significance Consensus Meeting G: Group vs individual approaches to understanding the clinical significance of differences or changes in quality of life. Mayo Clin Proc. 2002;77(4):384–392. [PubMed]
47. Frost MH. Bonomi AE. Ferrans CE. Wong GY. Hays RD. Clinical Significance Consensus Meeting G: Patient, clinician, and population perspectives on determining the clinical significance of quality-of-life scores. Mayo Clin Proc. 2002;77(5):488–494. [PubMed]
48. Pud D. Ben Ami S. Cooper BA, et al. The symptom experience of oncology outpatients has a different impact on quality-of-life outcomes. J Pain Symptom Manage. 2008;35(2):162–170. [PubMed]
49. Miaskowski C. Cooper BA. Paul SM, et al. Subgroups of patients with cancer with different symptom experiences and quality-of-life outcomes: A cluster analysis. Oncol Nurs Forum. 2006;33(5):E79–89. [PubMed]
50. Schwartz CE. Applications of response shift theory and methods to participation measurement: A brief history of a young field. Arch Phys Med Rehabil. 2010;91(9 Suppl):S38–S43. [PubMed]
51. Rapkin BD. Schwartz CE. Toward a theoretical model of quality-of-life appraisal: Implications of findings from studies of response shift. Health Qual Life Outcomes. 2004;2:14. [PMC free article] [PubMed]
52. de Graeff A. de Leeuw JR. Ros WJ. Hordijk GJ. Blijham GH. Winnubst JA. Sociodemographic factors and quality of life as prognostic indicators in head and neck cancer. Eur J Cancer. 2001;37(3):332–339. [PubMed]
53. Derks W. de Leeuw JR. Hordijk GJ. Winnubst JA. Reasons for non-standard treatment in elderly patients with advanced head and neck cancer. Eur Arch Otorhinolaryngol. 2005;262(1):21–26. [PubMed]
54. Bodurka-Bevers D. Basen-Engquist K. Carmack CL, et al. Depression, anxiety, and quality of life in patients with epithelial ovarian cancer. Gynecol Oncol. 2000;78(3 Pt 1):302–308. [PubMed]
55. Ahles TA. Herndon JE., 2nd Small EJ, et al. Quality of life impact of three different doses of suramin in patients with metastatic hormone-refractory prostate carcinoma: Results of Intergroup O159/Cancer and Leukemia Group B 9480. Cancer. 2004;101(10):2202–2208. [PubMed]
56. Bruera E. Willey J. Cohen M. Palmer JL. Expressive writing in patients receiving palliative care: A feasibility study. J Palliat Med. 2008;11(1):15–19. [PubMed]
57. Mystakidou K. Tsilika E. Parpa E. Gogou P. Theodorakis P. Vlahos L. Self-efficacy beliefs and levels of anxiety in advanced cancer patients. Eur J Cancer Care (Engl) 2010;19(2):205–211. [PubMed]
58. Mystakidou K. Tsilika E. Parpa E. Papageorgiou C. Georgaki S. Vlahos L. Investigating the effects of TTS-fentanyl for cancer pain on the psychological status of patients naive to strong opioids: An open label study. Cancer Nurs. 2004;27(2):127–133. [PubMed]
59. Bieling PJ. Antony MM. Swinson RP. The State-Trait Anxiety Inventory, Trait version: Structure and content re-examined. Behav Res Ther. 1998;36(7–8):777–788. [PubMed]
60. Miaskowski C. Dodd M. West C, et al. The use of a responder analysis to identify differences in patient outcomes following a self-care intervention to improve cancer pain management. Pain. 2007;129(1–2):55–63. [PMC free article] [PubMed]
61. Terrell JE. Ronis DL. Fowler KE, et al. Clinical predictors of quality of life in patients with head and neck cancer. Arch Otolaryngol Head Neck Surg. 2004;130(4):401–408. [PubMed]
62. Popa-Velea O. Cernat B. Tambu A. Influence of personalized therapeutic approach on quality of life and psychiatric comorbidity in patients with advanced colonic cancer requiring palliative care. J Med Life. 2010;3(3):343–347. [PMC free article] [PubMed]
63. Adamsen L. Quist M. Andersen C, et al. Effect of a multimodal high intensity exercise intervention in cancer patients undergoing chemotherapy: Randomised controlled trial. BMJ. 2009;339:b3410. [PMC free article] [PubMed]
64. Robinson DW., Jr. Eisenberg DF. Cella D. Zhao N. de Boer C. DeWitte M. The prognostic significance of patient-reported outcomes in pancreatic cancer cachexia. J Support Oncol. 2008;6(6):283–290. [PubMed]
65. Walsh D. Rybicki L. Symptom clustering in advanced cancer. Support Care Cancer. 2006;14(8):831–836. [PubMed]
66. Cheung WY. Le LW. Zimmermann C. Symptom clusters in patients with advanced cancers. Support Care Cancer. 2009;17(9):1223–1230. [PubMed]
67. Francoeur RB. The relationship of cancer symptom clusters to depressive affect in the initial phase of palliative radiation. J Pain Symptom Manage. 2005;29(2):130–155. [PMC free article] [PubMed]
68. Doorenbos AZ. Given CW. Given B. Verbitsky N. Symptom experience in the last year of life among individuals with cancer. J Pain Symptom Manage. 2006;32(5):403–412. [PMC free article] [PubMed]
69. von Gruenigen VE. Hutchins JR. Reidy AM, et al. Gynecologic oncology patients' satisfaction and symptom severity during palliative chemotherapy. Health Qual Life Outcomes. 2006;4:84. [PMC free article] [PubMed]
70. Lichtenthal WG. Nilsson M. Zhang B, et al. Do rates of mental disorders and existential distress among advanced stage cancer patients increase as death approaches? Psychooncology. 2009;18(1):50–61. [PMC free article] [PubMed]

Articles from Journal of Palliative Medicine are provided here courtesy of Mary Ann Liebert, Inc.