How young can children reliably and validly self-report their health-related quality of life?: An analysis of 8,591 children across age subgroups with the PedsQL™ 4.0 Generic Core Scales

doi:10.1186/1477-7525-5-1

Health Qual Life Outcomes. 2007; 5: 1.

Published online 2007 January 3. doi: 10.1186/1477-7525-5-1

PMCID: PMC1769360

How young can children reliably and validly self-report their health-related quality of life?: An analysis of 8,591 children across age subgroups with the PedsQL™ 4.0 Generic Core Scales

James W Varni,¹ Christine A Limbers,² and Tasha M Burwinkle³

¹Department of Pediatrics, College of Medicine, Department of Landscape Architecture and Urban Planning, College of Architecture, Texas A&M University, 3137 TAMU, College Station, TX 77843-3137, USA

²Department of Psychology, College of Liberal Arts, Texas A&M University, College Station, TX 77843-3137, USA

³The Children's Hospital at Scott & White, Department of Pediatrics, College of Medicine, Texas A&M University Health Science Center, 2401 South 31^stStreet, Temple, TX 76508, USA

Corresponding author.

James W Varni: jvarni/at/archmail.tamu.edu; Christine A Limbers: christtineL/at/aol.com; Tasha M Burwinkle: tburwinkle/at/swmail.sw.org

Received November 21, 2006; Accepted January 3, 2007.

This is an Open Access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/2.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.

This article has been cited by other articles in PMC.

Abstract

Background

The last decade has evidenced a dramatic increase in the development and utilization of pediatric health-related quality of life (HRQOL) measures in an effort to improve pediatric patient health and well-being and determine the value of healthcare services. The emerging paradigm shift toward patient-reported outcomes (PROs) in clinical trials has provided the opportunity to further emphasize the value and essential need for pediatric patient self-reported outcomes measurement. Data from the PedsQL™ Database^SMwere utilized to test the hypothesis that children as young as 5 years of age can reliably and validly report their HRQOL.

Methods

The sample analyzed represented child self-report age data on 8,591 children ages 5 to 16 years from the PedsQL™ 4.0 Generic Core Scales Database^SM. Participants were recruited from general pediatric clinics, subspecialty clinics, and hospitals in which children were being seen for well-child checks, mild acute illness, or chronic illness care (n = 2,603, 30.3%), and from a State Children's Health Insurance Program (SCHIP) in California (n = 5,988, 69.7%).

Results

Items on the PedsQL™ 4.0 Generic Core Scales had minimal missing responses for children as young as 5 years old, supporting feasibility. The majority of the child self-report scales across the age subgroups, including for children as young as 5 years, exceeded the minimum internal consistency reliability standard of 0.70 required for group comparisons, while the Total Scale Scores across the age subgroups approached or exceeded the reliability criterion of 0.90 recommended for analyzing individual patient scale scores. Construct validity was demonstrated utilizing the known groups approach. For each PedsQL™ scale and summary score, across age subgroups, including children as young as 5 years, healthy children demonstrated a statistically significant difference in HRQOL (better HRQOL) than children with a known chronic health condition, with most effect sizes in the medium to large effect size range.

Conclusion

The results demonstrate that children as young as the 5 year old age subgroup can reliably and validly self-report their HRQOL when given the opportunity to do so with an age-appropriate instrument. These analyses are consistent with recent FDA guidelines which require instrument development and validation testing for children and adolescents within fairly narrow age groupings and which determine the lower age limit at which children can provide reliable and valid responses across age categories.

Background

The last decade has evidenced a dramatic increase in the development and utilization of pediatric health-related quality of life measures in an effort to improve pediatric patient health and well-being and to determine the value of healthcare services [1,2]. Health-related quality of life (HRQOL) has been progressively acknowledged as an essential health outcome measure in clinical trials and health services research and evaluation [3-5]. A HRQOL instrument must be multidimensional, consisting at the minimum of the physical, psychological (including emotional and cognitive), and social health dimensions delineated by the World Health Organization [6,7]. Quality of life (QOL) is a broader general conceptual term which encompasses nonhealth-related aspects of life (e.g., the evaluation of the impact of the built environment on general well-being) which are not directly amenable to healthcare services and medical products [7]. Thus, HRQOL has emerged as the most appropriate term for health-related QOL dimensions that represent the patient's perception of the impact of an illness and its treatment and which are thus within the scope of healthcare services and medical products [7].

Although the measurement of HRQOL in pediatric clinical trials has been advocated for a number of years [8], the emerging paradigm shift toward patient-reported outcomes (PROs) in clinical trials [7] has provided the opportunity to further emphasize the value and essential need for pediatric patient self-report measurement as efficacy outcomes in clinical trials for pediatric chronic health conditions [9-12].

Pediatric clinical trials

Historically, only about 20 percent of drugs prescribed for children have been tested for safety and efficacy in pediatric populations and approved by the U.S. Food and Drug Administration (FDA) for labeling claims in pediatric patients [7]. During the past several years, legislative changes have created both voluntary and mandatory guidelines for drug studies in children, resulting in a substantial increase in pediatric clinical trials. Under the Pediatric Exclusivity Provision of the Best Pharmaceuticals for Children Act (BPCA), reauthorized in 2002, companies that conduct drug studies with children, as requested by the FDA, are eligible for an additional six months of marketing exclusivity for the studied drug. The Pediatric Research Equity Act (PREA), signed in 2003, allows the FDA to require pediatric studies if it is determined that the product is likely to be used by a considerable number of pediatric patients, or the product would offer an important advantage to pediatric patients over existing treatments.

While the above pediatric initiatives have created the opportunity for children to be included in clinical trials, pediatric patients have not been afforded the right to self-report on matters pertaining to their health and well-being when evaluating the efficacy of treatments in the vast majority of pediatric clinical trials to date [13]. This fact stands in sharp contrast to the recent FDA draft guidance for industry in which the FDA describes how it evaluates patient-reported outcome (PRO) instruments as efficacy outcomes in clinical trials [7]. In that draft document, the FDA is quite definitive in stating that "some treatment effects are known only to the patient". Thus, what has been an obvious recognition in clinical trials for adult patients, that is, that PROs are patient reported outcomes, has not received the same level of recognition in clinical trials for pediatric patients.

Patient Reported-Outcomes (PROs)

By definition, patient-reported outcomes (PROs) are self-report instruments that directly measure the patient's perceptions of the impact of disease and treatment as clinical trial endpoints [7]. PROs include multi-item health-related quality of life (HRQOL) instruments, as well as single-item symptom measures (e.g., pain intensity visual analogue scale [VAS]) [14-16]. Research conducted in the 1980's and early 1990's clearly demonstrated that children as young as 5 years of age can self-report their pain intensity using age-appropriate standardized VAS instruments [17-19], establishing pediatric patient self-report of pain intensity as the standard for clinical research and practice. However, young pediatric patients' self-report of their HRQOL at the individual age subgroup level has not been previously reported in the published literature with sufficient sample sizes to support reliability and validity analyses.

The proxy problem

It is well documented in both the adult and pediatric literature that information provided by proxy-respondents is not equivalent to that reported by the patient [20,21]. Imperfect agreement between self-report and proxy-report, termed cross-informant variance [22], has been consistently documented in the HRQOL measurement of children with chronic health conditions and healthy children [23-30].

In a meta-analysis of studies evaluating the agreement between child self-report and parent proxy-report on different measures of HRQOL, Eiser & Morse (2001) found generally good agreement (r > 0.50) between child and parent report for domains reflecting physical activity, functioning and some symptoms, but generally poor agreement (r < 0.30) between child self-report and parent proxy-report for emotional and social HRQOL domains [31]. Given these Pearson Product-Moment correlations, and others like them in the literature cited above, it can be concluded that parent proxy-reports typically explain only 10–25% of the variance in child self-report HRQOL outcomes. Thus, the findings on the proxy problem "indicate that parent reports cannot be substituted for child reports" [32]. To further complicate the use of proxy reporters, which typically are the child's parents, most often mothers, are the unresolved concerns regarding the influence of parental distress and related factors on parents' perceptions of child health and well-being [33-35].

Taken together, the evidence is quite compelling that evaluating pediatric patients' perspectives regarding treatment efficacy should become the standard in pediatric clinical trials given the potential for a significant degree of measurement error associated with parent proxy-report of child HRQOL. At the very least, parent proxy-report should be included to complement pediatric patient self-report as a secondary outcome measure, not to serve as a convenient substitute or proxy for pediatric patient PROs in pediatric clinical trials. Parent proxy-report should only be the primary outcome measure when the child is too young or ill or otherwise unable to self-report [36].

Recent FDA guidelines recommend that instrument development and validation testing for children and adolescents be conducted within fairly narrow age groupings and to determine the lower age limit at which children can provide reliable and valid responses that can be compared across age categories [7]. Consistent with these recommendations, it has been an explicit goal of the PedsQL™ Measurement Model [24] to develop and test brief measures for the broadest age group empirically feasible, specifically including pediatric patient self-report for the youngest children possible. This goal was originally articulated in the empirical efforts of the 1980's to measure pain perception in pediatric patients through the development and testing of the Varni/Thompson Pediatric Pain Questionnaire™, which included pain intensity visual analogue scales for children as young as 5 years of age [18].

The PedsQL™ 4.0 Generic Core Scales include child self-report for ages 5–18 and parent proxy-report for ages 2–18 [37,38]. The items chosen for inclusion were initially derived from the measurement properties of the child self-report scales, while the parent proxy-report scales were constructed to directly parallel the child self-report items. Thus, the development and testing of the PedsQL™ as a pediatric PRO explicitly emphasizes the child's perceptions, including children as young as 5 years of age, and consequently is an ideal HRQOL instrument to test the lower age limits achievable for pediatric patient HRQOL self-report.

Therefore, the objectives of the current analyses are to determine the feasibility, reliability and validity of child self-report at the individual age subgroup level for children 5–16 years of age utilizing data from the PedsQL™ 4.0 Generic Core Scales Database^SMon over 8,500 children and adolescents. These analyses are consistent with the FDA guidelines recommending validation testing for children and adolescents within fairly narrow age groupings and the determination of the lower age limit at which children can provide reliable and valid responses [7].

Method

Participants and settings

The sample contains composite child self-report and parent proxy-report age subgroup data on 8,591 children ages 5 to 16 years from the PedsQL™ 4.0 Generic Core Scales Database^SM(previously published data, n = 8,086, 94.1%; unpublished data, n = 505, 5.9%). Participants were recruited from general pediatric clinics, subspecialty clinics, and hospitals in which children were being seen for well-child checks, mild acute illness, or chronic illness care (n = 2,603, 30.3%), and from a State Children's Health Insurance Program (SCHIP) in California (n = 5,988, 69.7%). Participants recruited from general pediatric clinics, subspecialty clinics, and hospitals were assessed in-person or by telephone. For in-person mode of administration, research assistants obtained written parental informed consent and child assent. Paper-and-pencil questionnaires were self-administered for parents and for children ages 8 to 16 and interview administered for children ages 5 to 7 and in situations in which the child was unable to read or write as a consequence of either physical or cognitive impairment. For telephone administration, parents of children ages 5 to 16 were called by a research assistant who explained the study, and obtained verbal parental informed consent and child assent. The research assistant verbally administered the PedsQL™ 4.0 individually to the parent and their child. If the child was not home at the time of the initial call, the research assistant arranged for a call at another time. These research protocols were approved by the Institutional Review Board at Children's Hospital and Health Center, San Diego and other appropriate local Institutional Review Boards.

Participants recruited from the State Children's Health Insurance Program (SCHIP) were assessed via statewide mailing. PedsQL™ 4.0 paper-and-pencil surveys were mailed separately for each of the months of February and March 2001 to families with children ages 5–16 years throughout the State of California who were all new enrollees in SCHIP. Parents and children ages 8–16 were instructed to complete the survey separately, while parents of children ages 5–7 were instructed to assist their child in completing the questionnaire after completing the proxy-report. A reminder postcard followed the initial mailing, with a second survey mailed to nonrespondents. Nonrespondents to the second survey received a telephone reminder. Given that this project was conducted for program evaluation to comply with California Insurance Code 12693.92 (b), and not specifically research purposes, parents and children did not complete informed consent forms [38]. This protocol of analyzing existing deidentified data was approved by the Institutional Review Board at Children's Hospital and Health Center, San Diego.

For all forms combined (N = 8,591), the number of children within each age subgroup is as follows: 757 five-year-olds (8.8%), 932 six-year-olds (10.8%), 891 seven-year-olds (10.4%), 882 eight-year-olds (10.3%), 841 nine-year-olds (9.8%), 841 ten-year-olds (9.8%), 683 eleven-year-olds (7.9%), 683 twelve-year-olds (7.9%), 614 thirteen-year-olds (7.1%), 572 fourteen-year-olds (6.7%), 563 fifteen-year-olds (6.6%), and 332 sixteen-year-olds (3.9%). The sample contains 4,391 boys (51.1%), 4,185 girls (48.7%), and 15 missing (0.2%). The sample is heterogeneous with respect to race/ethnicity with 4,403 Hispanics (51.3%), 1,995 White non-Hispanics (23.2%), 759 Asian or Pacific Islanders (8.8%), 405 Black non-Hispanics (4.7%), 41 American Indians or Alaskan Natives (0.5%), 115 other (1.3%), and 873 missing (10.2%). Child surveys were completed in English (n = 4,859, 56.6%), Spanish (n = 3,377, 39.3%), Chinese (n = 184, 2.1%), Korean (n = 93, 1.1%), and Vietnamese (n = 46, 0.5%; missing = 32, 0.4%). Response equivalence has been previously demonstrated across language for the PedsQL™ by examining the percent missing data, floor and ceiling effects, and scale internal consistency across language, as well as across mode of administration [37].

The sample included healthy children, who were assessed either in physicians' offices during well-child checks and/or whose parents did not report the presence of a chronic health condition (n = 5,491, 63.9%), acutely ill children, whose parents did not report the presence of a chronic health condition, but who were assessed at one of the pediatric clinics or hospitals (n = 142, 1.7%), chronically ill children, whose parents reported the presence of a chronic health condition (i.e., a physical or mental health condition that has lasted or is expected to last at least 6 months and interferes with the child's activities) and/or were identified through their medical records as having a chronic health condition (n = 2,627, 30.6%), and 331 missing (3.9%). Within each age subgroup, the number of healthy and chronically ill children is as follows: 561 healthy (74.1%) and 155 chronically ill (20.5%) five-year-olds, 717 healthy (76.9%) and 161 chronically ill (17.3%) six-year-olds, 646 healthy (72.5%) and 185 chronically ill (20.8%) seven-year-olds, 590 healthy (66.9%) and 252 chronically ill (28.6%) eight-year-olds, 558 healthy (66.3%) and 233 chronically ill (27.7%) nine-year-olds, 545 healthy (64.8%) and 256 chronically ill (30.4%) ten-year-olds, 404 healthy (59.2%) and 257 chronically ill (37.6%) eleven-year-olds, 415 healthy (60.8%) and 225 chronically ill (32.9%) twelve-year-olds, 326 healthy (53.1%) and 258 chronically ill (42.0%) thirteen-year-olds, 301 healthy (52.6%) and 238 chronically ill (41.6%) fourteen-year-olds, 289 healthy (51.3%) and 230 chronically ill (40.9%) fifteen-year-olds, and 139 healthy (41.9%) and 177 chronically ill (53.3%) sixteen-year-olds. The chronically ill sample (n = 2,627) is heterogeneous in terms of diagnoses with 374 children diagnosed with asthma (14.2%), 358 with cancer (13.6%), 291 with diabetes (11.1%), 269 with a gastrointestinal condition (10.2%), 268 with a rheumatic condition (10.2%), 199 with a cardiac condition (7.6%), 103 diagnosed as obese (3.9%), 103 with sickle cell anemia (3.9%), 78 with ADHD (3.0%), 72 with renal disease (2.7%), 71 with cerebral palsy (2.7%), 45 with mental health conditions (1.7%), and 396 with other chronic conditions (15.1%).

Measures

The PedsQL™ 4.0 (Pediatric Quality of Life Inventory™ Version 4.0)

The 23-item PedsQL™ 4.0 Generic Core Scales encompass: 1) Physical Functioning (8 items), 2) Emotional Functioning (5 items), 3) Social Functioning (5 items), and 4) School Functioning (5 items), and were developed through focus groups, cognitive interviews, pre-testing, and field testing measurement development protocols [24,37]. The instrument takes approximately 5 minutes to complete [37].

The PedsQL™ 4.0 Generic Core Scales are comprised of parallel child self-report and parent proxy-report formats. Child self-report includes ages 5–7, 8–12, and 13–18 years. Parent proxy-report includes ages 2–4 (toddler), 5–7 (young child), 8–12 (child), and 13–18 (adolescent), and assesses parent's perceptions of their child's HRQOL. The items for each of the forms are essentially identical, differing in developmentally appropriate language, or first or third person tense. The instructions ask how much of a problem each item has been during the past one month. A 5-point Likert response scale is utilized across child self-report for ages 8–18 and parent proxy-report (0 = never a problem; 1 = almost never a problem; 2 = sometimes a problem; 3 = often a problem; 4 = almost always a problem). To further increase the ease of use for the young child self-report (ages 5–7), the response scale is reworded and simplified to a 3-point scale (0 = not at all a problem; 2 = sometimes a problem; 4 = a lot of a problem), with each response choice anchored to a happy to sad faces scale [18,39]. For the purposes of these analyses, parent proxy-report data for ages 5–16 were matched to the child self-report data.

Items are reverse-scored and linearly transformed to a 0–100 scale (0 = 100, 1 = 75, 2 = 50, 3 = 25, 4 = 0), so that higher scores indicate better HRQOL. Scale Scores are computed as the sum of the items divided by the number of items answered (this accounts for missing data). If more than 50% of the items in the scale are missing, the Scale Score is not computed. This accounts for the differences in sample sizes for scales reported in the Tables. Although there are other strategies for imputing missing values, this computation is consistent with the previous PedsQL™ peer-reviewed publications, as well as other well-established HRQOL measures [37,40,41]. For this study, over 99% of child respondents were included in the Scale Score analyses after imputing missing values. The Physical Health Summary Score (8 items) is the same as the Physical Functioning Scale. To create the Psychosocial Health Summary Score (15 items), the mean is computed as the sum of the items divided by the number of items answered in the Emotional, Social, and School Functioning Scales.

PedsQL™ Family Information Form

The PedsQL™ Family Information Form [37] or survey items adapted from the PedsQL™ Family Information Form were completed by parents. The PedsQL™ Family Information Form contains demographic information including the child's date of birth, gender, race/ethnicity, and parental education and occupation information required to calculate the Hollingshead socioeconomic status (SES) index [42]. One survey question asks the parent to report on the presence of a chronic health condition ("In the past 6 months, has your child had a chronic health condition?") defined as a physical or mental health condition that has lasted or is expected to last at least 6 months and interferes with the child's activities. If the parents check "Yes" to this question, they are asked to write in the name of the chronic health condition.

Statistical analyses

The feasibility of child self-report was determined from the percentage of missing values for the child self-report sample as a whole and across each individual age subgroup from 5 to 16 years [40]. Scale internal consistency reliability was determined by calculating Cronbach's coefficient alpha across individual age subgroups [43]. Scales with reliabilities of 0.70 or greater are recommended for comparing patient groups, while a reliability criterion of 0.90 is recommended for analyzing individual patient scale scores [44,45]. Range of measurement was based on the percentage of scores at the extremes of the scaling range, that is, the maximum possible score (ceiling effect) and the minimum possible score (floor effect) [40].

Construct validity was determined utilizing the known-groups method. The known-groups method compares scale scores across groups known to differ in the health construct being investigated. In this study, PedsQL™ 4.0 Generic Core Scales Scores in groups differing in known health condition (healthy children and children known to have a chronic illness) were computed across each age subgroup [40,46], using independent sample t-tests. In order to determine the magnitude of the anticipated differences, effect sizes were calculated [47]. Effect size as used in these analyses was calculated by taking the difference between the healthy sample mean and the chronic sample mean, divided by the healthy sample standard deviation. Effect sizes for differences in means are designated as small (0.20), medium (0.50), and large (0.80) in magnitude [47].

Agreement between child self-report and parent proxy-report was determined through two-way mixed effect model (absolute agreement, single measure) Intraclass Correlations (ICC) [48]. The ICC offers an index of absolute agreement given that it takes into account the ratio between subject variability and total variability [48,49]. Intraclass Correlations (ICC) are designated as ≤ 0.40 poor to fair agreement, 0.41–0.60 moderate agreement, 0.61–0.80 good agreement, and 0.81–1.00 excellent agreement [50,51]. Statistical analyses were conducted using SPSS Version 13.0 for Windows.

Results

Feasibility

The percentage of missing item responses for the child self-report sample as a whole was 1.2%. Items on the PedsQL™ 4.0 Generic Core Scales had minimal missing responses for children as young as 5 years old, with the percentage of missing item responses decreasing slightly with age. The percentage of missing item responses across the age subgroups was 2.8%, 1.3%, 1.5%, 1.5%, 1.0%, 0.99%, 0.85%, 0.95%, 0.76%, 0.95%, 0.95%, and 0.79% for age subgroups 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, and 16, respectively. It should be noted that most of the missing data for ages 5–7 involved the School Functioning Scale (60.0%, 26.6%, and 34.5% for ages 5, 6, and 7, respectively). This is not a surprising finding, since young children do not necessarily attend school. When eliminating the School Functioning items, the percentage of missing items for the Total Scale Score is 1.1%, 0.98%, and 0.99% for ages 5, 6, and 7, respectively.

Internal consistency reliability

Internal consistency reliability alpha coefficients across individual age subgroups are presented for the PedsQL™ 4.0 Generic Core Scales Total Scale Score in Table Table1,1, Physical Health Summary Score in Table Table2,2, Psychosocial Health Summary Score in Table Table3,3, Emotional Functioning Scale Score in Table Table4,4, Social Functioning Scale Score in Table Table5,5, and School Functioning Scale Score in Table Table6.6. The majority of the child self-report scales across the age subgroups, including for children as young as 5 years, exceeds the minimum reliability standard of 0.70 required for group comparisons, while the Total Scale Scores across the age subgroups approaches or exceeds the reliability criterion of 0.90 recommended for analyzing individual patient scale scores. Alpha values are lower for the School Functioning Scale Scores across the age subgroups. The alpha value is lowest on the School Functioning Scale for the 6 year old subgroup. Across the PedsQL™ scales and summary scores, internal consistency reliability alpha coefficients increase slightly with age.

Table 1

PedsQL™ 4.0 Generic Core Scales Total Scale Score: Child Self-Report Reliability and Validity

Table 2

PedsQL™ 4.0 Generic Core Scales Physical Health Summary Score: Child Self-Report Reliability and Validity

Table 3

PedsQL™ 4.0 Generic Core Scales Psychosocial Health Summary Score: Child Self-Report Reliability and Validity

Table 4

PedsQL™ 4.0 Generic Core Scales Emotional Functioning Scale Score: Child Self-Report Reliability and Validity

Table 5

PedsQL™ 4.0 Generic Core Scales Social Functioning Scale Score: Child Self-Report Reliability and Validity

Table 6

PedsQL™ 4.0 Generic Core Scales School Functioning Scale Score: Child Self-Report Reliability and Validity

Range of measurement

Tables Tables11 through 6 present the percentages of scores at the floor and ceiling for healthy children and children with a chronic health condition across the age subgroups. There were no significant floor effects for healthy children or children with a chronic health condition across the age subgroups, with the majority of scales demonstrating 0.0% of respondents scoring at the minimum. Ceiling effects existed in some scales. These ranged from minimal (e.g., 7.1% of healthy respondents in the 6 year old subgroup for the self-report Total Scale Score) to moderate (e.g., 49.2% of healthy respondents in the 14 year old subgroup for the self-report Social Functioning Scale). The ceiling effects were in the expected direction, with healthy children reporting more ceiling effects than children with a chronic health condition. Across the scales and summary scores, for both healthy children and children with a chronic health condition, the percentage of scores at the floor and ceiling was not greater for children in the younger age groups, suggesting that children of younger ages were not navigating to the ends of the response scales, reducing them to essentially yes/no answers. Thus, even the 3-point Likert response scale for ages 5–7 produced a range of responses.

Construct validity

Tables Tables11 through 6 demonstrate comparisons between children's self-reported PedsQL™ 4.0 Generic Core Scales Total Scale Scores, Physical Health Summary Scores, Psychosocial Health Summary Scores, Emotional Functioning Scale Scores, Social Functioning Scale Scores, and School Functioning Scale Scores for healthy children and children with a known chronic health condition by individual age subgroups. For each PedsQL™ scale and summary score, across each age subgroup, including children as young as 5 years, healthy children demonstrated a statistically significant difference in HRQOL (better HRQOL) than children with a known chronic health condition, with most effect sizes in the medium to large effect size range [47].

Parent/child agreement

Table Table77 shows two-way mixed effect model (absolute agreement, single measure) Intraclass Correlations (ICC) between PedsQL™ 4.0 child self-report and parent proxy-report across individual age subgroups for the entire sample. Most ICCs are in the range of moderate to good agreement, with ICC's generally increasing with the child's age across the scales and summary scores.

Table 7

Two-way mixed effect model (absolute agreement, single measure) Intraclass Correlations (ICC) between Child Self-Report and Parent Proxy-Report for PedsQL™ 4.0 Generic Core Scales by Age for Entire Sample

To investigate the relationship between the child's health status and parent-child agreement, Table Table88 presents two-way mixed effect model (absolute agreement, single measure) Intraclass Correlations (ICC) between PedsQL™ 4.0 child self-report and parent proxy-report across individual age subgroups for the chronic health condition sample, while Table Table99 presents the ICCs for the healthy sample. For both the chronic health condition and healthy samples, the ICCs generally increase with the child's age across the scales and summary scores. Across the age subgroups, the ICCs are generally greater in the chronic health condition sample compared to the healthy sample for the Physical Health Summary Score. ICCs across the age subgroups are generally greater in the healthy sample compared to the chronic health condition sample for the Emotional Functioning Scale.

Table 8

Table 9

Discussion

The results demonstrate that children as young as the 5 year old age subgroup can reliably and validly self-report their HRQOL when given the opportunity to do so with an age-appropriate instrument. Thus, although most available HRQOL instruments only include child self-report for ages 8 and older [1,2], the present findings indicate that 5, 6, and 7 year olds can reliably and validly self-report their HRQOL, comparable to older children and adolescents. It should be noted that even though the 5–7 age subgroups had the lowest coefficient alpha reliability coefficients for the age subgroups tested, the PedsQL™ child self-report instrument response scale for ages 5–7 is reworded and simplified to a 3-point Likert response scale, rather than the 5-point Likert response scale used for ages 8–18. Previous research suggests that 3-point response scales attenuate the achievable reliability coefficients relative to 5-point response scales [52]. This may explain in part the somewhat lower reliability coefficients for the 5–7 age subgroups in comparison to the 8–18 age subgroups. Finally, the relatively large number of missing data for the School Functioning Scale for the 5–7 subgroups may have further attenuated the potentially achievable reliability coefficients for these age subgroups [44]. Although Cronbach alpha represents the lower bound of the reliability of a measurement instrument, and is a conservative estimate of actual reliability [53], scales that do not approach or meet the 0.70 standard should be used only for descriptive analyses.

Although parent/child agreement has not typically been reported for children younger than 7 years of age for HRQOL instruments [31], the trend towards higher intercorrelations with increasing age in the present study is perhaps consonant with the trend towards higher scale reliabilities with increasing age for self-report. Lower scale reliabilities may attenuate the intercorrelations between self and proxy reporters. An additional possible explanation may be the greater verbal communication skills typically manifested with increasing developmental age. Further, while it might be expected that the intercorrelations between child and parent report across the physical, emotional, social and school functioning scales would follow the conceptualization that more observable domains (i.e., physical functioning) would yield higher agreement, this has not necessarily been the case in the published literature with other HRQOL instruments. In a comprehensive review, Eiser [54] found mixed results in terms of higher intercorrelations between self and proxy report of physical functioning across pediatric HRQOL instruments, with most studies demonstrating this effect, while some others did not.

Taken together, the evidence is quite compelling that parent proxy-report of child HRQOL, across the age subgroups reported herein, should be included to complement pediatric patient self-report as a secondary outcome measure, not to serve as a convenient substitute or proxy for pediatric patient PROs in pediatric clinical trials. Parent proxy-report should only be the primary outcome measure when the child is too young or ill or otherwise unable to self-report [36].

Conclusion

Evidence now available on thousands of children demonstrates that pediatric patients as young as the 5 year old age subgroup can reliably and validly self-report their HRQOL when an age-appropriate measurement instrument is utilized. Pediatric patient-reported outcomes should be accepted as the standard for HRQOL measurement in pediatric clinical trials in which patient health-related quality of life is investigated. In this way, the voices of the children will be heard in matters pertaining to their health and well-being given the perspective that "some treatment effects are known only to the patient" [7]. Measuring perceived health from the perspective of children provides a level of accountability consistent with the Institute of Medicine report on the quality of care [55]. As the consumers of pediatric healthcare, children are uniquely positioned to give their perspectives on healthcare quality through their perceptions of their health-related quality of life.

Abbreviations

HRQOL Health-Related Quality of Life

PedsQL™ Pediatric Quality of Life Inventory™

PRO Patient-Reported Outcomes

FDA Food and Drug Administration

Competing interests

Dr. Varni holds the copyright and the trademark for the PedsQL™ and receives financial compensation from the Mapi Research Trust, which is a nonprofit research institute that charges distribution fees to for-profit companies that use the Pediatric Quality of Life Inventory™. The PedsQL™ is available at the PedsQL™ Website [56].

Authors' contributions

JWV conceptualized the rationale and design of the study. JWV and CAL drafted the manuscript. CAL performed the statistical analyses. TMB participated in the statistical analyses. All authors read and approved the final manuscript.

References

Varni JW, Burwinkle TM, Lane MM. Health-related quality of life measurement in pediatric clinical practice: An appraisal and precept for future research and application. Health and Quality of Life Outcomes. 2005;3:34:1–9. [PMC free article] [PubMed]
Matza LS, Swensen AR, Flood EM, Secnik K, Leidy NK. Assessment of health-related quality of life in children: A review of conceptual, methodological, and regulatory issues. Value in Health. 2004;7:79–92. doi: 10.1111/j.1524-4733.2004.71273.x. [PubMed] [Cross Ref]
Fayers PM, Machin D. Quality of life: Assessment, analysis, and interpretation. New York , Wiley; 2000.
Spilker B. Quality of life and pharmacoeconomics in clinical trials. 2nd. Philadelphia , Lippincott-Raven; 1996.
Varni JW, Seid M, Kurtin PS. Pediatric health-related quality of life measurement technology: A guide for health care decision makers. Journal of Clinical Outcomes Management. 1999;6:33–40.
World Health Organization Constitution of the World Health Organization: Basic Document. Geneva, Switzerland , World Health Organization; 1948.
FDA Guidance for Industry: Patient-reported outcome measures: Use in medical product development to support labeling claims. Center for Drug Evaluation and Research, Food and Drug Administration, Rockville, MD; 2006.
Eiser C. Use of quality of life measures in clinical trials. Ambulatory Pediatrics. 2004;4:395–399. doi: 10.1367/A03-112R.1. [PubMed] [Cross Ref]
Razzouk BI, Hord JD, Hockenberry M, Hinds PS, Feusner J, Williams D, Rackoff WR. Double-blind, placebo-controlled study of quality of life, hematologic end points, and safety of weekly epoetin alfa in children with cancer receiving myelosuppressive chemotherapy. Journal of Clinical Oncology. 2006;24:3583–3589. doi: 10.1200/JCO.2005.03.4371. [PubMed] [Cross Ref]
Varni JW, Burwinkle TM, Seid M. The PedsQL™ as a pediatric patient-reported outcome: Reliability and validity of the PedsQL™ Measurement Model in 25,000 children . Expert Review of Pharmacoeconomics and Outcomes Research. 2005;5:705–719. doi: 10.1586/14737167.5.6.705. [Cross Ref]
Schwimmer JB, Middleton MS, Deutsch R, Lavine JE. A phase 2 trial of metformin as a treatment for non-diabetic pediatric non-alcoholic steatohepatitis. Alimentary Pharmacology & Therapeutics. 2005;21:871–879. doi: 10.1111/j.1365-2036.2005.02420.x. [PubMed] [Cross Ref]
Connelly M, Rapoff MA. Assessing health-related quality of life in children with recurrent headache: Reliability and validity of the PedsQL™ 4.0 in a pediatric sample. Journal of Pediatric Psychology. 2006;31:698–702. doi: 10.1093/jpepsy/jsj063. [PubMed] [Cross Ref]
Clarke SA, Eiser C. The measurement of health-related quality of life in pediatric clinical trials: A systematic review. Health and Quality of Life Outcomes. 2004;2:66:1–5. [PMC free article] [PubMed]
Acquadro C, Berzon R, Dubois D, Leidy NK, Marquis P, Revicki D, Rothman M. Incorporating the patient's perspective into drug development and communication: An ad hoc task force report of the patient-reported outcomes (PRO) harmonization group meeting at the Food and Drug Administration, February 16, 2001. Value in Health. 2003;6:522–531. doi: 10.1046/j.1524-4733.2003.65309.x. [PubMed] [Cross Ref]
Willke RJ, Burke LB, Erickson P. Measuring treatment impact: A review of patient-reported outcomes and other efficacy endpoints in approved product labels. Controlled Clinical Trials. 2004;25:535–552. doi: 10.1016/j.cct.2004.09.003. [PubMed] [Cross Ref]
Sherman SA, Eisen S, Burwinkle TM, Varni JW. The PedsQL™ Present Functioning Visual Analogue Scales: Preliminary reliability and validity. Health and Quality of Life Outcomes. 2006;4:75:1–10. [PMC free article] [PubMed]
McGrath PA. Pain in children: Nature, assessment, and treatment. New York , Guilford; 1990.
Varni JW, Thompson KL, Hanson V. The Varni/Thompson Pediatric Pain Questionnaire: I. Chronic musculoskeletal pain in juvenile rheumatoid arthritis. Pain. 1987;28:27–38. doi: 10.1016/0304-3959(87)91056-6. [PubMed] [Cross Ref]
Varni JW, Bernstein BH. Evaluation and management of pain in children with rheumatic diseases. Rheumatic Disease Clinics of North America. 1991;17:985–1000. [PubMed]
Sprangers MAG, Aaronson NK. The role of health care providers and significant others in evaluating the quality of life of patients with chronic disease: A review. Journal of Clinical Epidemiology. 1992;45:743–760. doi: 10.1016/0895-4356(92)90052-O. [PubMed] [Cross Ref]
Achenbach TM, McConaughy SH, Howell CT. Child/adolescent behavioral and emotional problems: Implications of cross-informant correlations for situational specificity. Psychological Bulletin. 1987;101:213–232. doi: 10.1037/0033-2909.101.2.213. [PubMed] [Cross Ref]
Varni JW, Katz ER, Colegrove R, Dolgin M. Adjustment of children with newly diagnosed cancer: Cross-informant variance. Journal of Psychosocial Oncology. 1995;13:23–38. doi: 10.1300/J077V13N04_02. [Cross Ref]
Varni JW, Katz ER, Seid M, Quiggins DJL, Friedman-Bender A, Castro CM. The Pediatric Cancer Quality of Life Inventory (PCQL): I. Instrument development, descriptive statistics, and cross-informant variance. Journal of Behavioral Medicine. 1998;21:179–204. doi: 10.1023/A:1018779908502. [PubMed] [Cross Ref]
Varni JW, Seid M, Rode CA. The PedsQL™: Measurement model for the Pediatric Quality of Life Inventory. Medical Care. 1999;37:126–139. doi: 10.1097/00005650-199902000-00003. [PubMed] [Cross Ref]
Levi RB, Drotar D. Health-related quality of life in childhood cancer: Discrepancy in parent–child reports. International Journal of Cancer. 1999;12:58–64. doi: 10.1002/(SICI)1097-0215(1999)83:12+<58::AID-IJC11>3.0.CO;2-A. [PubMed] [Cross Ref]
Clancy C, McGrath P, Oddson B. Pain in children and adolescents with spina bifida. Developmental Medicine and Child Neurology. 2005;47:27–34. doi: 10.1017/S0012162205000058. [PubMed] [Cross Ref]
Felder-Puig R, diGallo A, Waldenmair M, Norden P, Winter A, Gadner H, Topf R. Health-related quality of life of pediatric patients receiving allogeneic stem cell or bone marrow transplantation: Results of a longitudinal, multi-center study. Bone Marrow Transplantation. 2006;38:119–126. doi: 10.1038/sj.bmt.1705417. [PubMed] [Cross Ref]
Vance YH, Morse RC, Jenney ME, Eiser C. Issues in measuring quality of life in childhood cancer: Measures, proxies, and parental mental health. Journal of Child Psychology and Psychiatry. 2001;42:661–667. doi: 10.1017/S0021963001007314. [PubMed] [Cross Ref]
Chang P, Yeh C. Agreement between child self-report and parent proxy-report to evaluate quality of life in children with cancer. Psycho-Oncology. 2005;14:125–134. doi: 10.1002/pon.828. [PubMed] [Cross Ref]
Yeh CH, Chang CW, Chang PC. Evaluating quality of life in children with cancer using children's self-reports and parent-proxy reports. Nursing Research. 2005;54:354–362. doi: 10.1097/00006199-200509000-00010. [PubMed] [Cross Ref]
Eiser C, Morse R. Can parents rate their child's health-related quality of life?: Results from a systematic review. Quality of Life Research. 2001;10:347–357. doi: 10.1023/A:1012253723272. [PubMed] [Cross Ref]
Theunissen NCM, Vogels TGC, Koopman HM, Verrips GHW, Zwinderman KAH, Verloove-Vanhorick SP, Wit JM. The proxy problem: Child report versus parent report in health-related quality of life research. Quality of Life Research. 1998;7:387–397. doi: 10.1023/A:1008801802877. [PubMed] [Cross Ref]
De Los Reyes A, Kazdin AE. Measuring informant discrepancies in clinical child research. Psychological Assessment. 2004;16:330–334. doi: 10.1037/1040-3590.16.3.330. [PubMed] [Cross Ref]
Richters JE. Depressed mothers as informants about their children: A critical review of the evidence for distortion. Psychological Bulletin. 1992;112:485–499. doi: 10.1037/0033-2909.112.3.485. [PubMed] [Cross Ref]
Berg-Nielsen TS, Vika A, Dahl AA. When adolescents disagree with their mothers: CBCL-YSR discrepancies related to maternal depression and adolescent self-esteem. Child: Care, Health and Development. 2003;29:207–213. doi: 10.1046/j.1365-2214.2003.00332.x. [PubMed] [Cross Ref]
Varni JW, Limbers CA, Burwinkle TM. Parent proxy-report of their children’s health-related quality of life: An analysis of 13,878 parents’ reliability and validity across age subgroups using the PedsQL™ 4.0 Generic Core Scales. Health and Quality of Life Outcomes. 2007.
Varni JW, Seid M, Kurtin PS. PedsQL™ 4.0: Reliability and validity of the Pediatric Quality of Life Inventory™ Version 4.0 Generic Core Scales in healthy and patient populations. Medical Care. 2001;39:800–812. doi: 10.1097/00005650-200108000-00006. [PubMed] [Cross Ref]
Varni JW, Burwinkle TM, Seid M, Skarr D. The PedsQL™ 4.0 as a pediatric population health measure: Feasibility, reliability, and validity. Ambulatory Pediatrics. 2003;3:329–341. doi: 10.1367/1539-4409(2003)003<0329:TPAAPP>2.0.CO;2. [PubMed] [Cross Ref]
Varni JW, Waldron SA, Gragg RA, Rapoff MA, Bernstein BH, Lindsley CB, Newcomb MD. Development of the Waldron/Varni Pediatric Pain Coping Inventory. Pain. 1996;67:141–150. doi: 10.1016/0304-3959(96)03077-1. [PubMed] [Cross Ref]
McHorney CA, Ware JE, Lu JFR, Sherbourne CD. The MOS 36-item short-form health survey (SF-36): III. Tests of data quality, scaling assumptions, and reliability across diverse patient groups. Medical Care. 1994;32:40–66. doi: 10.1097/00005650-199401000-00004. [PubMed] [Cross Ref]
Fairclough DL, Cella DF. Functional Assessment of Cancer Therapy (FACT-G): Non-response to individual questions. Quality of Life Research. 1996;5:321–329. doi: 10.1007/BF00433916. [PubMed] [Cross Ref]
Hollingshead AB. Four factor index of social status. New Haven, CT , Yale University; 1975.
Cronbach LJ. Coefficient alpha and the internal structure of tests. Psychometrika. 1951;16:297–334. doi: 10.1007/BF02310555. [Cross Ref]
Nunnally JC, Bernstein IR. Psychometric theory. 3rd. New York , McGraw-Hill; 1994.
Pedhazur EJ, Schmelkin LP. Measurement, design, and analysis: An integrated approach. Hillsdale, NJ , Erlbaum; 1991.
McHorney CA, Ware JE, Raczek AE. The MOS 36-item short-form health survey (SF-36): II. Psychometric and clinical tests of validity in measuring physical and mental health constructs. Medical Care. 1993;31:247–263. doi: 10.1097/00005650-199303000-00006. [PubMed] [Cross Ref]
Cohen J. Statistical power analysis for the behavioral sciences. 2nd. Hillsdale, NJ , Erlbaum; 1988.
McGraw KO, Wong SP. Forming inferences about some Intraclass Correlation Coefficients. Psychological Methods. 1996;1:30–46. doi: 10.1037/1082-989X.1.1.30. [Cross Ref]
Cremeens J, Eiser C, Blades M. Factors influencing agreement between child self-report and parent proxy-reports on the Pediatric Quality of Life Inventory™ 4.0 (PedsQL™) Generic Core Scales. Health and Quality of Life Outcomes. 2006;4:1–8. [PMC free article] [PubMed]
Bartko JJ. The intraclass correlation coefficient as a measure of reliability. Psychological Reports. 1966;19:3–11. [PubMed]
Wilson KA, Dowling AJ, Abdolell M, Tannock IF. Perception of quality of life by patients, partners and treating physicians. Quality of Life Research. 2001;9:1041–1052. doi: 10.1023/A:1016647407161. [PubMed] [Cross Ref]
Weng. Li-Jen Impact of the number of response categories and anchor labels on coefficient alpha and test-retest reliability. Educational and Psychological Measurement. 2004;64:956–972. doi: 10.1177/0013164404268674. [Cross Ref]
Novick M, Lewis G. Coefficient alpha and the reliability of composite measurements. Psychometrika. 1967;32:1–13. doi: 10.1007/BF02289400. [PubMed] [Cross Ref]
Eiser C, Morse R. Quality of life measures in chronic diseases of childhood. Health Technology Assessment. 2001;5:1–158. [PubMed]
IOM Crossing the quality chasm: A new health system for the 21st century. Washington, DC , National Academy of Sciences; 2001.
Varni JW. PedsQL™ Website http://www.pedsql.org

Articles from Health and Quality of Life Outcomes are provided here courtesy of
BioMed Central