To determine whether community integration and/or quality of life (QoL) among people living with chronic spinal cord injury (SCI) are superior among sport participants vs non-sport participants.
Persons (n = 90) living in the community with SCI (ASIA Impairment Scale A–D), level C5 or below, > 15 years of age, ≥ 12 months postinjury, and requiring a wheelchair for > 1 hours/day were divided into 2 groups based on their self-reported sport participation at interview: sport participants (n = 45) and non-sport participants (n = 45).
Independent-sample t tests revealed that both Community Integration Questionnaire (CIQ) and Reintegration to Normal Living Index (RNL) total mean scores were higher among sport participants vs non-sport participants (P < 0.05). Significant correlation between CIQ and RNL total scores was found for all participants (Pearson correlation coefficients, P < 0.01). Logistic regression analysis revealed that the unadjusted odds ratio of a high CIQ mean score was 4.75 (95% CI 1.7, 13.5) among current sport participants. Similarly, the unadjusted odds ratio of a high RNL score was 7.00 (95% CI 2.3, 21.0) among current sport participants. Regression-adjusted odds ratios of high CIQ and high RNL scores were 1.36 (95% CI 0.09, 1.45) and 0.15 (95% CI 0.04, 0.55), respectively. The odds ratio for pre-SCI sport participation predicting post-SCI sport participation was 3.06 (95% CI 1.23, 7.65).
CIQ and QoL scores were higher among sport participants compared to non-sport participants. There was an association between mean CIQ and RNL scores for both groups. Sport participants were 4.75 and 7.00 times as likely to have high CIQ and QoL scores. Both groups had a similar likelihood of high CIQ and RNL scores after adjusting for important confounders. Individuals who participated in sports prior to SCI were more likely to participate in sports post-SCI.
Spinal cord injuries; Tetraplegia; Paraplegia; Disability; Sport participation; Wheelchair sports; Community reintegration; Quality of life
Study design: Systematic review.
Study rationale: According to current estimates, there are more than 1 million people living with a spinal cord injury (SCI) in the United States alone. Given the potentially devastating impact of SCI on health-related quality of life (QoL), we sought to gain an improved understanding of QoL outcomes in SCI.
Objective: To identify and describe common QoL outcomes measures in patients with SCI.
Methods: A systematic review of the English-language literature was undertaken for articles published from 1998 through December 2010. Electronic databases and reference lists of key articles were searched to identify measures or indices used to evaluate QoL outcomes in patients with SCI. The titles and abstracts of the SCI peer-reviewed literature were searched to determine which of these outcome measures were most commonly used to evaluate QoL in patients with SCI.
Results: We identified 27 outcome measures used to evaluate QoL in patients with SCI. In SCI literature, the six most commonly used objective outcome measures were the Short-form 36 (SF-36); Craig Handicap Assessment and Reporting Technique (CHART); Short-form 12 (SF-12); Sickness Impact Profile (SIP68); Reintegration to Normal Living Index (RNL); and Community Integration Questionnaire (CIQ). The six subjective measures that were most frequently used were the Satisfaction with Life Scale (SWLS); Quality of Life Index (QLI); Life Satisfaction Questionnaire (LISAT-9/-1); World Health Organization Quality of Life-BREF scale (WHOQOL-BREF); Perceived Quality of Life (PQOL); and global QoL. All six objective measures have been validated in an SCI population, and four of the six subjective measures have been similarly validated. Three of each of the objective and subjective measures have been reliability tested in a population with SCI.
Conclusion: In addition to neurological and functional changes after SCI, QoL outcomes should be routinely assessed. Choice of appropriate QoL measure should be influenced by the study objectives and design, as well as the psychometric properties of the particular measure within the context of SCI.
Purpose: To further investigate the construct validity of the Community Balance and Mobility Scale (CB&M), developed for ambulatory individuals with traumatic brain injury (TBI).
Methods: A convenience sample of 35 patients with TBI (13 in-patients, 22 outpatients) was recruited. Analyses included a comparison of CB&M and Berg Balance Scale (BBS) admission and change scores and associations between the CB&M and measures of postural sway, gait, and dynamic stability; the Community Integration Questionnaire (CIQ); and the Activities-specific Balance Confidence (ABC) Scale.
Results: Mean admission scores on the BBS and the CB&M were 53.6/56 (SD=4.3) and 57.8/96 (SD=23.3) respectively. Significant correlations were demonstrated between the CB&M and spatiotemporal measures of gait, including walking velocity, step length, step width, and step time; measures of dynamic stability, including variability in step length and step time; and the ABC (p<0.05). Significant correlations between the CB&M and CIQ were revealed with a larger data set (n=47 outpatients) combined from previous phases of research.
Conclusions: In patients with TBI, the CB&M is less susceptible to a ceiling effect than the BBS. The construct validity of the CB&M was supported, demonstrating associations with laboratory measures of dynamic stability, measures of community integration, and balance confidence.
balance; brain injuries; posture; mobility limitations; outcome assessment; équilibre; évaluation des résultats; limites à la mobilité; posture; traumatisme crânien
Psychological factors such as post-traumatic stress and depression may play an important role in the recovery after whiplash injuries. Difficulties in psychosocial functioning with limitations in everyday life may dominate for some time after the injury. Our study therefore investigates the relationships between pain, post-traumatic stress, depression, and community integration. A set of questionnaires was answered by 191 persons (88 men, 103 women) five years after a whiplash injury to assess pain intensity (visual analogue scale, VAS), whiplash-related symptoms, post-traumatic stress (impact of event scale, IES), depression (Beck depression inventory, BDI-II), community integration (community integration questionnaire, CIQ), life satisfaction (LiSat-11). One or more depressive symptoms were reported by 74% of persons; 22% reported scores that were classified as mild to severe depression. The presence of at least one post-traumatic symptom was reported by 70% of persons, and 38% reported mild to severe stress. Total scores of community integration for women were statistically significantly higher than for men. The total VAS score was correlated positively to the IES (r=0.456, P<0.456), the BDI (r=0.646, P<0.001), and negatively to the CIQ (r=−0.300, P<0.001). These results highlight the view that a significant proportion of people experience both pain and psychological difficulties for a long time after a whiplash injury. These findings should be taken into consideration in the management of subjects with chronic whiplash symptoms and may support a multi-professional rehabilitation model that integrates physical, psychological, and psychosocial factors.
whiplash injuries; depression; stress disorders; post-traumatic.
Having psychometrically strong disability measures that minimize response burden is
important in assessing of older adults.
Using the original 48 items from the Late-Life Function and Disability Instrument and
newly developed items, a 158-item Activity Limitation and a 62-item Participation
Restriction item pool were developed. The item pools were administered to a convenience
sample of 520 community-dwelling adults 60 years or older. Confirmatory factor analysis
and item response theory were employed to identify content structure, calibrate items,
and build the computer-adaptive testings (CATs). We evaluated real-data simulations of
10-item CAT subscales. We collected data from 102 older adults to validate the 10-item
CATs against the Veteran’s Short Form-36 and assessed test–retest
reliability in a subsample of 57 subjects.
Confirmatory factor analysis revealed a bifactor structure, and multi-dimensional item
response theory was used to calibrate an overall Activity Limitation Scale (141 items)
and an overall Participation Restriction Scale (55 items). Fit statistics were
acceptable (Activity Limitation: comparative fit index = 0.95, Tucker Lewis Index
= 0.95, root mean square error approximation = 0.03; Participation
Restriction: comparative fit index = 0.95, Tucker Lewis Index = 0.95, root
mean square error approximation = 0.05). Correlation of 10-item CATs with full
item banks were substantial (Activity Limitation: r = .90;
Participation Restriction: r = .95). Test–retest
reliability estimates were high (Activity Limitation: r = .85;
Participation Restriction r = .80). Strength and pattern of
correlations with Veteran’s Short Form-36 subscales were as hypothesized. Each
CAT, on average, took 3.56 minutes to administer.
The Late-Life Function and Disability Instrument CATs demonstrated strong reliability,
validity, accuracy, and precision. The Late-Life Function and Disability Instrument CAT
can achieve psychometrically sound disability assessment in older persons while reducing
respondent burden. Further research is needed to assess their ability to measure change
in older adults.
Function; Disability; Computer-adaptive testing; Activity; Participation
The eight Performance Scales and three assimilated scales (PS) used in North American Research Committee on Multiple Sclerosis (NARCOMS) registry surveys cover a broad range of neurologic domains commonly affected by multiple sclerosis (mobility, hand function, vision, fatigue, cognition, bladder/bowel, sensory, spasticity, pain, depression, and tremor/coordination). Each scale consists of a single 6-to-7-point Likert item with response categories ranging from “normal” to “total disability”. Relatively little is known about the performances of the summary index of disability derived from these scales (the Performance Scales Sum or PSS). In this study, we demonstrate the value of a combination of classical and modern methods recently proposed by the Patient-Reported Outcome Measurement Information System (PROMIS) network to evaluate the psychometric properties of the PSS and derive an improved measure of global disability from the PS.
The study sample included 7,851adults with MS who completed a NARCOMS intake questionnaire between 2003 and 2011. Factor analysis, bifactor modeling, and item response theory (IRT) analysis were used to evaluate the dimension(s) of disability underlying the PS; calibrate the 11 scales; and generate three alternative summary scores of global disability corresponding to different model assumptions and practical priorities. The construct validity of the three scores was compared by examining the magnitude of their associations with participant’s background characteristics, including unemployment.
We derived structurally valid measures of global disability from the PS through the proposed methodology that were superior to the PSS. The measure most applicable to clinical practice gives similar weight to physical and mental disability. Overall reliability of the new measure is acceptable for individual comparisons (0.87). Higher scores of global disability were significantly associated with older age at assessment, longer disease duration, male gender, Native-American ethnicity, not receiving disease modifying therapy, unemployment, and higher scores on the Patient Determined Disease Steps (PDDS).
Promising, interpretable and easily-obtainable IRT scores of global disability were generated from the PS by using a sequence of traditional and modern psychometric methods based on PROMIS recommendations. Our analyses shed new light on the construct of global disability in MS.
Electronic supplementary material
The online version of this article (doi:10.1186/s12883-014-0192-1) contains supplementary material, which is available to authorized users.
Multiple sclerosis; Disability evaluation; Patient-reported outcome measure; North American Research Committee on Multiple Sclerosis (NARCOMS) registry; Factor analysis; Bifactor model; Item response theory
Self-perceptions of aging have been implicated as independent predictors of functional disability and mortality in older adults. In spite of this, research on self-perceptions of aging is limited. One reason for this is the absence of adequate measures. Specifically, there is a need to develop a measure that is theoretically-derived, has good psychometric properties, and is multidimensional in nature. The present research seeks to address this need by adopting the Self-Regulation Model as a framework and using it to develop a comprehensive, multi-dimensional instrument for assessing self-perceptions of aging. This study describes the validation of this newly-developed instrument, the Aging Perceptions Questionnaire (APQ).
Participants were 2,033 randomly selected community-dwelling older (+65 yrs) Irish adults who completed the APQ alongside measures of physical and psychological health. The APQ assesses self-perceptions of aging along eight distinct domains or subscales; seven of these examine views about own aging, these are: timeline chronic, timeline cyclical, consequences positive, consequences negative, control positive, control negative, and emotional representations; the eighth domain is the identity domain and this examines the experience of health-related changes.
Mokken scale analysis showed that the majority of items within the views about aging subscales were strongly scalable. Confirmatory factor analysis also indicated that the model provided a good fit for the data. Overall, subscales had good internal reliabilities. Hierarchical linear regression was conducted to investigate the independent contribution of APQ subscales to physical and psychological health and in doing so determine the construct validity of the APQ. Results showed that self-perceptions of aging were independently related to physical and psychological health. Mediation testing also supported a role for self-perceptions of aging as partial mediators in the relationship between indices of physical functioning and physical and psychological health outcomes.
Findings support the complex and multifaceted nature of the aging experience. The good internal reliability and construct validity of the subscales suggests that the APQ is a promising instrument that can enable a theoretically informed, multidimensional assessment of self-perceptions of aging. The potential role of self-perceptions of aging in facilitating physical and psychological health in later life is also highlighted.
To our knowledge, the available psychometric literature does not include an instrument for the quantification of social quality of life among older women from diverse ethnic backgrounds. To address the need for a tool of this kind, we conducted two studies to assess the initial reliability and validity of a new instrument. The latter was created specifically to quantify the contribution of a) social networks and resources (e.g., family, friends, and community) as well as b) one's perceived power and respect within family and community to subjective well-being in non-clinical, ethnically diverse populations of older women.
In Study 1, we recruited a cross-sectional sample of primarily non-European-American older women (N = 220) at a variety of community locations. Participants were administered the following: a short screener for dementia; a demographic list; an initial pool of 50 items from which the final items of the new Older Women's Social Quality of Life Inventory (OWSQLI) were to be chosen (based on a statistical criterion to apply to the factor analysis findings); the Single Item Measure of Social Support (SIMSS); and the Medical Outcome Study 36-item Short-Form Health Survey (MOS SF-36). Study 2 was conducted on a second independent sample of ethnically diverse older women. The same recruitment strategies, procedures, and instruments as those of Study 1 were utilized in Study 2, whose sample was comprised of 241 older women with mostly non-European-American ethnic status.
In Study 1, exploratory factor analysis of the OWSQLI obtained robust findings: the total variance explained by one single factor with the final selection of 22 items was over 44%. The OWSQLI demonstrated strong internal consistency (α = .92, p < .001), adequate criterion validity with the SIMSS (r = .33; p < .01), and (as expected) moderate concurrent validity with the MOS SF-36 for both physical (r = .21; p < .01) and mental (r = .26; p < .01) quality of life. In order to confirm the validity of the 22-item OWSQLI scale that emerged from Study 1 analyses, we replicated those analyses in Study 2, although using confirmatory factor analysis. The total variance accounted for by one factor was about 42%, again quite high and indicative of a strong single-factor solution. Study 2 data analyses yielded the same strong reliability findings (i.e., α = .92, p < .001). The 22-item OWSQLI was correlated with the SIMSS (r = .27, p < .001) in the expected direction. Finally, correlations with the MOS SF- 36 demonstrated moderate concurrent validity for physical (r = .14; p < .01) and mental (r = .18; p < .01) quality of life, as expected.
The findings of these two studies highlight the potential for our new tool to provide a valid measure of older women's social quality of life, yet they require duplication in longitudinal research. Interested clinicians should consider using the OWSQLI in their assessment battery to identify older women's areas of lower versus higher social quality of life, and should establish the maximization of patients' social quality of life as an important therapeutic goal, as this variable is significantly related to both physical and mental health.
With China’s rapid economic growth in the past few decades, there is currently an emerging focus on happiness. Cross-cultural validity studies have indicated that the four-item Subjective Happiness Scale (SHS) has high internal consistency and stable reliability. However, the psychometric characteristics of the SHS in broader Chinese community samples are unknown.
We evaluated the factor structure and psychometric properties of the SHS in the Hong Kong general population.
The Chinese SHS was derived using forward–backward translation. Of the Cantonese-speaking participants aged ≥15 years, 2,635 were randomly selected from the random sample component of the FAMILY Cohort, a territory-wide cohort study in Hong Kong. In addition to the SHS, a single-item overall happiness scale, the Patient Health Questionnaire-9 (PHQ-9), the Family Adaptation, Partnership, Growth, Affection, Resolve (APGAR) scale, and the Medical Outcomes Study 12-item short-form version 2 (SF-12) mental and physical health scales were administered.
Exploratory and confirmatory factor analyses supported a single factor with high loadings for the four SHS items. Multiple group analyses indicated factor invariance across sex and age groups. Cronbach’s alpha was 0.82, and 2-week test–retest reliability (n = 191) was 0.70. The SHS correlated significantly with single-item overall happiness (Spearman’s rho [ρ] = 0.57), Family APGAR (ρ = 0.26), PHQ-9 (ρ = −0.34), and mental health-related quality of life (ρ = 0.40) but showed a lower correlation with physical health (ρ = 0.15). A regression model that included the PHQ-9 and Family APGAR scores explained 37 % of the variance in SF-12 mental health scores; adding the SHS raised the variance explained to 41 %.
Our results support the reliability and validity of the SHS as a relevant component in the measurement battery for mental well-being in a Chinese general population.
Subjective Happiness Scale; Construct validity; Well-being; Family study; Public health; Chinese
The 12-item Short Form Health Survey (SF-12) as a shorter alternative of the SF-36 is largely used in health outcomes surveys. The aim of this study was to validate the SF-12 in Iran.
A random sample of the general population aged 15 years and over living in Tehran, Iran completed the SF-12. Reliability was estimated using internal consistency and validity was assessed using known groups comparison and convergent validity. In addition, the factor structure of the questionnaire was extracted by performing both exploratory factor analysis (EFA) and confirmatory factor analysis (CFA).
In all, 5587 individuals were studied (2721 male and 2866 female). The mean age and formal education of the respondents were 35.1 (SD = 15.4) and 10.2 (SD = 4.4) years respectively. The results showed satisfactory internal consistency for both summary measures, that are the Physical Component Summary (PCS) and the Mental Component Summary (MCS); Cronbach's α for PCS-12 and MCS-12 was 0.73 and 0.72, respectively. Known-groups comparison showed that the SF-12 discriminated well between men and women and those who differed in age and educational status (P < 0.001). In addition, correlations between the SF-12 scales and single items showed that the physical functioning, role physical, bodily pain and general health subscales correlated higher with the PCS-12 score, while the vitality, social functioning, role emotional and mental health subscales more correlated with the MCS-12 score lending support to its good convergent validity. Finally the principal component analysis indicated a two-factor structure (physical and mental health) that jointly accounted for 57.8% of the variance. The confirmatory factory analysis also indicated a good fit to the data for the two-latent structure (physical and mental health).
In general the findings suggest that the SF-12 is a reliable and valid measure of health related quality of life among Iranian population. However, further studies are needed to establish stronger psychometric properties for this alternative form of the SF-36 Health Survey in Iran.
The Dizziness Handicap Inventory (DHI) is a validated, self-report questionnaire which is widely used as an outcome measure. Previous studies supported the multidimensionality of the DHI, but not the original subscale structure. The objectives of this survey were to explore the dimensions of the Dizziness Handicap Inventory - German version, and to investigate the associations of the retained factors with items assessing functional disability and the Hospital Anxiety and Depression Scale (HADS). Secondly we aimed to explore the retained factors according to the International Classification of Functioning, Disability and Health (ICF).
Patients were recruited from a tertiary centre for vertigo, dizziness or balance disorders. They filled in two questionnaires: (1) The DHI assesses precipitating physical factors associated with dizziness/unsteadiness and functional/emotional consequences of symptoms. (2) The HADS assesses non-somatic symptoms of anxiety and depression. In addition, patients answered the third question of the University of California Los Angeles-Dizziness Questionnaire which covers the impact of dizziness and unsteadiness on everyday activities. Principal component analysis (PCA) was performed to explore the dimensions of the DHI. Associations were estimated by Spearman correlation coefficients.
One hundred ninety-four patients with dizziness or unsteadiness associated with a vestibular disorder, mean age (standard deviation) of 50.6 (13.6) years, participated. Based on eigenvalues greater one respectively the scree plot we analysed diverse factor solutions. The 3-factor solution seems to be reliable, clinically relevant and can partly be explained with the ICF. It explains 49.2% of the variance. Factor 1 comprises the effect of dizziness and unsteadiness on emotion and participation, factor 2 informs about specific activities or effort provoking dizziness and unsteadiness, and factor 3 focuses on self-perceived walking ability in relation to contextual factors. The first factor correlates moderately with disability and the HADS (values ≥0.6). The second factor is comparable with the original physical subscale of the DHI and factors retained in previous studies.
The results of the present survey can not support the original subscale structure of the DHI. Therefore only the total scale should be used. We discuss a possible restructuring of the DHI.
To evaluate the psychometric properties of the UK FIM + FAM.
(a) A systematic literature review integrating the evidence for psychometric qualities of both the original and UK versions, and (b) exploratory and confirmatory factor analysis of admission/discharge data from an inpatient general neuro-rehabilitation cohort using parametric and non-parametric techniques. A prospective cohort of 459 patients with a male:female ratio of 57:43 and mean age of 44.5 (SD 14.3) years participated in this study.
Seven published articles together demonstrated acceptable utility, concurrent validity, inter-rater reliability and responsiveness of the UK FIM + FAM. Factor analysis demonstrated that all items loaded high (>0.58) on the first principal component and distinct motor and cognitive factors emerged after rotation. A four-factor solution also demonstrated four distinct, interpretable dimensions (Physical, Psychosocial, Communication and Extended Activities of Everyday Living (EADL)). Mokken analysis of the second data set confirmed these dimensions. Cronbach’s αs were 0.97 and 0.96 for the motor and cognitive domains and 0.90–0.97 for the subscales. Analysis of responsiveness demonstrated “large” effect sizes (0.86–1.29).
The UK FIM + FAM, including the newer EADL module, is a valid, reliable scale of functional independence. It has high internal consistency in two domains and four subscales and is responsive to changes occurring in a general inpatient neuro-rehabilitation population.
Implications for Rehabilitation
The UK FIM + FAM is a valid, reliable scale of functional independence, which is responsive to changes occurring in a general inpatient neuro-rehabilitation population.
Physical, Psychosocial, Communication It can be used to derive a reliable, single score of overall independence and also yields specific information in two main domains and four separate subscales of independence: Physical, Psychosocial, Communication and Extended Activities of Daily Living (EADL).
The newer EADL item module provides added value, measuring functional independence for community-based activities.
Extended activities of daily living; factor analysis; Mokken analysis; neurological rehabilitation; psychometrics; UK FIM + FAM
Measuring health-related quality of life (HRQOL) is important in arthritis and the SF-36v2 is the current state-of-the-art. It is only emerging how well the Centers for Disease Control and Prevention (CDC) HRQOL measures HRQOL for people with arthritis. This study's purpose is to assess the psychometric properties of the 9-item CDC HRQOL (4-item Healthy Days Core Module and 5-item Healthy Days Symptoms Module) in an arthritis sample using the SF-36v2 as a comparison.
In Fall 2002, a cross-sectional study acquired survey data including the CDC HRQOL and SF-36v2 from 2 North Carolina populations of adult patients reporting osteoarthritis, rheumatoid arthritis, and fibromyalgia; 2182 (52%) responded. The first item of both the CDC HRQOL and the SF-36v2 was general health (GEN). All 8 other CDC HRQOL items ask for the number of days in the past 30 days that respondents experienced various aspects of HRQOL. Exploratory principal components analyses (PCA) were conducted on each sample and the combined samples of the CDC HRQOL. The multitrait-multimethod matrix (MTMM) was used to compute correlations between each trait (physical health and mental health) and between each method of measurement (CDC HRQOL and SF36v2). The relative contribution of the CDC HRQOL in predicting the physical component summary (PCS) and the mental component summary (MCS) was determined by regressing the CDC HRQOL items on the PCS and MCS scales.
All 9 CDC HRQOL items loaded primarily onto 1 factor (explaining 57% of the item variance) representing a reasonable solution for capturing overall HRQOL. After rotation a 2 factor interpretation for the 9 items was clear, with 4 items capturing physical health (physical, activity, pain, and energy days) and 3 items capturing mental health (mental, depression, and anxiety days). All of the loadings for these two factors were greater than 0.70. The CDC HRQOL physical health factor correlated with PCS (r = -.78, p < 0.0001) and the mental health factor correlated with MCS (r = -.71, p < 0.0001). The relative contribution of the CDC HRQOL in predicting PCS was 73% (R2 = .73) when GEN was included in the CDC HRQOL score and 65% (R2 = .65) when GEN was removed. The relative contribution of the CDC HRQOL in predicting MCS was 56% (R2 = .56) when GEN was included and removed.
The CDC HRQOL appears to have strong psychometric properties in individuals with arthritis in both community-based and subspecialty clinical settings. The 9 item CDC HRQOL is a reasonable measure for overall HRQOL and the two subscales, representing physical and mental health, are reasonable when the goal is to examine those aspects.
There is a lack of validated instruments to measure the level of burden of Alzheimer’s disease (AD) on caregivers. The Impact of Alzheimer’s Disease on Caregiver Questionnaire (IADCQ) is a 12-item instrument with a seven-day recall period that measures AD caregiver’s burden across emotional, physical, social, financial, sleep, and time aspects. Primary objectives of this study were to evaluate psychometric properties of IADCQ administered on the Web and to determine most appropriate scoring algorithm.
A national sample of 200 unpaid AD caregivers participated in this study by completing the Web-based version of IADCQ and Short Form-12 Health Survey Version 2 (SF-12v2™). The SF-12v2 was used to measure convergent validity of IADCQ scores and to provide an understanding of the overall health-related quality of life of sampled AD caregivers.
The IADCQ survey was also completed four weeks later by a randomly selected subgroup of 50 participants to assess test-retest reliability. Confirmatory factor analysis (CFA) was implemented to test the dimensionality of the IADCQ items. Classical item-level and scale-level psychometric analyses were conducted to estimate psychometric characteristics of the instrument. Test-retest reliability was performed to evaluate the instrument’s stability and consistency over time.
Virtually none (2%) of the respondents had either floor or ceiling effects, indicating the IADCQ covers an ideal range of burden. A single-factor model obtained appropriate goodness of fit and provided evidence that a simple sum score of the 12 items of IADCQ can be used to measure AD caregiver’s burden. Scales-level reliability was supported with a coefficient alpha of 0.93 and an intra-class correlation coefficient (for test-retest reliability) of 0.68 (95% CI: 0.50–0.80). Low-moderate negative correlations were observed between the IADCQ and scales of the SF-12v2.
The study findings suggest the IADCQ has appropriate psychometric characteristics as a unidimensional, Web-based measure of AD caregiver burden and is supported by strong model fit statistics from CFA, high degree of item-level reliability, good internal consistency, moderate test-retest reliability, and moderate convergent validity. Additional validation of the IADCQ is warranted to ensure invariance between the paper-based and Web-based administration and to determine an appropriate responder definition.
Alzheimer’s disease; Caregivers; Burden; Psychometrics; Questionnaire
This study assessed the reliability and validity of the Child Oral Health Impact Profile–Short Form 19 (COHIP-SF 19) from the validated 34-item COHIP.
Participants included 205 pediatric, 107 orthodontic, and 863 patients with craniofacial anomalies (CFAs). Item level evaluations included examining content overlap, distributional properties, and use of the response set. Confirmatory factor analysis identified potential items for deletion. Scale reliability was assessed with Cronbach's alpha. Discriminant validity of the COHIP-SF 19 was evaluated as follows: among pediatric participants, scores were compared with varying amounts of decayed and filled surfaces (DFS) and presence of caries on permanent teeth; for orthodontic patients, scores were correlated with anterior tooth spacing/crowding; and for those with CFA, scores were compared with clinicians’ ratings of extent of defect (EOD) for nose and lip and/or speech hypernasality. Convergent validity was assessed by examining the partial Spearman correlation between the COHIP scores and a standard Global Health self-rating. Comparisons between the COHIP and the COHIP-SF 19 were completed across samples.
The reduced questionnaire consists of 19 items: Oral Health (five items), Functional Well-Being (four items), and a combined subscale named Socio-Emotional Well-Being (10 items). Internal reliability is ≥0.82 for the three samples. Results demonstrate that the COHIP-SF 19 discriminates within and across treatment groups by EOD and within a community-based pediatric sample. The measure is associated with the Global Health rating (P < 0.05), thereby indicating convergent validity.
Reliability and validity testing demonstrate that the COHIP-SF 19 is a psychometrically sound instrument to measure oral health-related quality of life across school-aged pediatric populations.
quality of life; pediatrics; global health rating; orthodontics; craniofacial; oral health-related quality of life
The WHODAS-II was substantially modified for use in the World Mental Health Surveys. This paper considers the modified WHODAS-II’s psychometric properties and implications of filter items employed to reduce respondent burden.
Study design and setting
Seventeen surveys in 16 countries administered a modified WHODAS-II to population samples (N=38,934 adults). Modifications included introducing filter questions for four sub-scales and substituting questions on the number of days activity was limited for the Life Activities domain. We evaluated distributional properties, reliability, and validity of the modified WHODAS-II.
Most respondents (77%–99%) had zero scores on filtered subscales. Lower bound estimates of internal consistency (alpha) for the filtered subscales were typically in the 0.70’s, but were higher for the Global scale. Loadings of subscale scores on a Global Disability factor were moderate-to-high. Correlations with the Sheehan Disability Scale were modest but consistently positive, while correlations with SF-12 Physical Component Summary were considerably higher. Cross-national variability in disability scores was observed, but was not readily explainable.
Internal consistency and validity of the modified WHODAS-II was generally supported, but use of filter questions impaired measurement properties. Group differences in modified WHODAS-II disability scores may be compared within, but not necessarily across, countries.
Disability; Measurement; Reliability; Validity; Survey; Epidemiology
Most existing tools for measuring health literacy (HL) focus on reading comprehension and numeracy in English speakers. The aim of this study was to develop a generic HL measure for Japanese adults.
A questionnaire survey was conducted among participants in multiphasic health examinations at a Japanese healthcare facility. HL was measured using the 14-item health literacy scale (HLS-14) that was adapted from the HL scale specific to diabetic patients developed by Ishikawa and colleagues. The 14 items consist of five items for functional HL, five items for communicative HL, and four items for critical HL. The reliability and validity of the HLS-14 were assessed among 1,507 eligible respondents aged 30–69 years.
Explanatory factor analysis produced a three-factor solution that was very similar to the original HL scale. Cronbach’s alpha indicated satisfactory internal consistency of the functional, communicative, and critical HL scores (0.83, 0.85, and 0.76, respectively). There were no floor or ceiling effects in each HL score. Confirmatory factor analysis revealed an acceptable fit of the three-factor model (comparative fit index = 0.912, normed fit index = 0.905, root mean square error of approximation = 0.082). When the two groups with a total HL score above and below the median (50), respectively, were compared, those who could obtain medication information satisfactorily and those who wanted to participate in making medication decisions were more frequently observed in the group with the higher score.
The HLS-14 demonstrated adequate reliability and validity as a generic HL measure for Japanese adults. This scale can be utilized for measuring functional, communicative, and critical HL in the clinical and public health contexts.
Health literacy; Adult; Japan; Questionnaire; Validity
This paper describes the development and psychometric properties of the Health and Functioning ICF-60 (HF-ICF-60) measure, based on the World Health Organization (WHO) ‘International Classification of Functioning, Disability and Health: ICF’ (2001). The aims of the present study were to test psychometric properties of the HF-ICF-60, developed as a measure that would be responsive to change in functioning through changes in health and nutritional status, as a prospective measure to monitor health and nutritional status of populations and to explore the relationship of the HF-ICF-60 with quality of life measures such as the World Health Organization WHOQOL-BREF quality of life assessment in relation to non-communicable diseases.
The HF-ICF-60 measure consists of 60 items selected from the ICF by an expert panel, which included 18 items that cover Body Functions, 21 items that cover Activities and Participation, rated on five-point scales, and 21 items that cover Environmental Factors (seven items cover Individual Environmental Factors and 14 items cover Societal Environmental Factors), rated on nine-point scales. The HF-ICF-60 measure was administered to the Russian nationally representative sample within the Russian National Population Quality of Life, Health and Nutrition Survey, in 2004 (n = 9807) and 2005 (n = 9560), as part of the two waves of the Russian Longitudinal Monitoring Survey (RLMS). The statistical analyses were carried out with the use of both classical and modern psychometric methods, such as factor analysis, and based on Item Response Theory, respectively.
The HF-ICF-60 questionnaire is a new measure derived directly from the ICF and covers the ICF components as follows: Body Functions, Activities and Participation, and Environmental Factors (Individual Environmental Factors and Societal Environmental Factors). The results from the factor analyses (both Exploratory Factor Analyses and Confirmatory Factor Analyses) show good support for the proposed structure together with an overall higher-order factor for each scale of the measure. The measure has good reliability and validity, and sensitivity to change in the health and nutritional status of respondents over time. Normative values were developed for the Russian adult population.
The HF-ICF-60 has shown good psychometric properties in the two waves of the nationally representative RLMS, which provided considerable support to using the HF-ICF-60 data as the normative health and functioning values for the Russian population. Similarly, the administration of the WHOQOL-BREF in the same two waves of the nationally representative RLMS has allowed the normative quality of life values for the Russian population to be obtained. Therefore, the objective assessment of health and functioning of the HF-ICF-60 could be mapped onto the subjective evaluation of quality of life of the WHOQOL-BREF to increase the potential usefulness of the surveys in relation to non-communicable diseases. © 2014 The Authors. Clinical Psychology & Psychotherapy. Published by John Wiley & Sons, Ltd.
Key Practitioner Message
The HF-ICF-60 offers a new perspective in measuring change in functioning through changes in lifestyle and diet.
The HF-ICF-60 can be combined with the WHOQOL-BREF to map the objective assessment of health and functioning onto the subjective evaluation of quality of life.
Combined use of the HF-ICF-60 and the WHOQOL-BREF can be especially useful for national and global monitoring and surveillance of implementation of measures to reduce risk factors of non-communicable diseases and to promote healthy lifestyles and healthy diets.
ICF; Health and Functioning; Nutrition; Quality of Life; Psychometrics; Population Surveys
related quality of life (HRQOL) inventories are multi-dimensional
measures of patient-centred health status developed for clinical
research. The MS quality of life 54 (MSQOL-54) is an MS-specific HRQOL
inventory originally devised for English speaking patients. It consists
of a core measure, the 36-item short form health survey (SF-36)
previously adapted into Italian, and 18 additional items exploring
domains relevant to patients with MS (MS-18 module). The authors
translated and culturally adapted into Italian the MS-18 module of the
MSQOL-54 questionnaire, and clinically validated the whole questionnaire.
module was translated following the methodology of the International
Quality of Life Assessment (IQOLA) project. The MSQOL-54 was validated
in 204 consecutive patients with MS seen between April and September
1997 at three participating centres. The questionnaire was explained by
the physician who also administered the expanded disability status
scale (EDSS) and mini mental status scale examination, and the patient
filled in the MSQOL-54 and Beck depression inventory questionnaires
(BDI), with assistance if required. The contribution of impairments and
disabilities to MSQOL-54 scores were assessed, and mean scores were
compared with normative data for the general Italian population, and
with the original sample of United States MS patients.
RESULTS—The mean age
of the 204 patients was 42 years; mean EDSS score was 4.5 (range
0-8.5). Patients' participation in the assessment was satisfactory,
and all scales satisfied the usual psychometric standards. The
characteristics of the United States sample matched those of our
patients in all but gender (72% United States patients v 52% Italian patients were women), and
education (90% United States patients and 44% Italian patients
completed high school); MSQOL-54 profiles were also similar. The EDSS
was significantly associated with the physical health composite but not
with the mental health composite score. Multiple linear regression
modelling showed that age and BDI independently predicted physical
health composite (p < 0.001), and mental health composite (p < 0.001). Clinical worsening in the previous year had an independent
effect on the physical health composite (p < 0.001).
Italian version of MSQOL-54 is easy to administer and is well accepted
by patients. Neurological impairment has a limited influence on
perceived quality of life, while age and depressive symptoms has a
The aim of this study was to determine the validity of the Italian translation of the Tinnitus Handicap Inventory (THI) by Newman et al. in order to make this self-report measure of perceived tinnitus handicap available both for clinical and research purposes in our country and to contribute to its cross-cultural validation as a self-report measure of perceived severity of tinnitus. The Italian translation of the Tinnitus Handicap Inventory (THI) was administered to 100 outpatients suffering from chronic tinnitus, aged between 20 and 82 years, who attended the audiological tertiary centres of the University Hospital of Modena and the Regional Hospital of Treviso. No segregation of cases was made on audiometric results; patients suffering from vertigo and neurological diseases were excluded. Pyschoacoustic characteristics of tinnitus (loudness and pitch) were determined and all patients also completed the MOS 36-Item Short Form Health Survey to assess self-perceived quality of life and the Hospital Anxiety and Depression Scale as a measure of self-perceived levels of anxiety and depression. The THI-I showed a robust internal consistency reliability (Cronbach’s alpha = 0.91) that was only slightly lower than the original version (Tinnitus Handicap Inventory-US; Cronbach’s alpha = 0.93) and its Danish (Cronbach’s alpha = 0.93) and Portuguese (Cronbach’s alpha = 0.94) translations. Also its two subscales (Functional and Emotional) showed a good internal consistency reliability (Cronbach’s alpha = 0.85 and 0.86, respectively). On the other hand, the Catastrophic subscale showed an unacceptable internal consistency reliability as it is too short in length (5 items). A confirmatory factor analysis failed to demonstrate that the 3 subscales of the THI-I correspond to 3 different factors. Close correlations were found between the total score of the Italian translation of the Tinnitus Handicap Inventory and all the subscales of the MOS 36-Item Short Form Health Survey (SF-36) and the Hospital Anxiety and Depression Scale scores indicating a good construct validity. Moreover, these statistically significant correlations (p < 0.005) confirmed that the self-report tinnitus handicap is largely related to psychological distress and a deterioration in the quality of life. On the other hand, it was confirmed that the tinnitus perceived handicap is totally independent (p > 0.05) from its audiometrically-derived measures of loudness and pitch thus supporting previous studies that focused on the importance of non-auditory factors, namely somatic attention, psychological distress and coping strategies, in the generation of tinnitus annoyance. Finally the results of the present study suggest that the THI-I maintains its original validity and should be incorporated, together with other adequate psychometric questionnaires, in the audiological examination of patients suffering from tinnitus and that psychiatric counselling should be recommended for the suspected co-morbidity between tinnitus annoyance and psychological distress.
Tinnitus; Anxiety; Depression; Quality of life
To describe the development and psychometric testing of the Multidimensional Trust in Health Care Systems Scale (MTHCSS).
Scale development occurred in 2 phases. In phase 1, a pilot instrument with 70 items was generated from the review of the trust literature, focus groups, and expert opinion. The 70 items were pilot tested in a sample of 256 students. Exploratory factor analysis was used to derive an orthogonal set of correlated factors. In phase 2, the final scale was administered to 301 primary care patients to assess reliability and validity. Phase 2 participants also completed validated measures of patient-centered care, health locus of control, medication nonadherence, social support, and patient satisfaction.
In phase 1, a 17-item scale (MTHCSS) was developed with 10 items measuring trust in health care providers, 4 items measuring trust in health care payers, and 3 items measuring trust in health care institutions. In phase 2, the 17-item MTHCSS had a mean score of 63.0 (SD 8.8); the provider subscale had a mean of 40.0 (SD 6.2); the payers subscale had a mean of 12.8 (SD 3.0); and the institutions subscale had a mean of 10.3 (SD 2.1). Cronbach’s α for the MTHCSS was 0.89 and 0.92, 0.74, and 0.64 for the 3 subscales. The MTHCSS was significantly correlated with patient-centered care (r = .22 to .62), locus of control—chance (r = .42), medication nonadherence (r = −.22), social support (r = .25), and patient satisfaction (r = .67).
The MTHCSS is a valid and reliable instrument for measuring the 3 objects of trust in health care and is correlated with patient-level health outcomes.
Multidimensional Trust in Health Care Systems Scale; interpersonal trust; health care; psychometrics; trust; health services research
The Neck Disability Index (NDI) is the most commonly used outcome measure for neck pain. This study aimed to determine the psychometric properties of a German version of the NDI. Cross-cultural translation and psychometric testing of the NDI were performed.
The 10-item NDI was translated into German and administered to 558 patients with chronic unspecific neck pain (Mean age 49.9 ± 11.4 years, 76% female). The factor structure and reliability of the NDI were assessed using factor analysis, Cronbach’s alpha, split-half reliability (Spearman-Brown coefficient), and intra-class correlation (ICC2,1). To determine convergent validity, pain intensity (visual analog scale; VAS), pain on movement (VAS), and quality of life (Short Form 36 Health Survey Questionnaire; SF-36) were correlated with the NDI. Correlation with range of motion and sensitivity to change were also assessed in a subsample of 49 patients.
The mean NDI score was 32.75 ± 13.09. Factor analysis revealed a single factor that explained 39.8% of the variance. Cronbach’s alpha was 0.81; Spearman-Brown coefficient was 0.80; and intra-class correlation was 0.81 (95% confidence interval = 0.78, 0.83). Significant correlations were found for pain intensity (r = 0.22, p < 0.01), pain on movement (r = 0.39, p < 0.01), quality of life (r = -0.30 to -0.45, p < 0.01), and range of motion (r = -0.34, p = 0.02). Patients who reported global improvement of health after an exercise or yoga intervention showed a higher decrease on the NDI than patients who reported no global improvement (p < 0.01).
The German version of the NDI has a comparable factor structure as the original version, acceptable psychometric properties, and is sensitive to change after physical activity. Neck disability is associated with other measures of neck pain.
Neck pain; Chronic pain; Disability; Neck disability index; Translation; German; Validity; Reliability; Factor structure; Sensitivity to change
HIV is a stigmatizing medical condition. The concept of HIV stigma is multifaceted, with personalized stigma (perceived stigmatizing consequences of others knowing of their HIV status), disclosure concerns, negative self-image, and concerns with public attitudes described as core aspects of stigma for individuals with HIV infection. There is limited research on HIV stigma in children. The aim of this study was to test a short version of the 40-item HIV Stigma Scale (HSS-40), adapted for 8–18 years old children with HIV infection living in Sweden.
A Swedish version of the HSS-40 was adapted for children by an expert panel and evaluated by think aloud interviews. A preliminary short version with twelve items covering the four dimensions of stigma in the HSS-40 was tested. The psychometric evaluation included inspection of missing values, principal component analysis (PCA), internal consistency, and correlations with measures of health-related quality of life (HRQoL).
Fifty-eight children, representing 71% of all children with HIV infection in Sweden meeting the inclusion criteria, completed the 12-item questionnaire. Four items concerning participants’ experiences of others’ reactions to their HIV had unacceptable rates of missing values and were therefore excluded. The remaining items constituted an 8-item scale, the HIV Stigma Scale for Children (HSSC-8), measuring HIV-related disclosure concerns, negative self-image, and concerns with public attitudes. Evidence for internal validity was supported by a PCA, suggesting a three factor solution with all items loading on the same subscales as in the original HSS-40. The scale demonstrated acceptable internal consistency, with exception for the disclosure concerns subscale. Evidence for external validity was supported in correlational analyses with measures of HRQoL, where higher levels of stigma correlated with poorer HRQoL.
The results suggest feasibility, reliability, as well as internal and external validity of the HSSC-8, an HIV stigma scale for children with HIV infection, measuring disclosure concerns, negative self-image, and concerns with public attitudes. The present study shows that different aspects of HIV stigma can be assessed among children with HIV in the age group 8–18.
HIV; Stigma; Child; Adolescent; Psychometrics; HIV Stigma Scale for Children
The Subjective Well-Being Under Neuroleptic Treatment Scale short form (SWN-K) is a self-rating scale developed to measure mentally ill patients' well-being under the antipsychotic drug treatment. This paper reports on adaptation and psychometric properties of the instrument in an Estonian psychiatric sample.
In a naturalistic study design, 124 inpatients or outpatients suffering from the first psychotic episode or chronic psychotic illness completed the translated SWN-K instrument. Item content analysis, internal consistency analysis, exploratory principal components analysis, and confirmatory factor analysis were used to construct the Estonian version of the SWN-K (SWN-K-E). Additionally, socio-demographic and clinical data, observer-rated psychopathology, medication side effects, daily antipsychotic drug dosages, and general functioning were assessed at two time points, at baseline and after a 29-week period; the associations of the SWN-K-E scores with these variables were explored.
After having selected 20 items for the Estonian adaptation, the internal consistency of the total SWN-K-E was 0.93 and the subscale consistencies ranged from 0.70 to 0.80. Good test–retest reliabilities were observed for the adapted scale scores, with the correlation of the total score over about 6 months being r = 0.70. Confirmatory factor analysis replicated the presence of a higher-order factor (general well-being) and five first-order factors (mental functioning, physical functioning, social integration, emotional regulation, and self-control); the model fitted the data well. The results indicated a moderate-high correlations r = 0.54 between the SWN-K-E total score and the evaluation how satisfied patients were with their lives in generally. No significant correlations were found between the overall subjective well-being score and age, severity of the psychopathology, drug adverse effects, or prescribed drug dosage.
Taken together, the results demonstrated that the Estonian version of the SWN-K is a reliable and valid instrument with psychometric properties similar to the original English version. The potential uses of the scale in both research and clinical settings are considered.
SWN scale; Subjective well-being; Psychometric properties; Schizophrenia
This paper aimed to develop a short version of the 32-item Ageing Perceptions Questionnaire (APQ), a multi-dimensional measure based on Leventhal's self-regulation model. Ageing perceptions are a key area of interest for large-scale surveys of ageing populations. As these studies capture a broad range of health and social variables, included instruments need to be as concise as possible.
Data from the Irish Longitudinal Study of Ageing (TILDA), a representative sample of community-dwelling individuals aged 50+ (n = 6,718), was used to revise the scale. Items for exclusion were identified by examining conceptual content, descriptive statistics, and by detecting sources of poor model fit using confirmatory factor analysis (CFA). Potential combinations of dimensions were also tested using CFA. Finally, we identified any dimensions that could be excluded without limiting the conceptual coverage and coherence of the scale. Model modifications were done sequentially and with regard to theoretical considerations. Internal consistency and construct validity of the concise scale were compared with the longer version.
Initially, 11 items were excluded on the basis of conceptual and empirical overlap with other items. CFA indicated that the negative-control and negative-consequences dimensions could be combined, allowing us to exclude a further item from this dimension. The 5-item timeline-cyclical dimension was also excluded, as it was less well-established conceptually and empirically than the other dimensions. The final 17-item, 5-dimension model was consistent with the original conceptual model and fit the data well (chi-sq = 1433.54, df(109), p < 0.01, RMSEA = 0.04, CFI = 0.97, TLI = 0.96).
The Brief-APQ (B-APQ) is a concise, multi-dimensional measure of ageing perceptions, which is psychometrically valid for use with the Irish population aged 50+. The concise version preserved the internal consistency and construct validity of the original. Its brevity makes it particularly suitable for use with large-scale adult population surveys. The psychometric analysis supports the application of the self-regulation model to ageing perceptions, but also the existence of distinct "physical decline" and "ongoing development" dimensions of perceptions.
Ageing perceptions; Self-perceptions; Self-regulation; Confirmatory factor analysis; Item reduction