The operational definition of relational continuity is “a therapeutic relationship between a patient and one or more providers that spans various healthcare events and results in accumulated knowledge of the patient and care consistent with the patient's needs.”
To examine how well relational continuity is measured in validated instruments that evaluate primary healthcare from the patient's perspective.
645 adults with at least one healthcare contact in the previous 12 months responded to six instruments that evaluate primary healthcare. Five subscales map to relational continuity: the Primary Care Assessment Survey (PCAS, two subscales), the Primary Care Assessment Tool – Short Form (PCAT-S) and the Components of Primary Care Index (CPCI, two subscales). Scores were normalized for descriptive comparison. Exploratory and confirmatory (structural equation modelling) factor analysis examined fit to operational definition, and item response theory analysis examined item performance on common constructs.
All subscales load reasonably well on a single factor, presumed to be relational continuity, but the best model has two underlying factors corresponding to (1) accumulated knowledge of the patient and (2) relationship that spans healthcare events. Some items were problematic even in the best model. The PCAS Contextual Knowledge subscale discriminates best between different levels of accumulated knowledge, but this dimension is also captured well by the CPCI Accumulated Knowledge subscale and most items in the PCAT-S Ongoing Care subscale. For relationship-spanning events, the items' content captures concentration of care in one doctor; this is captured best by the CPCI Preference for Regular Provider subscale and, to a lesser extent, by the PCAS Visit-Based Continuity subscale and one relevant item in the PCAT-S Ongoing Care subscale. But this dimension correlates only modestly with percentage of reported visits to the personal doctor. The items function as yes/no rather than ordinal options, and are especially informative for poor concentration of care.
These subscales perform well for key elements of relational continuity, but do not capture consistency of care. They are more informative for poor relational continuity.
The operational definition of interpersonal communication is “the ability of the provider to elicit and understand patient concerns, to explain healthcare issues and to engage in shared decision-making if desired.”
To examine how well interpersonal communication is captured in validated instruments that evaluate primary healthcare from the patient's perspective.
645 adults with at least one healthcare contact in the previous 12 months responded to instruments that evaluate primary healthcare. Eight subscales measure interpersonal communication: the Primary Care Assessment Survey (PCAS, two subscales); the Components of Primary Care Index (CPCI, one subscale); the first version of the EUROPEP (EUROPEP-I); and the Interpersonal Processes of Care Survey, version II (IPC-II, four subscales). Scores were normalized for descriptive comparison. Exploratory and confirmatory (structural equation) factor analysis examined fit to operational definition, and item response theory analysis examined item performance.
Items not pertaining to interpersonal communication were removed from the EUROPEP-I. Most subscales are skewed positively. Normalized mean scores are similar across subscales except for IPC-II Patient-Centred Decision-Making and IPC-II Hurried Communication. All subscales load reasonably well on a single factor, presumed to be interpersonal communication. The best model has three underlying factors corresponding to eliciting (eigenvalue = 26.56), explaining (eigenvalue = 2.45) and decision-making (eigenvalue = 1.34). Both the PCAS Communication and the EUROPEP-I Clinical Behaviour subscales capture all three dimensions. Individual subscales within IPC-II measure each sub-dimension.
The operational definition is well reflected in the available measures, although shared decision-making is poorly represented. These subscales can be used with confidence in the Canadian context to measure this crucial aspect of patient-centred care.
Coping strategies are among the psychosocial factors hypothesized to contribute to the development of chronic musculoskeletal disability. The Chronic Pain Coping Inventory (CPCI) was developed to assess eight behavioral coping strategies targeted in multidisciplinary pain treatment (Guarding, Resting, Asking for Assistance, Task Persistence, Relaxation, Exercise/Stretch, Coping Self-Statements and Seeking Social Support). The present study had two objectives. First, it aimed at measuring the internal consistency and the construct validity of the French version of the CPCI. Second, it aimed to verify if, as suggested by the CPCI authors, the scales of this instrument can be grouped according to the following coping families: Illness-focused coping and Wellness-focused coping.
The CPCI was translated into French with the forward and backward translation procedure. To evaluate internal consistency, Cronbach's alphas were computed. Construct validity of the inventory was estimated through confirmatory factor analysis (CFA) in two samples: a group of 439 Quebecois workers on sick leave in the sub-acute stage of low back pain (less than 84 days after the work accident) and a group of 388 French chronic pain patients seen in a pain clinic. A CFA was also performed to evaluate if the CPCI scales were grouped into two coping families (i.e. Wellness-focused and Illness-focused coping).
The French version of the CPCI had adequate internal consistency in both samples. The CFA confirmed the eight-scale structure of the CPCI. A series of second-order CFA confirmed the composition of the Illness-focused family of coping (Guarding, Resting and Asking for Assistance). However, the composition of the Wellness-focused family of coping (Relaxation, Exercise/Stretch, Coping Self-Statements and Seeking Social Support) was different than the one proposed by the authors of the CPCI. Also, a positive correlation was observed between Illness and Wellness coping families.
The present study indicates that the internal consistency and construct validity of the French version of the CPCI were adequate, but the grouping and labeling of the CPCI families of coping are debatable and deserve further analysis in the context of musculoskeletal and pain rehabilitation.
Management continuity, operationally defined as “the extent to which services delivered by different providers are timely and complementary such that care is experienced as connected and coherent,” is a core attribute of primary healthcare. Continuity, as experienced by the patient, is the result of good care coordination or integration.
To provide insight into how well management continuity is measured in validated coordination or integration subscales of primary healthcare instruments.
Relevant subscales from the Primary Care Assessment Survey (PCAS), the Primary Care Assessment Tool – Short Form (PCAT-S), the Components of Primary Care Instrument (CPCI) and the Veterans Affairs National Outpatient Customer Satisfaction Survey (VANOCSS) were administered to 432 adult respondents who had at least one healthcare contact with a provider other than their family physician in the previous 12 months. Subscales were examined descriptively, by correlation and factor analysis and item response theory analysis. Because the VANOCSS elicits coordination problems and is scored dichotomously, we used logistic regression to examine how evaluative subscales relate to reported problems.
Most responses to the PCAS, PCAT-S and CPCI subscales were positive, yet 83% of respondents reported having one or more problems on the VANOCSS Overall Coordination subscale and 41% on the VANOCSS Specialist Access subscale. Exploratory factor analysis suggests two distinct factors. The first (eigenvalue=6.98) is coordination actions by the primary care physician in transitioning patient care to other providers (PCAS Integration subscale and most of the PCAT-S Coordination subscale). The second (eigenvalue=1.20) is efforts by the primary care physician to create coherence between different visits both within and outside the regular doctor's office (CPCI Coordination subscale). The PCAS Integration subscale was most strongly associated with lower likelihood of problems reported on the VANOCSS subscales.
Ratings of management continuity correspond only modestly to reporting of coordination problems, possibly because they rate only the primary care physician, whereas patients experience problems across the entire system. The subscales were developed as measures of integration and provider coordination and do not capture the patient's experience of connectedness and coherence.
Patient evaluations are an important part of monitoring primary healthcare reforms, but there is little comparative information available to guide evaluators in the choice of instruments or to determine their relevance for Canada.
To compare values and the psychometric performances of validated instruments thought to be most pertinent to the Canadian context for evaluating core attributes of primary healthcare.
Among validated instruments in the public domain, we selected six: the Primary Care Assessment Survey (PCAS); the Primary Care Assessment Tool – Short Form (PCAT-S); the Components of Primary Care Index (CPCI); the first version of the EUROPEP (EUROPEP-I); the Interpersonal Processes of Care Survey, version II (IPC-II); and part of the Veterans Affairs National Outpatient Customer Satisfaction Survey (VANOCSS). We mapped subscales to operational definitions of attributes. All were administered to a sample of adult service users balanced by English/French language (in Nova Scotia and Quebec, respectively), urban/rural residency, high/low education and overall care experience. The sample was recruited from previous survey respondents, newspaper advertisements and community posters. We used common factor analysis to compare our factor resolution for each instrument to that of the developers.
Our sample of 645 respondents was approximately balanced by design variables, but considerable effort was required to recruit low-education and poor-experience respondents. Subscale scores are statistically different by excellent, average and poor overall experience, but interpersonal communication and respectfulness scores were the most discriminating of overall experience. We found fewer factors than did the developers, but when constrained to the number of expected factors, our item loadings were largely similar to those found by developers. Subscale reliability was equivalent to or higher than that reported by developers.
These instruments perform similarly in the Canadian context to their original development context, and can be used with confidence. Interpersonal and respectfulness scores are most discriminating of excellent, average or poor overall experience and are crucial dimensions of patient evaluations.
Patient safety can be increased by improving the organization of care. A tool that evaluates the actual organization of care, as perceived by multidisciplinary teams, is the Care Process Self-Evaluation Tool (CPSET). CPSET was developed in 2007 and includes 29 items in five subscales: (a) patient-focused organization, (b) coordination of the care process, (c) collaboration with primary care, (d) communication with patients and family, and (e) follow-up of the care process. The goal of the present study was to further evaluate the psychometric properties of the CPSET at the team and hospital levels and to compile a cutoff score table.
The psychometric properties of the CPSET were assessed in a multicenter study in Belgium and the Netherlands. In total, 3139 team members from 114 hospitals participated. Psychometric properties were evaluated by using confirmatory factor analysis (CFA), Cronbach’s alpha, interclass correlation coefficients (ICCs), Kruskall-Wallis test, and Mann–Whitney test. For the cutoff score table, percentiles were used. Demographic variables were also evaluated.
CFA showed a good model fit: a normed fit index of 0.93, a comparative fit index of 0.94, an adjusted goodness-of-fit index of 0.87, and a root mean square error of approximation of 0.06. Cronbach’s alpha values were between 0.869 and 0.950. The team-level ICCs varied between 0.127 and 0.232 and were higher than those at the hospital level (0.071-0.151). Male team members scored significantly higher than females on 2 of the 5 subscales and on the overall CPSET. There were also significant differences among age groups. Medical doctors scored significantly higher on 4 of the 5 subscales and on the overall CPSET. Coordinators of care processes scored significantly lower on 2 of the 5 subscales and on the overall CPSET. Cutoff scores for all subscales and the overall CPSET were calculated.
The CPSET is a valid and reliable instrument for health care teams to measure the extent care processes are organized. The cutoff table permits teams to compare how they perceive the organization of their care process relative to other teams.
Psychometric properties; Care process; Organization of care; Validity; Reliability; Health care teams; CPSET; Multidisciplinary teams; Multicenter study
The extent to which partnership synergy is created within quality improvement programmes in the Netherlands is unknown. In this article, we describe the psychometric testing of the Partnership Self-Assessment Tool (PSAT) among professionals in twenty-two disease-management partnerships participating in quality improvement projects focused on chronic care in the Netherlands. Our objectives are to validate the PSAT in the Netherlands and to reduce the number of items of the original PSAT while maintaining validity and reliability.
The Dutch version of the PSAT was tested in twenty-two disease-management partnerships with 218 professionals. We tested the instrument by means of structural equation modelling, and examined its validity and reliability.
After eliminating 14 items, the confirmatory factor analyses revealed good indices of fit with the resulting 15-item PSAT-Short version (PSAT-S). Internal consistency as represented by Cronbach's alpha ranged from acceptable (0.75) for the 'efficiency' subscale to excellent for the 'leadership' subscale (0.87). Convergent validity was provided with high correlations of the partnership dimensions and partnership synergy (ranged from 0.512 to 0.609) and high correlations with chronic illness care (ranged from 0.447 to 0.329).
The psychometric properties and convergent validity of the PSAT-S were satisfactory rendering it a valid and reliable instrument for assessing partnership synergy and its dimensions of partnership functioning.
chronic care; measurement; quality; chronic illness; health care; partnership synergy; isease management
To test the psychometric properties of the Participation Scale (P-scale) among people with various disabling conditions in Eastern Nepal.
A sample of 153 individuals with disabling conditions was selected through systematic random sampling. The following psychometric properties were tested: structural validity (explanatory and confirmatory factor analyses), internal consistency, inter-tester reliability, construct validity and floor and ceiling effects.
The explanatory factor analysis indicated a two-factor structure (‘work-related participation’ and ‘general participation’). The confirmatory factor analysis suggested good model fit. The internal consistency measured with Cronbach’s alpha was 0.93 for the whole scale and 0.78 and 0.93 for the subscales. The inter-tester reliability coefficient was 0.90. All hypothesized correlations were as expected confirming the construct validity of the scale. No floor or ceiling effects were identified for the whole scale; only the subscale ‘work-related participation’ showed a ceiling effect.
The results of the analyses suggest that the psychometric properties of the P-scale are sufficient in the context of Eastern Nepal. Use of the P-scale will require (re-) confirmation of its validity in each new cultural context.
Disability; Instrument; Participation; Psychometric properties; Reliability; Validity
Respectfulness is one measurable and core element of healthcare responsiveness. The operational definition of respectfulness is “the extent to which health professionals and support staff meet users' expectations about interpersonal treatment, demonstrate respect for the dignity of patients and provide adequate privacy.”
To examine how well respectfulness is captured in validated instruments that evaluate primary healthcare from the patient's perspective, whether or not their developers had envisaged these as representing respectfulness.
645 adults with at least one healthcare contact with their own regular doctor or clinic in the previous 12 months responded to six instruments, two subscales that mapped to respectfulness: the Interpersonal Processes of Care, version II (IPC-II, two subscales) and the Primary Care Assessment Survey (PCAS). Additionally, there were individual respectfulness items in subscales measuring other attributes in the Components of Primary Care Index (CPCI) and the first version of the EUROPEP (EUROPEP-I). Scores were normalized for descriptive comparison. Exploratory and confirmatory (structural equation modelling) factor analyses examined fit to operational definition.
Respectfulness scales correlate highly with one another and with interpersonal communication. All items load adequately on a single factor, presumed to be respectfulness, but the best model has three underlying factors corresponding to (1) physician's interpersonal treatment (eigenvalue=13.99), (2) interpersonal treatment by office staff (eigenvalue=2.13) and (3) respect for the dignity of the person (eigenvalue=1.16). Most items capture physician's interpersonal treatment (IPC-II Compassionate, Respectful Interpersonal Style, IPC-II Hurried Communication and PCAS Interpersonal Treatment). The IPC-II Interpersonal Style (Disrespectful Office Staff) captures treatment by staff, but only three items capture dignity.
Various items or subscales seem to measure respectfulness among currently available validated instruments. However, many of these items related to other constructs, such as interpersonal communication. Further studies should aim at developing more refined measures – especially for privacy and dignity – and assess the relevance of the broader concept of responsiveness.
Work engagement is a positive work-related state of fulfillment characterized by vigor, dedication, and absorption. Previous studies have operationalized the construct through development of the Utrecht Work Engagement Scale. Apart from the original three-factor 17-item version of the instrument (UWES-17), there exists a nine-item shortened revised version (UWES-9).
The current study explored the psychometric properties of the Chinese version of the Utrecht Work Engagement Scale in terms of factorial validity, scale reliability, descriptive statistics, and construct validity.
A cross-sectional questionnaire survey was conducted in 2009 among 992 workers from over 30 elderly service units in Hong Kong.
Confirmatory factor analyses revealed a better fit for the three-factor model of the UWES-9 than the UWES-17 and the one-factor model of the UWES-9. The three factors showed acceptable internal consistency and strong correlations with factors in the original versions. Engagement was negatively associated with perceived stress and burnout while positively with age and holistic care climate.
The UWES-9 demonstrates adequate psychometric properties, supporting its use in future research in the Chinese context.
Work engagement; Validity; Reliability; Chinese
There is a lack of German-language, disease-specific health related quality of life instruments applicable in cardiac rehabilitation. The purpose of this project was to investigate the psychometric properties of the German version of the MacNew Heart Disease Health-related Quality of Life Questionnaire (MacNew) in patients undergoing cardiac rehabilitation.
The MacNew was filled out by 5692 inpatients. We analysed acceptance (number of missing values), ceiling and floor effects, reliability (Cronbach’s α), factor structure (confirmatory factor analysis), construct validity (correlation with a generic health-related quality of life instrument), and sensitivity to change.
Two items had more than 7% missing data. We observed neither floor nor ceiling effects. Cronbach’s α of the scales ranged from 0.78 (physical scale) to 0.95 (global scale). Confirmatory factor analysis failed to reproduce the proposed factor structure (CFI = 0.882; TLI = 0.871; RMSEA = 0.074). We therefore drafted our own model (CFI = 0.932; TLI = 0.921; RMSEA = 0.064), and observed a correlation pattern largely conforming to the hypotheses with a generic health-related quality of life instrument. The effect sizes we noted between the start and end of rehabilitation fell between 0.66 and 0.74; at the 6-month follow-up they ranged from 0.69 to 0.92.
The German version of the MacNew Heart Disease Health-related Quality of Life Questionnaire is a suitable instrument with which to measure the impairment experienced by individuals with heart disease during inpatient cardiologic rehabilitation. The social and the global scale must be interpreted cautiously.
In this paper the psychometric properties of the multidimensional fatigue inventory (MFI-20) are established further in cancer patients. The MFI is a 20-item self-report instrument designed to measure fatigue. It covers the following dimensions: general fatigue, physical fatigue, reduced activity, reduced motivation and mental fatigue. The instrument was used in a Dutch and Scottish sample of cancer patients receiving radiotherapy. The dimensional structure was assessed using confirmatory factor analyses (Lisrel's unweighted least-squares method). The hypothesised five-factor model appeared to fit the data in both samples (adjusted goodness of fit; AGFI: 0.97 and 0.98). Internal consistency of the separate scales was good in both the Dutch and Scottish samples with Cronbach's alpha coefficients ranging from 0.79 to 0.93. Construct validity was assessed by correlating the MFI-20 to activities of daily living, anxiety and depression. Significant relations were assumed. Convergent validity was investigated by correlating the MFI scales with a visual analogue scale measuring fatigue and with a fatigue-scale derived from the Rotterdam Symptom Checklist. Results support the validity of the MFI-20. The highly similar results in the Dutch and Scottish sample suggest that the portrayal of fatigue using the MFI-20 is quite robust.
The patient assessment of chronic illness care (PACIC) is a promising instrument to evaluate the chronic care experiences of patients, yet additional validation is needed to improve its usefulness.
A total of 1941 patients with diabetes completed the questionnaire. Reliability coefficients and factor analyses were used to psychometrically test the PACIC and PACIC+ (i.e. PACIC extended with six additional multidisciplinary team functioning items to improve content validity). Intra-class correlations were computed to identify the extent to which variation in scores can be attributed to GP practices.
The PACIC and PACIC+ showed a good psychometric quality (Cronbach’s alpha’s >0.9). Explorative factor analyses showed inconclusive results. Confirmative factor analysis showed that none of the factor structures had an acceptable fit (RMSEA>0.10). In addition, 5.1 to 5.4% of the total variation was identified at the GP practice level.
The PACIC and PACIC+ are reliable instruments to measure the chronic care management experiences of patients. The PACIC+ is preferred because it also includes multidisciplinary coordination and cooperation—one of the central pillars of chronic care management—with good psychometric quality. Previously identified subscales should be used with caution. Both PACIC instruments are useful in identifying GP practice variation.
chronic care model; patient experience; chronic care management; integrated care; diabetes; PACIC
To test the psychometric properties of the short form of the Chinese version Diabetes Quality of Life for Youth scale (C-DQOLY-SF).
RESEARCH DESIGN AND METHODS
A 30-item C-DQOLY-SF was administered to 371 adolescents with type 1 diabetes. Exploratory and confirmatory factor analysis, correlation with HbA1c, internal consistency, and test-retest reliability were used to examine the psychometric characteristics of C-DQOLY-SF.
A 25-item questionnaire with three correlated second-order factor structures best fitted data. Scores on the 25-item C-DQOLY-SF significantly correlated with HbA1c values. Cronbach’s α and ICCs of each scale and subscale ranged from 0.77 to 0.90 and from 0.70 to 0.92, respectively.
The C-DQOLY-SF has satisfactory reliability and validity. The C-DQOLY-SF can be conveniently used in clinical settings to assess the quality of life of adolescents with type 1 diabetes.
To determine the psychometric properties of the Hospital Anxiety and Depression Scale (HADS) in patients with breast cancer and determine the suitability of the instrument for use with this clinical group.
A cross-sectional design was used. The study used a pooled data set from three breast cancer clinical groups. The dependent variables were HADS anxiety and depression sub-scale scores. Exploratory and confirmatory factor analyses were conducted on the HADS to determine its psychometric properties in 110 patients with breast cancer. Seven models were tested to determine model fit to the data.
Both factor analysis methods indicated that three-factor models provided a better fit to the data compared to two-factor (anxiety and depression) models for breast cancer patients. Clark and Watson's three factor tripartite and three factor hierarchical models provided the best fit.
The underlying factor structure of the HADS in breast cancer patients comprises three distinct, but correlated factors, negative affectivity, autonomic anxiety and anhedonic depression. The clinical utility of the HADS in screening for anxiety and depression in breast cancer patients may be enhanced by using a modified scoring procedure based on a three-factor model of psychological distress. This proposed alternate scoring method involving regressing autonomic anxiety and anhedonic depression factors onto the third factor (negative affectivity) requires further investigation in order to establish its efficacy.
The present study examined the psychometric properties of the Persian version of the Revised Cheek and Buss Shyness Scale (RCBS) using confirmatory factor analysis among (n = 300) college students.
A total of 300 undergraduate students participated in this study And completed the Revised Cheek and Buss Shyness Scale (RCBS). A confirmatory factor analysis was performed to test diagnosis as a unitary construct and to test an earlier-reported two-factor model.
Results indicated that unidimensional measurement model of the RCBS did not provide the best fit for the data. Then three measurement models were tested, and the results showed that a two-factor model taking into account differences in the direction of item wording provided a satisfactory and parsimonious fit to the data. Multi-group confirmatory factor analysis was used to better understand the factorial invariance of the scale across genders, and indicated that two-factor structure of the RCBS was equivalent across genders. Supplementary t-tests revealed no other gender differences on shyness.
The results provide initial support for the construct validity of the self- report version of the RCBS in college students.
Factor analysis; PsychologicalTests; Psychometrics; Shyness; Students
The present study investigated the psychometric properties of a Malaysian adapted Brunel Mood Scale.
The questionnaire was administered to 355 young sport athletes with a mean age of 14.69+1.70 years. Confirmatory factor analysis (CFA) and Cronbach's alpha were used to determine the factorial validity and the internal consistency of the questionnaire respectively.
CFA results revealed adequate model fit, best represented by a 6-factor model with one of the items removed (item 24). Internal consistency of the questionnaire was marginally supported through alpha reliability method. Alpha coefficients of 0.72, 0.64, 0.73, 0.69, 0.65, and 0.58 were obtained for tension, depression, anger, vigour, fatigue and confusion subscales respectively. Closer inspection of items for confusion revealed a ‘problematic’ item (item 24/uncertain). Removing this item increased the alpha coefficient to 0.67 for this subscale.
It was concluded that this questionnaire may be used to measure differentiated negative and positive mood states among Malaysian adolescent athletes. However, further analyses involving independent samples are needed to confirm the present findings.
Brunel Mood Scale; Mood; Validity; Adolescent; Athletes
Comprehensiveness relates both to scope of services offered and to a whole-person clinical approach. Comprehensive services are defined as “the provision, either directly or indirectly, of a full range of services to meet most patients' healthcare needs”; whole-person care is “the extent to which a provider elicits and considers the physical, emotional and social aspects of a patient's health and considers the community context in their care.” Among instruments that evaluate primary healthcare, two had subscales that mapped to comprehensive services and to the community component of whole-person care: the Primary Care Assessment Tool – Short Form (PCAT-S) and the Components of Primary Care Index (CPCI, a limited measure of whole-person care).
To examine how well comprehensiveness is captured in validated instruments that evaluate primary healthcare from the patient's perspective.
645 adults with at least one healthcare contact in the previous 12 months responded to six instruments that evaluate primary healthcare. Scores were normalized for descriptive comparison. Exploratory and confirmatory (structural equation modelling) factor analysis examined fit to operational definition, and item response theory analysis examined item performance on common constructs.
Over one-quarter of respondents had missing responses on services offered or doctor's knowledge of the community. The subscales did not load on a single factor; comprehensive services and community orientation were examined separately. The community orientation subscales did not perform satisfactorily. The three comprehensive services subscales fit very modestly onto two factors: (1) most healthcare needs (from one provider) (CPCI Comprehensive Care, PCAT-S First-Contact Utilization) and (2) range of services (PCAT-S Comprehensive Services Available). Individual item performance revealed several problems.
Measurement of comprehensiveness is problematic, making this attribute a priority for measure development. Range of services offered is best obtained from providers. Whole-person care is not addressed as a separate construct, but some dimensions are covered by attributes such as interpersonal communication and relational continuity.
The Functional Assessment of Cancer Therapy (FACT) is one of the most commonly used self-report instruments for evaluation of health-related quality of life in oncology patients. However, cultural considerations necessitate testing of the subscales in different populations. We sought to qualitatively and quantitatively investigate the applicability and psychometric properties of the Chinese version of the FACT-Cervix (FACT-Cx) in Chinese women with cervical cancer.
Ten personal interviews were conducted in order to explore patients’ opinions about the scale and its items in depth. In addition the questionnaire was administered to 400 women with cervical cancer to test its psychometric properties. Reliability was assessed using Cronbach’s alpha coefficient and item-subscale correlation while validity was evaluated using factor analysis and known-group validity.
Some items related to sex and the ability to give birth were questioned in the personal interviews, mostly regarding their significance and acceptance in the Chinese cultural context. The Cronbach’s alphas of FACT-Cx and the subscales were greater than 0.7, except for the cervical-cancer-specific subscale which was 0.57. Factor analysis demonstrated that the FACT-G construct generally paralleled the original. There were significant differences in the FACT-Cx and some subscales between those receiving and not receiving treatment and among the patients with different performance status.
In general, psychometric properties of the Chinese version supported its use with cervical cancer patients in Mainland China. Further work is needed to improve the psychometric adequacy of the cervical-cancer-specific subscale and adjust it to cultural considerations.
Health-related quality of life; FACT-Cx; FACT-G; Chinese version; Psychometric properties; Cervical cancer
The Edinburgh Postnatal Depression Scale (EPDS) has been proposed as a one-dimensional instrument and used as a single 10-item scale. This might be considered questionable since repeated psychometric studies have shown multi-dimensionality, which would entail using separate component subscales. This study reappraised the dimensional structure of the EPDS, with a focus on the extent of factor correlations and related factor-based discriminant validity as a foundation for deciding how to effectively scale the component items.
The sample comprised 811 randomly selected mothers of children up to 5 months attending primary health services of Rio de Janeiro, Brazil. Strict Confirmatory Factor Analysis (CFA) and Exploratory Factor Analysis modeled within a CFA framework (E/CFA) were sequentially used to identify best fitting and parsimonious model(s), including a bifactor analysis to evaluate the existence of a general factor. Properties concerning the related 10-item raw-score scale were also investigated using non-parametric items response theory methods (scalability and monotonicity).
An initial CFA rejected the one-dimensional structure, while an E/CFA subscribed a three-dimensional solution. Yet, factors were highly correlated (0.66, 0.75 and 0.82). The ensuing CFA showed poor discriminant validity (some square-roots of average variance extracted below the factor correlations). A general bifactor CFA was then fit. Results suggested that, although still weakly encompassing three specific factors, the EPDS might be better described by a model encompassing a general factor (loadings ranging from 0.51 to 0.81). The related 10-item raw score showed adequate scalability (Loevinger's H coefficient = 0.4208), monotonicity e partial double monotonicity (nonintersections of Item Step Response Functions).
Although the EPDS indicated the presence of specific factors, they do not qualify as independent dimensions if used separately and should therefore not be used empirically as sub-scales (raw scores). An all-encompassing scale seems better suited and continuing its use in clinical practice and applied research should be encouraged.
Evaluating the extent to which groups or subgroups of individuals differ with respect to primary healthcare experience depends on first ruling out the possibility of bias.
To determine whether item or subscale performance differs systematically between French/English, high/low education subgroups and urban/rural residency.
A sample of 645 adult users balanced by French/English language (in Quebec and Nova Scotia, respectively), high/low education and urban/rural residency responded to six validated instruments: the Primary Care Assessment Survey (PCAS); the Primary Care Assessment Tool – Short Form (PCAT-S); the Components of Primary Care Index (CPCI); the first version of the EUROPEP (EUROPEP-I); the Interpersonal Processes of Care Survey, version II (IPC-II); and part of the Veterans Affairs National Outpatient Customer Satisfaction Survey (VANOCSS). We normalized subscale scores to a 0-to-10 scale and tested for between-group differences using ANOVA tests. We used a parametric item response model to test for differences between subgroups in item discriminability and item difficulty. We re-examined group differences after removing items with differential item functioning.
Experience of care was assessed more positively in the English-speaking (Nova Scotia) than in the French-speaking (Quebec) respondents. We found differential English/French item functioning in 48% of the 153 items: discriminability in 20% and differential difficulty in 28%. English items were more discriminating generally than the French. Removing problematic items did not change the differences in French/English assessments. Differential item functioning by high/low education status affected 27% of items, with items being generally more discriminating in high-education groups. Between-group comparisons were unchanged. In contrast, only 9% of items showed differential item functioning by geography, affecting principally the accessibility attribute. Removing problematic items reversed a previously non-significant finding, revealing poorer first-contact access in rural than in urban areas.
Differential item functioning does not bias or invalidate French/English comparisons on subscales, but additional development is required to make French and English items equivalent. These instruments are relatively robust by educational status and geography, but results suggest potential differences in the underlying construct in low-education and rural respondents.
This study aimed to test the preliminary psychometric properties of the Scale of Body Connection (SBC), a 20-item self-report measure, designed to assess body awareness and bodily dissociation in mind–body intervention research.
The SBC items were based on common expressions of awareness in body therapy. Content validity was established by a panel of experts. The validity and reliability of the scale was examined with an undergraduate sample. To assess the scale’s discriminant validity, the respondents were asked to indicate exposure to specific traumas.
Confirmatory factor analysis, used to examine the scale’s construct validity, indicated acceptable goodness-of-fit indices, and revealed uncorrelated subscales, reflecting independent dimensions. Cronbach’s alpha revealed equal internal consistency reliability for each subscale for both men and women. Body awareness scores did not differ between individuals with and without reported trauma exposure. Bodily dissociation scores differed between individuals with and without past experience with physical trauma, suggesting the applicability of this subscale for use with populations with trauma histories.
The results provide preliminary evidence of the construct validity and internal consistency reliability of the SBC.
Lifestyle choices and individuals’ behaviors have the potential to influence health and improve the quality of life.
The purpose of this study was to develop and psychometrically test an instrument for measuring healthy lifestyle in Iranian adolescents.
Materials and Methods:
A comprehensive literature review related to health-promoting lifestyles was used to identify potential scale items. Data were collected from 797 school students. Construct validity was analyzed using exploratory factor analysis. Confirmatory factor analysis (CFA) was used to cross-validate.
Nine factors emerged that explained 59.8% of the variance in the 43 items. Cronbach's α coefficient Healthy Lifestyle Questionnaire was r=0.82. After the model was modified, the fit indices indicated that the data were an adequate-to-good fit to the proposed models.
The current study provides some support to the internal and external validity of the healthy lifestyles questionnaire for Iranian adolescents.
Healthy lifestyle; Iranian adolescents; reliability; validity
The 10-item Connor-Davidson Resilience Scale (10-item CD-RISC) is an instrument for measuring resilience that has shown good psychometric properties in its original version in English. The aim of this study was to evaluate the validity and reliability of the Spanish version of the 10-item CD-RISC in young adults and to verify whether it is structured in a single dimension as in the original English version.
Cross-sectional observational study including 681 university students ranging in age from 18 to 30 years. The number of latent factors in the 10 items of the scale was analyzed by exploratory factor analysis. Confirmatory factor analysis was used to verify whether a single factor underlies the 10 items of the scale as in the original version in English. The convergent validity was analyzed by testing whether the mean of the scores of the mental component of SF-12 (MCS) and the quality of sleep as measured with the Pittsburgh Sleep Index (PSQI) were higher in subjects with better levels of resilience. The internal consistency of the 10-item CD-RISC was estimated using the Cronbach α test and test-retest reliability was estimated with the intraclass correlation coefficient.
The Cronbach α coefficient was 0.85 and the test-retest intraclass correlation coefficient was 0.71. The mean MCS score and the level of quality of sleep in both men and women were significantly worse in subjects with lower resilience scores.
The Spanish version of the 10-item CD-RISC showed good psychometric properties in young adults and thus can be used as a reliable and valid instrument for measuring resilience. Our study confirmed that a single factor underlies the resilience construct, as was the case of the original scale in English.
Resilience; 10-item CD-RISC; Young adults; Reliability; Validity; Questionnaire
Although some studies have used the Team Climate Inventory within teams working in health care settings, none of these included quality improvement teams. The aim of our study is to investigate the psychometric properties of the 14-item version of the Team Climate Inventory in healthcare quality improvement teams participating in a Dutch quality collaborative.
This study included quality improvement teams participating in the Care for Better improvement program for home care, care for the handicapped and the elderly in the Netherlands between 2006 and 2008. As part of a larger evaluation study 270 written questionnaires from team members were collected at baseline and 139 questionnaires at end measurement. Confirmatory factor analyses, reliability, Pearson correlations and paired samples t-tests were conducted to investigate construct validity, reliability, predictive validity and temporal stability.
Confirmatory factor analyses revealed the expected four-factor structure and good fit indices. For the four subscales – vision, participative safety, task orientation and support for innovation – acceptable Cronbach's alpha coefficients and high inter-item correlations were found. The four subscales all proved significant predictors of perceived team effectiveness, with participatory safety being the best predictor. As expected the four subscales were found to be stable over time; i.e. without significant changes between baseline and end measurement.
The psychometric properties of the Dutch version of the TCI-14 are satisfactory. Together these results show that the TCI-14 is a useful instrument to assess to what extent aspects of team climate influence perceived team effectiveness of quality improvement teams.