PMCCPMCCPMCC

Search tips
Search criteria 

Advanced

 
Logo of aidsrestherBioMed CentralBiomed Central Web Sitesearchsubmit a manuscriptregisterthis articleAIDS Research and Therapy
 
AIDS Res Ther. 2017; 14: 21.
Published online 2017 April 11. doi:  10.1186/s12981-017-0146-y
PMCID: PMC5387298

Validity assessment of the PROMIS fatigue domain among people living with HIV

L. E. Gibbons,corresponding author1,10 R. Fredericksen,1 D. S. Batey,2 L. Dant,3 T. C. Edwards,4 K. H. Mayer,3,5 W. C. Mathews,6 L. S. Morales,7 M. J. Mugavero,8 F. M. Yang,9 E. Paez,6 M. M. Kitahata,1 D. L. Patrick,4 H. M. Crane,1 P. K. Crane,1 and for the Centers for AIDS Research Network of Integrated Clinical Systems (CNICS)

Abstract

Purpose

To evaluate psychometric characteristics and cross-sectional and longitudinal validity of the 7-item PROMIS® Fatigue Short Form and additional fatigue items among people living with HIV (PLWH) in a nationally distributed network of clinics collecting patient reported data at the time of routine clinical care.

Methods

Cross-sectional and longitudinal fatigue data were collected from September 2012 through April 2013 across clinics participating in the Centers for AIDS Research Network of Integrated Clinical Systems (CNICS). We analyzed data regarding psychometric characteristics including simulated computerized adaptive testing and differential item functioning, and regarding associations with clinical characteristics.

Results

We analyzed data from 1597 PLWH. Fatigue was common in this cohort. Scores from the PROMIS® Fatigue Short Form and from the item bank had acceptable psychometric characteristics and strong evidence for validity, but neither performed better than shorter instruments already integrated in CNICS.

Conclusions

The PROMIS® Fatigue Item Bank is a valid approach to measuring fatigue in clinical care settings among PLWH, but in our analyses did not perform better than instruments associated with less respondent burden.

Electronic supplementary material

The online version of this article (doi:10.1186/s12981-017-0146-y) contains supplementary material, which is available to authorized users.

Keywords: Fatigue, HIV, PROMIS, Validity, Psychometrics, Measurement, Patient burden

Background

Fatigue is a common clinical symptom and adversely impacts health-related quality of life. Fatigue is highly prevalent among persons living with HIV (PLWH) [1, 2]. It is a common side-effect of antiretroviral medications [3], and it is associated with several adverse clinical outcomes, including longer time until depression remission [4], poorer physical functioning [5, 6], poorer adherence to antiretroviral medications [7], and virologic failure [8]. Patients rank fatigue as an important domain for providers to know about in order to provide good care [9].

In many cases fatigue is not systematically assessed as part of clinical care. Challenges that impede fatigue assessment for research in PLWH have been outlined previously, including lack of consistent measurement, lack of longitudinal measurement, and lack of comprehensive clinical data to examine potential predictors of fatigue [10]. Measuring fatigue for clinical care further compounds these issues as there are substantial time constraints and logistical hurdles that must be addressed to minimize impact of assessment on clinical flow.

One option for assessing fatigue among PLWH is the HIV-Related Fatigue Scale [1012]. This is a well-designed measure with 56 items including subscales addressing concepts such as intensity and impact. Unfortunately, it is too long to be useful in most routine clinical care settings. At the opposite end of the spectrum are very brief assessments such as the single item included in the HIV symptoms index [13].

The Patient Reported Outcomes Measurement and Information System (PROMIS®, http://www.nihpromis.org) is a National Institutes of Health Roadmap initiative to develop item banks to measure patient-reported symptoms. PROMIS investigators developed a fatigue item bank [14]. Items from the bank can be used as either a fixed-length short-form or as a computerized adaptive test (CAT) [15]. The PROMIS® Fatigue Item Bank was developed for people in general rather than specific patient groups such as PLWH, which facilitates comparisons with the general population and across patient groups [16]. Well-developed and calibrated universal fatigue measures could enhance comparability of findings and serve as a common metric of fatigue across conditions [15]. Yet, previous analyses of the PROMIS® fatigue domain were not conducted among PLWH, and were not carried out in the context of routine clinical care. We conducted this study to better understand the properties of the PROMIS® fatigue instrument as part of routine clinical care for PLWH.

Methods

Study cohort

This study was conducted in the Centers for AIDS Research Network of Integrated Clinical Systems (CNICS) cohort [17], which integrates comprehensive inpatient and outpatient clinical data on PLWH in the cohort [17]. PLWH complete the CNICS clinical assessment of patient reported measures, symptoms, and outcomes (PROs) every 4–6 months as part of routine clinic visits [18, 19]. They use touch screen tablets or personal computers using web-based survey software developed specifically for PROs [18, 20] to complete the clinical assessment which includes a variety of measures such as the HIV Symptoms Index [13], the Patient Health Questionnaire (PHQ-9) [21, 22] for depression, and the modified Alcohol, Smoking, and Substance Involvement Screening Test [23, 24] for illicit drug use. The assessment was integrated into clinical care for regularly scheduled clinic visits at each site. No exclusions were made on the basis of severe fatigue.

Study participants

PLWH 18 years old or older who spoke English or Spanish at four clinics (University of Washington Madison HIV Clinic, Seattle; University of Alabama at Birmingham 1917 Clinic, Birmingham; University of California San Diego HIV Clinic, San Diego; and Fenway Health, Boston) were eligible to participate in this study. Data were collected from 1597 PLWH from September 2012 to April 2013.

Qualitative analyses

We conducted in-depth interviews in English and Spanish with 42 patients endorsing fatigue to elicit concepts regarding the experience of living with fatigue and HIV, as described elsewhere [25]. We excerpted and coded transcribed interview content using codes adapted from PROMIS® Fatigue Item Bank content. We matched coded interview content to bank items. The team assessed unmatched content for possible new item development. We reviewed all proposed items using PROMIS® Qualitative Item Review criteria [26], for readability using the Lexile Analyzer, and for translatability into English or Spanish. We held focus groups with 68 patients and asked them to rank-order the prospective item list in order of importance for their provider to know. We retained the most important items and conducted cognitive interviews with 21 patients to assess item comprehensibility, modifying items as needed [25]. We developed four new items in addition to those already in the PROMIS® Fatigue Item Bank [25].

Item administration

We administered the 7-item PROMIS® Fatigue Short Form [27], an additional 13 items selected from the PROMIS® Fatigue Item Bank (including four items excluded from the final bank and, thus, without PROMIS® item parameters), and our four new items (see Table 1). We modified response options for five existing PROMIS® items because of qualitative feedback. We used PROMIS® item parameters for all of the other PROMIS® items but calibrated the five items with new response options anew.

Table 1
Fatigue items administered, with a priori subdomains

Quantitative analyses

We used Stata [28] for all analyses unless otherwise noted.

Dimensionality

We used structural equation modeling to determine whether the items were sufficiently unidimensional to use item response theory (IRT) in our sample. All structural equation models were fit in Mplus [29]. We applied the following thresholds for acceptable model fit: confirmatory fit index (CFI) > 0.95, Tucker–Lewis index (TLI) > 0.95, and root mean squared error of approximation (RMSEA) < 0.08 [30].

PROMIS® item parameters

We performed additional analyses to determine whether it was appropriate to use PROMIS® item parameters in our population of PLWH. We initially fixed all seven items from the fatigue short form to their PROMIS® values and used modification indices to identify the item for which constraining parameters to PROMIS® values had the greatest impact on model fit. We then removed those constraints and freely estimated parameters for that item and identified the next item that had the greatest impact on model fit. We repeated this procedure until we were left with two anchor items. We extracted factor scores from the PROMIS®-fixed model and from a model with the final two anchor items and five freely estimated items and calculated correlations between these scores. We plotted agreement between scores using a variant of a Bland–Altman plot, with the difference between the scores on the y-axis and the PROMIS®-fixed model scores on the x-axis. We superimposed the standard error of measurement (SEM) curve on this graph and examined whether the differences were smaller than the SEM at each level of fatigue.

Comparison of measurement properties of scores

We computed an IRT score for all 24 items. We fixed item parameters for the 11 PROMIS® items with PROMIS® response options to their PROMIS® values, so scores are on the PROMIS® metric. We freely estimated parameters for the other 13 items. We compared the SEM for the PROMIS®-7a short form to that from all 24 items.

Simulated CAT

We used Firestar [31] to simulate CAT from the 24-item bank we administered. We categorized PLWH into groups based on PROMIS® fatigue scores: <40, 40–50, >50–60, and >60. We set the minimum number of items administered by the simulated CAT at 7 and the default stopping rule of SEM < 0.3 (equivalent: T-metric SEM < 3). We determined the proportion of times each item was administered to people in each fatigue level group. We used seven items as a minimum to determine the extent of overlap between items selected by CAT and items included in the 7-item PROMIS® Fatigue Short Form. As a sensitivity analysis, we performed a second CAT simulation with no minimum number of items and used a 0.3 SEM or seven items maximum stopping rule. We compared patient burden based on the average completion times per item for patients from one site (University of Washington) who completed both instruments, based on the 7-item short form and the number of items in the 2 CAT simulations.

Differential item functioning (DIF)

We used the Stata command—difwithpar—[32] to evaluate items for DIF with respect to age, sex, race, and nadir CD4 count. We used a P value criterion of 0.05 for uniform and for non-uniform DIF. The—difwithpar—algorithm uses demographic-specific item parameters for items identified with DIF and generates new scores that account for DIF. We evaluated DIF impact by comparing naïve scores that ignored DIF to those that accounted for DIF. We use differences of score larger than 0.3 points on the theta metric (larger than 3 points on the T metric) as the primary threshold to indicate salient DIF impact and the median SEM as a more stringent threshold.

Associations with clinical characteristics

We used Spearman correlations to compare cross-sectional associations between clinical characteristics and the HIV Symptoms Index fatigue item [13], the “tired” item from the PHQ-9 [21, 22], the PROMIS®-7a score, and the score derived from the entire 24 items we administered. The clinical characteristics included: hepatitis C virus co-infection; nadir and current CD4 count; the number of symptoms endorsed on the HIV Symptoms Index; specific symptoms endorsed on the HIV Symptoms Index; quality of life estimated using EQ-5D responses [3336]; and the total PHQ-9 score. Among PLWH taking antiretroviral medications for HIV, we also determined associations between fatigue scores and medication adherence based on the last time the person stated they had missed medications, their self-reported ability to take medications, and the proportion of medications they were estimated to have taken [3742].

Test–retest reliability

We had 51 people return to clinic on a second occasion from 6–14 days following their initial assessment to repeat the assessment. Since this involved an extra visit outside the context of clinical care, we provided an incentive of $15 for this activity. We used intraclass correlation coefficients (ICCs) to measure test–retest reliability.

Longitudinal evaluation

A subset of 249 PLWH had repeat assessment on a second routine clinical care visit from 79–203 days following their initial assessment [median 119 days, interquartile range (IQR) 105–134 days]. Given the episodic nature of HIV symptoms [43], we were interested first in describing changes in fatigue. We also sought to compare changes in fatigue measures in two situations where change might be expected: concurrent with a change in depression symptoms or a change in methamphetamine use on the clinical assessment.

Results

Demographic and clinical characteristics from the cross-sectional quantitative data

English questionnaires were completed by 1597 PLWH (Table 2); we included Spanish speakers in our qualitative analyses, but there were too few respondents in Spanish (n = 94) for meaningful quantitative analyses. Mean age (SD) was 45.7 (10.4), with a range from 20 to 83 (IQR 39, 53).

Table 2
Participant characteristics (n = 1597)

Fatigue was common in this cohort. Using the HIV Symptoms Index single item, 65% stated they had fatigue (Table 2). Scores from the PROMIS® items mapped closely to these scores from the HIV Symptoms Index. As shown in Fig. 1, median fatigue scores on the PROMIS® metric ranged from just below 40 for those who stated they did not have fatigue to just over 65 for those who stated they had fatigue and that it bothered them a lot.

Fig. 1
Box and whisker plots showing the distribution of PROMIS® 7a fatigue scores on the PROMIS® T score metric for each level of fatigue according to the HIV symptoms inventory fatigue item* (a); for people with different recent CD4+ T-cell ...

Dimensionality

A single factor confirmatory factor analysis model did not fit well by RMSEA criteria (CFI 0.98, TLI 0.98, RMSEA 0.103). We assigned items a priori to one of two subdomains, the experience of fatigue vs. the impact of fatigue, based on PROMIS®’s domain framework (see Table 1), but this model did not fit well and had loadings that did not support the theoretical structure, such as negative loadings on a subdomain. A negative loading means that as levels of the item were of increasing severity, the level of fatigue impact was expected to be lower down, which is difficult to explain.

We then considered modification indices from a single factor model that suggested candidate pairs of items with residual correlations that would have the greatest impact on model fit. We included 6 such pairs, which resulted in a model with CFI 0.99, TLI 0.99, and RMSEA 0.08. We extracted factor scores for the single factor score and the bifactor score with the six residual correlations. These scores were highly correlated at 0.9999. We compared standardized factor loadings between these models, and the largest difference was 0.020, well lower than the 0.10 threshold that would indicate a salient difference in loadings between the single factor and bifactor models [44]. These findings led us to conclude that the items were sufficiently unidimensional to proceed with IRT analyses.

PROMIS item parameters

The loadings and thresholds for the two anchor items and the five freely estimated items are shown in Additional file 1. The correlation between the score using those parameters and the score based entirely on PROMIS parameters was >0.99. All of the score differences were within the SEM curve thresholds (Additional file 2). These results supported use of PROMIS item parameters for PLWH.

Measurement properties

We show a plot of the SEM for the 24 items administered and for the 7-item PROMIS® Fatigue Short Form subset in Fig. 2. The median SEM was 0.29 (range 0.24–0.57; IQR 0.26–0.34) for the 7-item PROMIS® Fatigue Short Form and 0.15 (range 0.11–0.52; IQR 0.14–0.20) using all 24 items. On the T-score metric, the 7-item PROMIS® Fatigue Short Form has an SEM < 3 over the 45–73 range, while using all 24 items gives an SEM under 3 for all scores 35 and above. We also show a histogram of observed fatigue scores from the 7-item PROMIS® Fatigue Short Form on the same plot. There are very few people with extremely high levels of fatigue (over 73) for whom the 24 items would provide a markedly improved level of precision; most of the people for whom differences in precision between the 7-item short form and the 24-item bank are characterized by low levels of fatigue, with scores 35-45 on the PROMIS® metric. While scores in this range are common, it may not be clinically important to measure fatigue levels precisely in these individuals 1.5–2.5 SD below national norms for fatigue.

Fig. 2
Histogram of observed fatigue levels (open bars) superimposed on standard error of measurement curves for the 24 fatigue items administered to participants (lower light gray curve) and for the 7-item PROMIS® Fatigue Short Form (upper darker gray ...

CAT results

Our first CAT simulation used a minimum of seven items. With this criterion, only people with PROMIS fatigue scores <40 required more than seven items to achieve a SEM < 3 on the T-metric (Table 3). There were two items that were administered in all simulated CATs: “How run-down did you feel on average” and “How fatigued were you on average.” The item “How often were you physically drained” was almost always administered. None of the items from the 7-item PROMIS® Fatigue Short Form was routinely selected for CAT administration across all fatigue levels, though “How often did you feel tired” and “How often did you run out of energy” were always administered to individuals with fatigue scores <40.

Table 3
Frequency of item administration in simulated computerized adaptive testing, by level of fatigue

As outlined in our previous publication, we developed four new fatigue items based on our qualitative work [25]. In simulated CAT, one of these, “How often did your body feel exhausted?” was selected 46% of the time; it was always selected for people with fatigue scores ≤40, 61% of the time for fatigue scores >40–50 and 46% of the time for those with the highest levels of fatigue. In contrast, the other new items we developed were either never or rarely selected for people with fatigue levels >40; these items were “How often were you too exhausted to carry out your daily responsibilities?”, “How often were you too exhausted to chew and swallow food?” and “How often were you too exhausted to concentrate?

In our secondary analyses, we completed another CAT simulation with no minimum number of items and a stopping rule of either a standard error of measurement <3 points on the T metric or up to 7 items maximum; the median (IQR) number of items administered was 3 (3–4).

Based on the mean time per item for the PROMIS fatigue items (mean 6.73 s, SD 2.74 per item), a person completing the 7-item PROMIS short form or 7-item CAT would be expected to take an average of 47.1 s. Based on the second simulated CAT where people completed a mean of 3 items, the average completion time for the PROMIS fatigue CAT would be 20.2 s. This is in comparison to an estimated time to complete the HIV Symptom Index fatigue screening item of 6 s (mean 6.0 s, SD 10.1).

DIF results

A few items had DIF with respect to age, sex, race, and/or nadir CD4 count with the very sensitive DIF thresholds we used (results not shown). There was negligible DIF impact, and for none of these covariates was there any individual PLWH where accounting for DIF led to a change in score as much as three points on the PROMIS T-score metric. Indeed, when we considered a more stringent 1.7 points PROMIS T-score metric (the median SEM for this sample), only 1–7 people (all <1%) had DIF impact of this magnitude with respect to each of these covariates. We concluded that there was negligible DIF in these items with respect to these covariates.

Associations with clinical characteristics

The HIV Symptom Index single item fatigue score was closely associated with the 7-item PROMIS® Fatigue Short Form (ρ = 0.82) and with the score from all of 24 items (ρ = 0.85) (Table 4). Similarly, the PHQ-9 fatigue item was closely associated with the HIV Symptoms Index fatigue item (ρ = 0.77), with the 7-item PROMIS® Fatigue Short Form (ρ = 0.75), and with the 24-item score (ρ = 0.77). Correlations with clinical characteristics were generally as strong for the HIV Symptom Index fatigue item as they were for either the 7-item PROMIS® Fatigue Short Form or the full 24-item score.

Table 4
Spearman correlation coefficients between fatigue measures and clinical characteristics

Test–retest reliability

Fifty-one people completed the 7-item PROMIS® Fatigue Short Form again 6–14 days later (median 8, IQR 7–11 days). The ICC was 0.74 (0.55, 0.83). The mean change was −0.17 points, though 4 people had a decrease of at least on point and 2 had an increase of at least one point, either due to true changes in fatigue [43] or measurement error. Among the 31 people who said their level of fatigue was “about the same” as previously, the ICC was similar at 0.66 (0.44, 0.81).

Longitudinal analyses

On average there was little change in level of fatigue over approximately 4 months—the mean change was −0.16. However, this obscures individual variation, in that 9% reported an increase in fatigue of at least one point, and 16% reported a decrease of at least one point. Changes in the PHQ-9 depression score were more highly correlated with changes in the HIV Symptom Index fatigue item (Spearman ρ = 0.47) than were changes in the 7-item PROMIS® Fatigue Short Form score (ρ = 0.39). Only 13 people changed from using methamphetamines to not, or vice versa, so comparisons of the fatigue measures were not feasible.

Discussion

In a thorough evaluation of the psychometric properties of the 7-item PROMIS® Fatigue Short Form and additional items selected from the PROMIS® Fatigue Item Bank or items specifically developed for this project, we found that these fatigue items had excellent content validity among PLWH. While the 24 fatigue items did not form a scale that was strictly unidimensional, it was sufficiently unidimensional to use item response theory. Furthermore, our analyses suggested that PROMIS® item parameters were appropriate to use among PLWH. We used very sensitive DIF detection thresholds and identified items with DIF, but did not find salient impact for DIF with respect to age, sex, race, or nadir CD4 count. Scores from the 7-item PROMIS® Fatigue Short Form or from all 24 items from the fatigue item bank had excellent validity in a variety of analyses, but were no better than the HIV Symptom Index single fatigue item measure or the fatigue item from the PHQ-9. The HIV Symptom Index single fatigue item has limited ability to detect change over time, because it has only a few response options. Nevertheless, in the longitudinal sample, we did not find evidence that the PROMIS scores were more responsive to change than was the HIV Symptom Index fatigue item or the PHQ-9 fatigue item.

Fatigue is clearly a relevant consideration for this clinical population. Sizable numbers of PLWH had substantial levels of fatigue. One advantage of the PROMIS® fatigue metric is that we can relate fatigue levels to national averages. As shown in Fig. 1 and in Table 3, substantial numbers of PLWH endorse high levels of fatigue. Those who stated that they have fatigue that bothers them a lot on the HIV Symptom Index have median (IQR) PROMIS® fatigue scores of 66 (IQR 61–71), which is about 1.5 SD (1–2 SD) above the national average.

Our CAT simulations showed a small amount of overlap with the 7-item PROMIS® Fatigue Short Form. We set up the first simulation such that each individual received at least seven items to facilitate comparisons with the short form. Only people with very low fatigue levels received more than 7 items from the simulated CAT; everyone else received exactly 7 items. While the 7-item short form may not include the most informative items from the PROMIS® Fatigue Item Bank, it nevertheless had good measurement precision across a broad range of fatigue levels (see Fig. 2). Furthermore, the 7-item PROMIS® Fatigue Short Form performed well in all of our validity analyses; indeed, scores from the 7-item PROMIS® Fatigue Short Form performed just as well as scores from the entire 24 items we considered. At the same time, briefer instruments, including the fatigue item from the PHQ-9 and the single HIV Symptom Index fatigue item, also did well in all of our validity analyses. We did not find a compelling case to choose the PROMIS® fatigue scores over much shorter instruments. A CAT with different specifications could have arrived at a PROMIS fatigue score in fewer items, but it would be unlikely to have better performance in our validity analyses than the entire scale considered here. Furthermore, the HIV Symptom Index fatigue item required much less time on average for patients to complete than the 7-item PROMIS short form, CAT, or even the shorter CAT with an average of 3 items. While this may be of limited importance in research settings, minimizing patient burden in clinical care settings is important to avoid impacting clinical flow.

Our findings should be considered in the context of strengths and limitations. Our study was performed in CNICS, which is a nationally distributed cohort of PLWH who are in clinical care. Our data were collected from convenience samples of PLWH seen in particular calendar months, and were not purposefully sampled from people particularly likely to have changing fatigue levels. Generalizability is limited as our study was conducted only among PLWH. We did administer the PROMIS fatigue items to Spanish speakers, but had too few of them during the data collection window to facilitate analyses of DIF. We found no evidence of DIF with respect to four covariates, but were not able to evaluate DIF with respect to Spanish vs. English. The CNICS assessment of patient-reported measures now includes Amharic, but unfortunately, an Amharic version of the PROMIS Fatigue Item Bank has not been developed, nor were we able to assess the performance of these items in any other language.

Our ability to evaluate change in fatigue over time was limited, because we had few options for external comparison. One validation option was changes in depression levels as measured by the PHQ-9, where we found that the HIV Symptom Index fatigue item was more closely correlated to changes in depression levels than were PROMIS scores. In theory, IRT scores are more accurate measures of change over time than ordinal scales, because they have linear measurement properties [45], which means that one point of change in a score corresponds to the same amount of change in fatigue regardless of the initial level of fatigue. Indeed, PROMIS® scores may have shown better responsiveness to change than the HIV symptoms index fatigue item scores had we designed our study specifically to collect data on people expected to change [46]. In that setting, a brief CAT may prove to have better responsiveness to change than the single HIV symptoms index fatigue item and may fit in a reasonable time footprint, making this a feasible choice in routine clinical care settings. Firmer conclusions regarding responsiveness of PROMIS® scores among PLWH will require additional data.

This study has several strengths that are also worth noting. It includes a particularly relevant population (PLWH) given the high rates of fatigue experienced by a substantial proportion of this group. We studied the performance of these items in a geographically and racially/ethnically diverse population. We performed a variety of psychometric analyses using state-of-the-art approaches.

Fatigue in PLWH often does not remit [10], suggesting the need for additional research to better understand factors leading to fatigue in PLWH and interventions to successfully address it. Research on fatigue among PLWH will require a sustainable systematic approach to measuring fatigue in clinical care.

Conclusions

The PROMIS® Fatigue Short Form and other fatigue items performed well among PLWH, though we did not find evidence that they performed better than shorter legacy scales in the specific context of routine clinical care. Unless comparison to national norms is needed, the HIV Symptom Index fatigue item may be preferred in HIV clinical care settings due to reduced patient burden.

Authors’ contributions

LG conducted the statistical analyses and drafted sections of the manuscript. RF conducted all the qualitative analyses and made substantial contributions to the conception and design of the study and acquisition of data. DB, LD, KM, WM, MM, EP, and MK were involved in acquisition of data and critical revision of the manuscript for important intellectual content. TE, LM, and FY, were involved in critical revision of the manuscript for important intellectual content. DP was involved in the conception and design of the study and critical revision of the manuscript for important intellectual content. HC made substantial contributions to the conception and design of the study and acquisition of data and provided important intellectual content. PC made substantial contributions to the conception and design of the study and drafted sections of the manuscript. All authors read and approved the final manuscript.

Acknowledgements

We would like to thank the patients and clinics across CNICS. This research was funded by a cooperative agreement from the National Institute of Allergy and Infectious Diseases (NIAID) and National Institute of Arthritis and Musculoskeletal and Skin Diseases (NIAMS) (Grant #U01 AR057954). Support was also provided by the National Institute of Allergy and Infectious Diseases (NIAID) University of Washington Center for AIDS Research (Grant #P30 AI027757) and CNICS (R24 AI067039).

Competing interests

The authors declare that they have no competing interests.

Availability of data and materials

Deidentified data that support the findings of this study are available from CNICS (https://www.uab.edu/cnics/) with a concept proposal approved by the CNICS research coordination committee. The data are not publicly available due to them containing information that could compromise research participant privacy/consent.

Ethical approval and consent to participate

All procedures performed in studies involving human participants were in accordance with the ethical standards of the institutional and/or national research committee and with the 1964 Helsinki declaration and its later amendments or comparable ethical standards. Informed consent was obtained from all individual participants included in the study. Study procedures were approved by Institutional Review Boards at each site (CNICS Data Repository #27647).

Funding

This research was funded by a cooperative agreement from the National Institute of Allergy and Infectious Diseases (NIAID) and National Institute of Arthritis and Musculoskeletal and Skin Diseases (NIAMS) (Grant #U01 AR057954). Support was also provided by the National Institute of Allergy and Infectious Diseases (NIAID) University of Washington Center for AIDS Research (Grant #P30 AI027757) and CNICS (R24 AI067039).

Abbreviations

CAT
computerized adaptive test
CFI
confirmatory fit index
CNICS
Centers for AIDS Research Network of Integrated Clinical Systems
DIF
differential item functioning
ICC
intraclass correlation coefficient
IQR
interquartile Range
IRT
item response theory
PHQ-9
patient health questionnaire for depression
PLWH
persons living with HIV
PROMIS
Patient Reported Outcomes Measurement and Information System
PROs
patient reported measures, symptoms, and outcomes
RMSEA
root mean squared error of approximation
SEM
standard error of measurement
TLI
Tucker–Lewis Index

Contributor Information

L. E. Gibbons, Phone: 206-744-1842, ude.notgnihsaw.u@lsnobbig.

R. Fredericksen, ude.notgnihsaw.u@irederfr.

D. S. Batey, ude.bau@yetabsd.

L. Dant, gro.htlaehyawnef@tnadl.

T. C. Edwards, ude.notgnihsaw.u@ecddot.

K. H. Mayer, gro.htlaehyawnef@reyamk.

W. C. Mathews, ude.dscu.da@swehtamc.

L. S. Morales, ude.wu@0102msl.

M. J. Mugavero, ude.bau@orevagumm.

F. M. Yang, ude.urg@gnayrf.

E. Paez, ude.dscu@zeape.

M. M. Kitahata, ude.notgnihsaw.u@atahatik.

D. L. Patrick, ude.wu@dlanod.

H. M. Crane, ude.wu@enarch.

P. K. Crane, ude.wu@enarcp.

References

1. Jong E, Oudhoff LA, Epskamp C, et al. Predictors and treatment strategies of HIV-related fatigue in the combined antiretroviral therapy era. AIDS. 2010;24(10):1387–1405. doi: 10.1097/QAD.0b013e328339d004. [PubMed] [Cross Ref]
2. Barroso J, Voss JG. Fatigue in HIV and AIDS: an analysis of evidence. J Assoc Nurses AIDS Care. 2013;24(1 Suppl):S5–S14. doi: 10.1016/j.jana.2012.07.003. [PubMed] [Cross Ref]
3. daCosta DiBonaventura M, Gupta S, Cho M, Mrus J. The association of HIV/AIDS treatment side effects with health status, work productivity, and resource use. AIDS Care. 2012;24(6):744–755. doi: 10.1080/09540121.2011.630363. [PubMed] [Cross Ref]
4. Sowa NA, Bengtson A, Gaynes BN, Pence BW. Predictors of depression recovery in HIV-infected individuals managed through measurement-based care in infectious disease clinics. J Affect Disord. 2016;192:153–161. doi: 10.1016/j.jad.2015.12.031. [PMC free article] [PubMed] [Cross Ref]
5. O’Brien KK, Solomon P, Bergin C, et al. Reliability and validity of a new HIV-specific questionnaire with adults living with HIV in Canada and Ireland: the HIV disability questionnaire (HDQ) Health Qual Life Outcomes. 2015;13:124. doi: 10.1186/s12955-015-0310-9. [PMC free article] [PubMed] [Cross Ref]
6. Simmonds MJ, Novy D, Sandoval R. The differential influence of pain and fatigue on physical performance and health status in ambulatory patients with human immunodeficiency virus. Clin J Pain. 2005;21(3):200–206. doi: 10.1097/00002508-200505000-00002. [PubMed] [Cross Ref]
7. Al-Dakkak I, Patel S, McCann E, Gadkari A, Prajapati G, Maiese EM. The impact of specific HIV treatment-related adverse events on adherence to antiretroviral therapy: a systematic review and meta-analysis. AIDS Care. 2013;25(4):400–414. doi: 10.1080/09540121.2012.712667. [PMC free article] [PubMed] [Cross Ref]
8. Marconi VC, Wu B, Hampton J, et al. Early warning indicators for first-line virologic failure independent of adherence measures in a South African urban clinic. AIDS Patient Care STDS. 2013;27(12):657–668. doi: 10.1089/apc.2013.0263. [PMC free article] [PubMed] [Cross Ref]
9. Fredericksen RJ, Edwards TC, Merlin JS, et al. Patient and provider priorities for self-reported domains of HIV clinical care. AIDS Care. 2015;27(10):1255–1264. doi: 10.1080/09540121.2015.1050983. [PMC free article] [PubMed] [Cross Ref]
10. Barroso J, Leserman J, Harmon JL, Hammill B, Pence BW. Fatigue in HIV-infected people: a three-year observational study. J Pain Symptom Manag. 2015;50(1):69–79. doi: 10.1016/j.jpainsymman.2015.02.006. [PMC free article] [PubMed] [Cross Ref]
11. Barroso J, Lynn MR. Psychometric properties of the HIV-related fatigue scale. J Assoc Nurses AIDS Care. 2002;13(1):66–75. doi: 10.1016/S1055-3290(06)60242-2. [PubMed] [Cross Ref]
12. Pence BW, Barroso J, Leserman J, Harmon JL, Salahuddin N. Measuring fatigue in people living with HIV/AIDS: psychometric characteristics of the HIV-related fatigue scale. AIDS Care. 2008;20(7):829–837. doi: 10.1080/09540120701694063. [PMC free article] [PubMed] [Cross Ref]
13. Justice AC, Holmes W, Gifford AL, et al. Development and validation of a self-completed HIV Symptom Index. J Clin Epidemiol. 2001;54(Suppl 1):S77–S90. doi: 10.1016/S0895-4356(01)00449-8. [PubMed] [Cross Ref]
14. Lai JS, Cella D, Choi S, et al. How item banks and their application can influence measurement practice in rehabilitation medicine: a PROMIS fatigue item bank example. Arch Phys Med Rehabil. 2011;92(10 Suppl):S20–S27. doi: 10.1016/j.apmr.2010.08.033. [PMC free article] [PubMed] [Cross Ref]
15. Cella D, Lai JS, Jensen SE, et al. Clinical validity of the PROMIS fatigue item bank across diverse clinical samples. J Clin Epidemiol. 2016;73:128–134. doi: 10.1016/j.jclinepi.2015.08.037. [PMC free article] [PubMed] [Cross Ref]
16. Junghaenel DU, Christodoulou C, Lai JS, Stone AA. Demographic correlates of fatigue in the US general population: results from the patient-reported outcomes measurement information system (PROMIS) initiative. J Psychosom Res. 2011;71(3):117–123. doi: 10.1016/j.jpsychores.2011.04.007. [PMC free article] [PubMed] [Cross Ref]
17. Kitahata MM, Rodriguez B, Haubrich R, et al. Cohort profile: the centers for AIDS research network of integrated clinical systems. Int J Epidemiol. 2008;37(5):948–955. doi: 10.1093/ije/dym231. [PMC free article] [PubMed] [Cross Ref]
18. Crane HM, Lober W, Webster E, et al. Routine collection of patient-reported outcomes in an HIV clinic setting: the first 100 patients. Curr HIV Res. 2007;5(1):109–118. doi: 10.2174/157016207779316369. [PubMed] [Cross Ref]
19. Fredericksen RJ, Crane PK, Tufano J, et al. Integrating a web-based patient assessent into primary care for HIV-infected adults. J AIDS HIV Res. 2012;4(2):47–55. doi: 10.5897/JAHR11.046. [PMC free article] [PubMed] [Cross Ref]
20. Lawrence ST, Willig JH, Crane HM, et al. Routine, self-administered, touch-screen, computer-based suicidal ideation assessment linked to automated response team notification in an HIV primary care setting. Clin Infect Dis. 2010;50(8):1165–1173. doi: 10.1086/651420. [PMC free article] [PubMed] [Cross Ref]
21. Spitzer RL, Kroenke K, Williams JB. Validation and utility of a self-report version of PRIME-MD: the PHQ primary care study. Primary care evaluation of mental disorders. Patient health questionnaire. JAMA. 1999;282(18):1737–1744. doi: 10.1001/jama.282.18.1737. [PubMed] [Cross Ref]
22. Kroenke K, Spitzer RL, Williams JB. The PHQ-9: validity of a brief depression severity measure. J Gen Intern Med. 2001;16(9):606–613. doi: 10.1046/j.1525-1497.2001.016009606.x. [PMC free article] [PubMed] [Cross Ref]
23. Newcombe DA, Humeniuk RE, Ali R. Validation of the World Health Organization alcohol, smoking and substance involvement screening test (ASSIST): report of results from the Australian site. Drug Alcohol Rev. 2005;24(3):217–226. doi: 10.1080/09595230500170266. [PubMed] [Cross Ref]
24. WHO Assist Working Group The alcohol, smoking and substance involvement screening test (ASSIST): development, reliability and feasibility. Addiction. 2002;97(9):1183–1194. doi: 10.1046/j.1360-0443.2002.00185.x. [PubMed] [Cross Ref]
25. Edwards TC, Fredericksen RJ, Crane HM, et al. Content validity of Patient-Reported Outcomes Measurement Information System (PROMIS) items in the context of HIV clinical care. Qual Life Res. 2016;25(2):293–302. doi: 10.1007/s11136-015-1096-2. [PMC free article] [PubMed] [Cross Ref]
26. DeWalt DA, Rothrock N, Yount S, Stone AA. Evaluation of item candidates: the PROMIS qualitative item review. Med Care. 2007;45(5 Suppl 1):S12–S21. doi: 10.1097/01.mlr.0000254567.79743.e2. [PMC free article] [PubMed] [Cross Ref]
27. Garcia SF, Cella D, Clauser SB, et al. Standardizing patient-reported outcomes assessment in cancer clinical trials: a patient-reported outcomes measurement information system initiative. J Clin Oncol. 2007;25(32):5106–5112. doi: 10.1200/JCO.2007.12.2341. [PubMed] [Cross Ref]
28. Stata statistical software: release 14. [computer program]. College Station: StataCorp LP; 2015.
29. Mplus: statistical analysis with latent variables [computer program]. Version 7.11. Los Angeles: Muthén & Muthén; 1998–2013.
30. Reeve BB, Hays RD, Bjorner JB, et al. Psychometric evaluation and calibration of health-related quality of life item banks: plans for the Patient-Reported Outcomes Measurement Information System (PROMIS) Med Care. 2007;45(5 Suppl 1):S22–S31. doi: 10.1097/01.mlr.0000250483.85507.04. [PubMed] [Cross Ref]
31. Choi SW. Firestar: computerized adaptive testing simulation program for polytomous item response theory models. Appl Psych Meas. 2009;33(8):644–645. doi: 10.1177/0146621608329892. [Cross Ref]
32. Crane PK, Gibbons LE, Jolley L, van Belle G. Differential item functioning analysis with ordinal logistic regression techniques: DIFdetect and difwithpar. Med Care. 2006;44(11 Suppl 3):S115–S123. doi: 10.1097/01.mlr.0000245183.28384.ed. [PubMed] [Cross Ref]
33. Wu AW, Jacobson KL, Frick KD, et al. Validity and responsiveness of the euroqol as a measure of health- related quality of life in people enrolled in an AIDS clinical trial. Qual Life Res. 2002;11(3):273–282. doi: 10.1023/A:1015240103565. [PubMed] [Cross Ref]
34. Johnson JA, Coons SJ. Comparison of the EQ-5D and SF-12 in an adult US sample. Qual Life Res. 1998;7(2):155–166. doi: 10.1023/A:1008809610703. [PubMed] [Cross Ref]
35. Johnson JA, Coons SJ, Ergo A, Szava-Kovats G. Valuation of EuroQOL (EQ-5D) health states in an adult US sample. Pharmacoeconomics. 1998;13(4):421–433. doi: 10.2165/00019053-199813040-00005. [PubMed] [Cross Ref]
36. Harding R, Clucas C, Lampe FC, et al. What factors are associated with patient self-reported health status among HIV outpatients? A multi-centre UK study of biomedical and psychosocial factors. AIDS Care. 2012;24(8):963–971. doi: 10.1080/09540121.2012.668175. [PubMed] [Cross Ref]
37. Chesney MA, Ickovics JR, Chambers DB, et al. Self-reported adherence to antiretroviral medications among participants in HIV clinical trials: the AACTG adherence instruments. Patient Care Committee & Adherence Working Group of the Outcomes Committee of the Adult AIDS Clinical Trials Group (AACTG) AIDS Care. 2000;12(3):255–266. doi: 10.1080/09540120050042891. [PubMed] [Cross Ref]
38. Lu M, Safren SA, Skolnik PR, et al. Optimal recall period and response task for self-reported HIV medication adherence. AIDS Behav. 2008;12(1):86–94. doi: 10.1007/s10461-007-9261-4. [PubMed] [Cross Ref]
39. Walsh JC, Mandalia S, Gazzard BG. Responses to a 1 month self-report on adherence to antiretroviral therapy are consistent with electronic data and virological treatment outcome. AIDS. 2002;16(2):269–277. doi: 10.1097/00002030-200201250-00017. [PubMed] [Cross Ref]
40. Kalichman SC, Cain D, Fuhrel A, Eaton L, Di Fonzo K, Ertl T. Assessing medication adherence self-efficacy among low-literacy patients: development of a pictographic visual analogue scale. Health Educ Res. 2005;20(1):24–35. doi: 10.1093/her/cyg106. [PubMed] [Cross Ref]
41. Giordano TP, Guzman D, Clark R, Charlebois ED, Bangsberg DR. Measuring adherence to antiretroviral therapy in a diverse population using a visual analogue scale. HIV Clin Trials. 2004;5(2):74–79. doi: 10.1310/JFXH-G3X2-EYM6-D6UG. [PubMed] [Cross Ref]
42. Feldman BJ, Fredericksen RJ, Crane PK, et al. Evaluation of the single-item self-rating adherence scale for use in routine clinical care of people living with HIV. AIDS Behav. 2012;17(1):307–318. doi: 10.1007/s10461-012-0326-7. [PMC free article] [PubMed] [Cross Ref]
43. O’Brien KK, Davis AM, Strike C, Young NL, Bayoumi AM. Putting episodic disability into context: a qualitative study exploring factors that influence disability experienced by adults living with HIV/AIDS. J Int AIDS Soc. 2009;12:5. doi: 10.1186/1758-2652-2-5. [PMC free article] [PubMed] [Cross Ref]
44. McDonald RP. Test theory: a unified treatment. Mahwah: Lawrence Erlbaum; 1999.
45. Mungas D, Reed BR. Application of item response theory for development of a global functioning measure of dementia with linear measurement properties. Stat Med. 2000;19(11–12):1631–1644. doi: 10.1002/(SICI)1097-0258(20000615/30)19:11/12<1631::AID-SIM451>3.0.CO;2-P. [PubMed] [Cross Ref]
46. Cook KF, Jensen SE, Schalet BD, et al. PROMIS measures of pain, fatigue, negative affect, physical function and social function demonstrate clinical validity across a range of chronic conditions. J Clin Epidemiol. 2016;73:89. doi: 10.1016/j.jclinepi.2015.08.038. [PMC free article] [PubMed] [Cross Ref]

Articles from AIDS Research and Therapy are provided here courtesy of BioMed Central