PMCCPMCCPMCC

Search tips
Search criteria 

Advanced


 
Formats
Article sections
Authors
Related links
Logo of bmcmudisBioMed Centralsearchsubmit a manuscriptregisterthis articleBMC Musculoskeletal Disorders
 
BMC Musculoskelet Disord. 2012; 13: 112.
Published online 2012 June 25. doi:  10.1186/1471-2474-13-112
PMCID: PMC3476966
Copyright ©2012 Buitinga et al.; licensee BioMed Central Ltd.
Construct validity of the interview Time Trade-Off and computer Time Trade-Off in patients with rheumatoid arthritis: A cross-sectional observational pilot study
Laurien Buitinga,corresponding author1 Louise MA Braakman-Jansen,1 Erik Taal,1 and Mart AFJ van de Laar1,2
1Department of Psychology, Health and Technology, Institute for Innovation and Governance Studies, University of Twente, Enschede, The Netherlands
2Department of Rheumatology and Clinical Immunology, Medisch Spectrum Twente, Enschede, The Netherlands
corresponding authorCorresponding author.
Laurien Buitinga: l.buitinga/at/utwente.nl; Louise MA Braakman-Jansen: l.m.a.braakman-jansen/at/utwente.nl; Erik Taal: E.Taal/at/utwente.nl; Mart AFJ van de Laar: M.A.F.J.vandeLaar/at/utwente.nl
Received October 13, 2011; Accepted June 19, 2012.
This is an Open Access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/2.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.
Abstract
Background
The Time Trade-Off (TTO) is a widely used instrument for valuing preference-based health-related quality of life (HRQoL). The TTO reveals preferences for own current health (‘utilities’) on a scale anchored between death (0) and perfect health (1). Limited information on the external validity of the TTO is available. Aim of this pilot study was to examine the construct validity of both an interview TTO and a computer-based TTO in patients with rheumatoid arthritis (RA).
Methods
Thirty patients visiting the outpatient rheumatology clinic participated. Construct validity was assessed by measuring convergent and discriminative validity. Convergent validity was assessed by calculating Spearman’s correlations between the utilities obtained from the TTOs and pain, general health (rating scales), health-related quality of life (SF-36 and SF-6D) and functional status (HAQ-DI). Discriminative power of both TTO measures was determined by comparing median utilities between worse and better health outcomes.
Results
Correlations of both TTO measures with HRQoL, general health, pain and functional status were poor (absolute values ranging from .05 to .26). Both TTOs appeared to have no discriminative value among groups of RA patients who had a worse or better health status defined by six health outcome measures. About one-third of respondents were zero-traders on each of the TTO measures. After excluding zero-traders from analysis, the correlations improved considerably.
Conclusions
Both the interview TTO and computer TTO showed poor construct validity in RA patients when using measures of HRQol, general health, pain and functional status as reference measures. Possibly, the validity of the TTO improves when using an anchor that is more realistic to RA patients than the anchor ‘death’.
Background
The Time Trade-Off (TTO) [1] is an instrument developed to assess effects of treatments in cost-utility analyses (CUAs) by measuring changes in health-related quality of life (HRQoL) directly by patients. The TTO reveals preferences for own current health (‘utilities’) on a scale anchored between death (0) and perfect health (1) by asking people how many life years they are willing to give up to become perfectly healthy. It is assumed that the more life years people are willing to trade off, the worse their health state is. The purpose of this measure is to capture the desirability of patients’ own health state reflecting their health-related quality of life (HRQoL).
Traditionally, the TTO is administered by interview. The TTO can also be administered by questionnaire or computer. Furthermore, different methodological approaches to the TTO are used [2]. This makes comparison between studies difficult. Differences in TTO procedures seem to influence utilities. For example, it has been found that utility scores are heavily influenced by the method of elicitation (ping-pong, titration) [3]. Furthermore, the mode of administration (interview/computer/questionnaire) or the way the TTO question is formulated can influence utilities. Besides, the size of time frame that is used (e.g. fixed time period, life expectancy) has a great impact, since utilities are calculated as the proportion of the remaining lifetime sacrificed [2].
Few studies have examined psychometric properties of the interview TTO in rheumatoid arthritis (RA). The studies that reported on the construct validity, showed poor to moderate correlations between TTO and measures of HRQoL, functional status, disease activity and pain [4-6]. It was found that the TTO was only able to discriminate between worse or better disease-specific HRQoL using the RAQoL [4,5], between worse or better outcomes on the dimensions ‘symptom’ and ‘role’ of the disease-specific AIMS-2 [5] and between worse or better mental health using the RAND-36 mental component summary scale [4]. Tijhuis et al. showed that the TTO was able to discriminate between worse or better pain, worse or better disease activity and worse or better functional status [4]. In contrast, Bejia et al. showed that the TTO was not able to discriminate between worse and better pain or worse and better disease activity [5].
Computer-based utility elicitation procedures to administer the TTO have been developed, for example iMPACT3 [7] and U-Titer [8]. Studies in a range of conditions have used such computer-based programmes to administer a TTO using different procedures [7,9].
In this study, we report on preliminary results with respect to the construct validity of the TTO assessed in patients with RA using an interview TTO as well as a computer TTO, and using a standardised procedure for both TTOs. The first aim of this study was to examine convergent validity of the interview and computer TTO separately by correlating TTO utilities of both TTO measures with other patient-reported outcomes (PROs) in patients with RA. The second aim was to examine whether the interview and computer TTO were able to discriminate between worse and better patient-reported health outcomes.
Methods
Patients and study design
Thirty consecutive outpatients (aged 18–85) of our rheumatology clinic who were diagnosed with RA participated. People who did not understand the Dutch language were excluded.
All participants completed the TTO twice with an interval of 14 days. Randomly the first TTO was either interview or computer-based, consequently followed by the other at the next assessment. Measures of pain, general health, health-related quality of life and functional status were administered at the first TTO assessment. Informed consent was obtained from all participants. According to legislation in the Netherlands (WMO), no approval of the ethical review board was indicated.
Measures
TTO interview
The Time Trade-Off question used in this study was formulated as follows:
“Imagine that a new treatment became available which helped you to recover fully. A side-effect of this treatment, however, is that you will die sooner. Would you opt for this treatment?” A graphical aid was used to make the question more clearly. When participants asked about the definition of being perfectly healthy, they were told to imagine being in perfect health without any disease or health-related complaints.
A life time perspective was adopted. Life expectancy calculations of the Dutch Central Bureau of Statistics [10] were used. The remaining life expectancy was calculated by extracting the age of the participant from his or her expected age of dying according to the CBS. The bisection method was applied to reach the point at which participants did not prefer one of the two options: staying in their health state for the rest of their lives or being perfectly healthy for a shorter life time. Therefore, the trade-off started with setting the shorter life in perfect health on half of the remaining life expectancy. For example, a person with a remaining life expectancy of 20 years was first asked about his or her willingness to trade off 10 life years. If the person accepted the trade, a remaining life expectancy of five years in perfect health was presented. If the person did not accept the trade, a remaining life expectancy of 15 years was presented. This process continued until the patient was indifferent between his or her own current health state according to his or her life expectancy and a shorter life in perfect health. Then, the TTO score was calculated by the formula: 1-(number of life years given up/remaining expected life years).
Computer TTO
Utilities were obtained by means of touch screens. Graphical presentations supported the TTO question (Figure ​(Figure1).1). The computer TTO and the interview TTO were formatted equally, using similar formulations and graphical presentations. The bisection method was used to find the indifference point. During the computer assessment of the TTO, the researcher (LB) was present to start up the computer. The respondents completed the TTO independently. The researcher observed the patients during the assessment. Our previous study [11] demonstrated that the test retest-reliability of this computer TTO was good (ICC = 0.88) and comparable with the test reliability of the interview TTO [4,5].
Figure 1
Figure 1
Two screen shots of the computer TTO*. Here, a person with a life expectancy of 27 years was asked about his or her willingness to trade off 13 life years. The person did not accept the 13 years in perfect health, so six years were added (more ...)
NRS pain and general health
Current severity of pain and current general health were both measured by a numerical rating scale (NRS), ranging from 0 (best) to 10 (worst).
SF-36
Physical and mental health were measured by calculating the physical and mental component summary scores (PCS and MCS) of the SF-36 version 2 [12], a generic descriptive instrument for measuring health-related quality life on eight dimensions (mental functioning, physical functioning, bodily pain, vitality, role limitations due to physical problems, role limitations due to emotional problems, social functioning and general health). The scores range from 0 to 100, whereby a higher score indicates a better health.
SF-6D
From the SF-36, SF-6D utility scores were derived, reflecting health state valuations of the general public [13]. The utility scores range from 0 to 1, whereby a higher score indicates a better HRQoL.
HAQ-DI
The level of functional disability was assessed by the Health Assessment Questionnaire Disability Index (HAQ-DI) [14], a self-report measure consisting of eight categories (dressing and grooming, arising, eating, walking, hygiene, reach, grip and common daily activities). The HAQ score ranges from 0 to 3, whereby a higher score indicates a worse functional status.
Statistical analysis
To examine the presence of an order effect between participants who started with the interview TTO or with the computer TTO, a Mann–Whitney U-test was performed.
Construct validity was assessed by measuring convergent and discriminative validity. Convergent validity of the interview and computer version was assessed by calculating Spearman’s correlations between each of the TTOs with the NRS for pain and general health, SF-36, SF-6D and HAQ-DI. Moderate correlations (0.40-0.59) are expected: all measures (except for the SF-6D) are descriptive, and most instruments only capture one or some aspects of the construct quality of life. The SF-6D yields utilities, but these are derived from a general public. A sample of 29 participants is required to demonstrate a significant moderate Spearman’s correlation of 0.50 with an alpha of 0.05 (one-tailed) and a power (1-β) of 0.80. Discriminative power of the interview TTO and computer TTO was determined by comparing median utilities between worse and better pain, general health, HRQoL and functional status. Therefore, the outcome measures were dichotomised by the median score. A worse health outcome was defined by the ≤ median value of the outcome measure. A better health outcome was defined by the > median value of the outcome measure. Because of a difference in scaling of the NRS (Pain and General Health) and HAQ-DI, a worse health outcome on these instruments was defined by the > median value of the outcome measure. A better health outcome was defined by the ≤ median value of the outcome measure. The Mann–Whitney U-test was used to test significance. Data were analysed using SPSS version 16.0.
Results
Subjects
All 30 patients who participated completed both TTO measures. Demographic, clinical and psychosocial characteristics and utility scores for both TTO methods of the 30 patients are shown in Table ​Table1.1. Median TTO utility scores were 0.87 (interview TTO) and 0.85 (computer TTO). Ten participants did not want to trade any life year for perfect health on the interview TTO; eight participants did not want to trade any life year for perfect health on the computer TTO (zero-traders). Zero-traders did not have a significantly different self-reported health than traders (data not shown). Six zero-traders on the computer TTO were also zero-traders on the interview TTO. Two zero-traders on the computer TTO were not zero-traders on the interview TTO, and two zero-traders on the interview TTO were not zero-traders on the computer TTO.
Table 1
Table 1
Demographic, clinical and psychosocial characteristics
Test order
For neither interview TTO utility scores nor computer TTO utility scores an effect of test order was found (P = 0.37 and P = 0.73 respectively). So, no significant differences in utility scores existed between patients who started with the interview TTO or computer TTO.
Construct validity: Convergent and discriminative validity
Correlations between utilities and scores on rating scales for pain and general health, SF-36, SF-6D and HAQ-DI are shown in Table ​Table2.2. In the entire group of RA patients, poor correlations were found between either both TTOs and the NRS measuring pain and general health, physical and mental component summaries of the SF-36, the SF-6D and the HAQ-DI. After exclusion of zero-traders, the correlations were moderate and significant between either the interview TTO and the NRS measuring pain (r = −0.38) and general health (r = −0.42), the physical component summary of the SF-36 (r = 0.45), and the SF-6D (r = 0.45). In addition, moderate and significant correlations were found between either the computer TTO and the NRS pain (r = −0.47) and the HAQ-DI (r = −0.38) (Table ​(Table2).2). All other correlations remained non-significant after exclusion of zero-traders. Discriminative properties of both TTOs are shown in Table ​Table3.3. Both TTOs proved to have no discriminative value between worse and better health outcomes for all six outcome measures. Performing these analyses without the zero-traders resulted in larger and significant median differences in interview TTO scores between worse and better outcomes for the physical component summary of the SF-36 (difference in mean rank = 5.50), the NRS measuring pain (difference in mean rank = 5.83) and the SF-6D (difference in mean rank = 4.85). In addition, larger and significant median differences in computer TTO scores between worse and better outcomes were found for the NRS measuring pain (difference in mean rank = 6.30). No significant median differences in TTO scores between worse and better health outcomes were found for the other outcome measures.
Table 2
Table 2
Spearman’s correlations (95% confidence intervals) of interview TTO or computer TTO utilities with health outcome measures for the total sample and for the traders only
Table 3
Table 3
Discrimination of the interview and computer TTO between worse and better health outcomesa d
Discussion
This pilot study showed that the construct validity of both the interview TTO and computer TTO was poor in patients with RA when using measures of HRQol, general health, pain and functional status as reference measures. After exclusion of zero-traders from analysis, the results improved. This finding was expected, because zero-traders did not have a significantly different health status compared with traders. Indications of the poor convergent validity of the TTO were also found in other studies in RA and studies in other diseases [4-6,9,15-17]. In most of these studies it was unclear how many participants were zero-traders and whether they were in- or excluded. One study reported similar results when in- or excluding zero-traders from analysis [15]. In our study, we did not find the TTO to be discriminative for any of the health outcome measures used. Other studies found evidence for and against its discriminative ability [4,5,9,16]. Contradicting findings were found for pain and disease activity scores in patients with RA [4,5] and for functional status scores in patients with cardiovascular disease [9,16].
All these studies were found to have differences in the TTO procedure applied. This might explain the contradicting results regarding the discriminative ability of the TTO. Beside the mode of administration, studies differed in the time frame used (remaining life expectancy [4,5,16-18], time frame dependent on age group [6] or not mentioned [15]). Furthermore, some studies described the way in which people had to think about current health [16,17] and/or about the anchors perfect health [4,5,16] and death [16], whereas other studies did not [6,9,18]. One study used a symptom-free anchor (‘no angina’) instead of ‘perfect health’ [9]. In many studies it was stated that a visual aid was used, although no further information was given about its representation [4-6]. Besides, many studies did not report the precise method of elicitation (e.g. ping-pong) [4-6,9,18].
In our study, the TTO procedure applied was precisely described, facilitating the comparison with other studies. Strengths of this study were the fact that we used two different TTO assessments and that we used a broad set of PROs in a homogeneous population consisting of RA patients. A limitation of this study was the use of a small convenience sample.
There are several explanations possible for the results of our study, irrespective of the TTO procedure used. First, the low correlation with the SF-6D, another preference-based instrument, can be partly explained by the difference in perspective used to obtain utilities. SF-6D utilities are derived from the general public, so these scores represent a societal perspective. TTO scores were directly calculated from the patients’ preferences, representing a patient perspective. Secondly, except for the SF-36 and SF-6D, the comparators used in this study only measure one aspect (e.g. functional status) of the construct quality of life. Furthermore, except for the SF-6D, the comparators are descriptive which implies that valuations of health states are not assessed. With these measures patients are asked about their levels of impaired health or pain, whereas personal preferences toward their health state remain unrevealed. It is possible that people with the same health state report different utilities if they have different ‘aspirations’ [18]. Nease et al. illustrate this by the example that inability to walk ‘more than a city block’ does not have to be a limitation if someone does not desire to be active [18]. Therefore, it would be worthwhile to examine in future studies whether it is better to validate the TTO against individualized measures of personal preferences, such as the SEIQOL [19,20] or MACTAR [21]. Thirdly, it has been found that preferences are prone to biases inherently to the nature of the TTO, such as loss aversion. Loss aversion can be observed when a choice has to be made between ‘remaining the status quo’ (remaining in the current health state) and ‘accepting an alternative to it’ (trading off life years for perfect health). In that case people will evaluate the advantages and disadvantages of the alternative in terms of losses and gains [22]. The TTO asks people about their willingness to trade off life years (a loss) for optimal health (a gain) [23]. Because ‘losses loom larger than gains’ [22], people become reluctant to give up life years. This will result in higher utilities, as supported by findings of Van Osch et al. [24]. Furthermore, TTO utilities might be influenced by other factors that are unrelated to current health [15], such as family-related aspects, for example having children [2] or seeing grandchildren grow up [17]. Finally, the nature of the disease can influence utilities. Asking patients to trade off life years may feel unrealistic, because patients with RA do not perceive their disease as life-threatening [6]. Therefore, people may be less willing or not willing at all to trade off life years. Our results are indicative of this: irrespective of health, a relatively large number of participants were not willing to trade any life year for perfect health. For chronic illnesses such as RA there may be more realistic health-related anchors, for example ‘becoming dependent on others’ and ‘having increased physical limitations’, which were reported by RA patients to worry them [25,26]. It could be examined whether the validity of the TTO improves when changing the trade-off about dying earlier in other more realistic (health-related) trade-offs. The use of a ‘chained’ TTO procedure could also improve the validity of the TTO. In a chained procedure, the health state of interest is not directly compared with death but indirectly with the aid of an intermediate anchor health state [27-29]. A limitation is that a chained procedure is more complex, because it adds an additional step to the valuation process, possibly leading to extra noise [28]. Limited research has been performed on the chained TTO and has been mainly applied in temporary health states [28-30]. For chronic health states it has been shown that chained TTOs are systematically biased upwards (when the worst endpoint was varied) or downwards (when the best endpoint was varied), but that it is possible to correct for these biases [31]. However, the respondents were not patients, but healthy people and women at high risk for breast cancer. Research in chronically ill patients examining the validity of the chained TTO for chronic states is lacking.
Conclusions
In conclusion, both the standardised interview TTO and standardised computer TTO showed similar poor results regarding construct validity when using measures of HRQoL, general health, pain and functional status as reference measures. Possibly, the validity of the TTO can be improved by replacing the anchor ‘death’ by an anchor that is more realistic to RA patients. Future studies in which direct patient reported utilities are derived, could start with the development of a TTO instrument using realistic anchors for RA patients. This instrument could be validated against individualized measures of personal preferences, such as the SEIQOL or MACTAR instrument.
Competing interests
The authors declare that they have no competing interests.
Authors’ contributions
LB was the primary researcher, responsible for collection of data by administering the instruments, data analysis and writing the manuscript. LMABJ, ET and MAFJL were closely involved in designing the study, interpreting the results and revising the manuscript. All authors have read and approved the final manuscript.
Pre-publication history
The pre-publication history for this paper can be accessed here:
http://www.biomedcentral.com/1471-2474/13/112/prepub
Acknowledgements
We would like to thank the participants and the rheumatology department for their contribution to this study. We are also very grateful to André Brands, who programmed the computer TTO. This study was financially supported by a grant from the foundation: ‘Stichting Onderzoek en Zorgontwikkeling Reumacentrum Twente’.
References
  • Torrance GW, Thomas WH, Sackett DL. A utility maximization model for evaluation of health care programs. Health Serv Res. 1972;7:118–133. [PMC free article] [PubMed]
  • Arnesen T, Trommald M. Are QALYs based on time trade-off comparable? A systematic review of TTO methodologies. Health Econ. 2005;14:39–53. doi: 10.1002/hec.895. [PubMed] [Cross Ref]
  • Lenert LA, Cher DJ, Goldstein MK, Bergen MR, Garber A. The effect of search procedures on utility elicitations. Med Decis Making. 1998;18:76–83. doi: 10.1177/0272989X9801800115. [PubMed] [Cross Ref]
  • Tijhuis GJ, Jansen SJT, Stiggelbout AM, Zwinderman AH, Hazes JMW, Vliet Vlieland TPM. Value of the time trade off method for measuring utilities in patients with rheumatoid arthritis. Ann Rheum Dis. 2000;59:892–897. doi: 10.1136/ard.59.11.892. [PMC free article] [PubMed] [Cross Ref]
  • Bejia I, Salem KB, Touzi M, Bergaoui N. Measuring utilities by the time trade-off method in Tunisian rheumatoid arthritis patients. Clin Rheumatol. 2006;25:38–41. doi: 10.1007/s10067-005-1125-6. [PubMed] [Cross Ref]
  • Witney AG, Treharne GJ, Tavakoli M, Lyons AC, Vincent K, Scott DL, Kitas GD. The relationship of medical, demographic and psychosocial factors to direct and indirect health utility instruments in rheumatoid arthritis. Rheumatology. 2006;45:975–981. doi: 10.1093/rheumatology/kel027. [PubMed] [Cross Ref]
  • Lenert LA, Sturley A, Watson ME. iMPACT3: Internet-based development and administration of utility elicitation protocols. Med Decis Making. 2002;22:464–474. doi: 10.1177/0272989X02238296. [PubMed] [Cross Ref]
  • Sumner W, Nease R, Littenberg B. In: Proceedings of the Annual Symposium on Computer Application in Medical Care: 17–20 November 1991; Washington D.C. Clayton PD, editor. McGraw-Hill, Washington D.C; 1991. U-titer: a utility assessment tool; pp. 701–705.
  • Nease RF, Kneeland T, O'Connor GT, Sumner W, Lumpkins C, Shaw L, Pryor D, Sox HC. Variation in patient utilities for outcomes of the management of chronic stable angina: Implications for clinical practice guidelines. J Am Med Assoc. 1995;273:1185–1190. doi: 10.1001/jama.1995.03520390045031. [PubMed] [Cross Ref]
  • Centraal Bureau voor de Statistiek. Overlevingstafels 2006. Available from: http://www.cbs.nl. Accessed 17 december 2007.
  • Buitinga L, Braakman-Jansen LMA, Taal E, Van de Laar MAFJ. A computer Time Trade-Off: a feasible and reliable alternative for the interview Time Trade-Off in rheumatoid arthritis. Clin Exp Rheumatol. 2011;29:783–789. [PubMed]
  • Ware JE, Sherbourne CD. The MOS 36-Item Short-Form Health Survey (SF-36): I. Conceptual Framework and Item Selection. Med Care. 1992;30:473–483. doi: 10.1097/00005650-199206000-00002. [PubMed] [Cross Ref]
  • Brazier J, Roberts J, Deverill M. The estimation of a preference-based measure of health from the SF-36. J Health Econ. 2002;21:271–292. doi: 10.1016/S0167-6296(01)00130-8. [PubMed] [Cross Ref]
  • Fries JF, Spitz P, Kraines RG, Holman HR. Measurement of patient outcome in arthritis. Arthritis Rheum. 1980;23:137–145. doi: 10.1002/art.1780230202. [PubMed] [Cross Ref]
  • Maor Y, King M, Olmer L, Mozes B. A comparison of three measures: the time trade-off technique, global health-related quality of life and the SF-36 in dialysis patients. J Clin Epidemiol. 2001;54:565–570. doi: 10.1016/S0895-4356(00)00338-3. [PubMed] [Cross Ref]
  • Lalonde L, Clarke AE, Joseph L, Mackenzie T, Grover SA. Comparing the psychometric properties of preference-based and nonpreference-based health-related quality of life in coronary heart disease. Qual Life Res. 1999;8:399–409. doi: 10.1023/A:1008991816278. [PubMed] [Cross Ref]
  • Khanna D, Ahmed M, Furst DE, Ginsburg SS, Park GS, Hornung R, Tsevat J. Health values of patients with systemic sclerosis. Arthritis Rheum. 2007;57:86–93. doi: 10.1002/art.22465. [PubMed] [Cross Ref]
  • Nease RF, Tsai R, Hynes LM, Littenberg B. Automated utility assessment of global health. Qual Life Res. 1996;5:175–182. doi: 10.1007/BF00435983. [PubMed] [Cross Ref]
  • McGee HM, O'Boyle CA, Hickey A, O'Malley K, Joyce CRB. Assessing the quality of life of the individual: the SEIQoL with a healthy and a gastroenterology unit population. Psychol Med. 1991;21:749–759. doi: 10.1017/S0033291700022388. [PubMed] [Cross Ref]
  • O'Boyle CA, McGee H, Hickey A, O'Malley K, Joyce CRB. Individual quality of life in patients undergoing hip replacement. Lancet. 1992;339:1088–1091. doi: 10.1016/0140-6736(92)90673-Q. [PubMed] [Cross Ref]
  • Tugwell P, Bombardier C, Buchanan WW. The MACTAR patient preference disability questionnaire - An individualized functional priority approach for assessing improvement in physical disability in clinical trials in rheumatoid arthritis. J Rheumatol. 1987;14:446–451. [PubMed]
  • Kahneman D, Tversky A. Choices, values, and frames. Am Psychol. 1984;39:341–350.
  • Van Osch SMC, Wakker PP, Van Den Hout WB, Stiggelbout AM. Correcting biases in standard gamble and time tradeoff utilities. Med Decis Making. 2004;24:511–517. doi: 10.1177/0272989X04268955. [PubMed] [Cross Ref]
  • Van Osch SMC. The Construction of Health State Utilities. , ; 2007. PhD thesis. Leiden University Medical Center (LUMC), Leiden University, Department of Medical Decision Making.
  • Lempp H, Scott D, Kingsley G. The personal impact of rheumatoid arthritis on patients' identity: A qualitative study. Chronic Illn. 2006;2:109–120. [PubMed]
  • McPherson KM, Brander P, Taylor WJ, McNaughton HK. Living with arthritis – What is important? Disabil Rehabil. 2001;23:706–721. doi: 10.1080/09638280110049919. [PubMed] [Cross Ref]
  • Spencer A. The implications of linking questions within the SG and TTO methods. Health Econ. 2004;13:807–818. doi: 10.1002/hec.863. [PubMed] [Cross Ref]
  • Locadia MA, Stalmeier PFM, Oort FJ, Prins MH, Spranger MAG, Bossuyt PMM. A comparison of 3 valuation methods for temporary health states in patients treated with oral anticoagulants. Med Decis Making. 2004;24:625–633. doi: 10.1177/0272989X04271042. [PubMed] [Cross Ref]
  • Jansen SJT, Stiggelbout AM, Wakker PP, Vliet-Vlieland TPM, Leer JH, Nooy MA, Kievit J. Patients’ utilities for cancer treatments: A study of the chained procedure for the Standard Gamble and Time Tradeoff. Med Decis Making. 1998;18:391–399. doi: 10.1177/0272989X9801800406. [PubMed] [Cross Ref]
  • Johnston K, Brown J, Gerard K, O’Hanlon M, Morton A. Valuing temporary and chronic health states associated with breast screening. Soc Sci Med. 1998;47:213–222. doi: 10.1016/S0277-9536(98)00065-3. [PubMed] [Cross Ref]
  • Stalmeier PFM. Discrepancies between chained and classic utilities induced by anchoring with occasional adjustments. Med Decis Making. 2002;22:53–64. [PubMed]
Articles from BMC Musculoskeletal Disorders are provided here courtesy of
BioMed Central