Pharmacoepidemiologic methods are advancing with guidelines regarding good pharmacoepidemiologic practice [
Schneeweiss, 2009;
Stürmer et al. 2008] and adherence research [
Gwadry-Sridhar et al. 2009;
Cramer et al. 2007;
Peterson et al. 2007] only recently published. We report wide variability in the methods of prior studies that examine the relationship between osteoporosis treatment compliance and fracture risk. To help guide future research, we summarize our recommendations in the following paragraphs.
At minimum, we suggest that the ideal cohort study will: (1) use a new user design, (2) have a minimum 1-year baseline period to exclude prior drug exposure, (3) evaluate each drug class separately, and (4) adjust for fracture risk factors. We also recommend that studies consider restricting inclusion to individuals with at least two prescriptions filled, include switchers within the same drug class and drug efficacy, document the potential for immeasurable time bias, consider a period of drug onset prior to fracture identification, and provide a rationale for how compliance is quantified. Nested case—control studies require similar methodological considerations when selecting the source population that defines the nest. We recommend that case—control studies match cases to controls on: sex, drug class/ efficacy, index date and length of follow up. If a case—control study matches on age, we recommend matching within 1 year of age. Case—control studies should additionally control for baseline risk for fracture, such as age, prior fracture and comorbidity, in their analysis.
Baseline (lookback) period and restriction to new users
The new user design is essential when studying drug effects [
Schneeweiss, 2009;
Ray, 2003]. The most conservative method is to restrict inclusion to those with no prior osteoporosis treatment. However, when studying bisphosphonates, the most commonly prescribed agents, excluding those with prior bisphosphonate use and adjusting for use of other osteoporosis medications may be appropriate. Nonetheless, given that patients largely switch between agents due to adverse drug events or ineffectiveness of the first-line drug therapy, excluding any history of osteoporosis pharmacotherapy other than hormone therapy may be most prudent. All but the first two studies [
Huybrechts et al. 2006;
Caro et al. 2004] employed a new user design, suggesting that quality is improving over time.
The length of baseline period used to identify prior drug use is important because many patients who stop osteoporosis pharmacotherapy will reinitiate treatment after an extended gap [
Roughead et al. 2009;
Brookhart et al. 2007a;
Melo et al. 2006]. It is estimated that 30% of patients who discontinue osteoporosis pharmacotherapy, defined by a gap of 60 days or more, will reinitiate treatment within 6 months of discontinuation, and 40% will reinitiate osteoporosis treatment within 1 year of discontinuation [
Brookhart et al. 2007a]. We therefore recommend a minimum of 1-year baseline period to define incident users.
Switching between drugs and minimum drug exposure
Most patients switch between osteoporosis drugs due to adverse drug events [
Papaioannou et al. 2007]. Switching between agents may be permitted provided drug efficacy is interchangeable. Little evidence suggests that alendronate is more effective than risedronate, and thus switching between these agents may be appropriate [
Curtis et al. 2009;
Cadarette et al. 2008;
MacLean et al. 2008]. However, due to the varying mechanisms of action between therapies, one should take caution when evaluating individuals who switch between different therapy groups (e.g. bisphosphonate to raloxifene) [
MacLean et al. 2008;
Peterson et al. 2007]. Another option observed is to allow switching but control for the starting treatment regimen [
Huybrechts et al. 2006]. In addition, it may be prudent to restrict inclusion to those with a minimum of two drug dispensings. A single treatment dispensing could indicate no drug exposure, be attributed to unmeasured factors such as an adverse side effect that resulted in immediate drug discontinuation, or be a marker of competing illness or unmeasured frailty. Alternatively, filling more than a single prescription could be a marker of unmeasured healthy behaviors [
Brookhart et al. 2007b]. Given that there is little potential fracture reduction within the first 3–6 months of exposure [
Harrington et al. 2004;
Pols et al. 1999], including only patients with a minimum of two drug dispensings may better reflect the effects of drug compliance on fracture risk versus unmeasured factors attributed to only a single prescription.
Immeasurable time
In many healthcare utilization databases, drugs dispensed in hospital or long-term care may be covered by different drug plans and thus these data are not available for analysis. Periods of incomplete drug information is labeled ‘immeasurable time’, and may have an impact on estimated compliance [
Suissa, 2008]. For example, one may falsely associate poor compliance due to immeasurable time during hospitalizations with increased fracture rates. All studies that adjusted for immeasurable time assumed that patients were provided with and fully compliant to all medications during their hospital stay, and that previous supplies were continued upon discharge. This method is the most conservative approach because if patients did not receive therapy during hospitalization, then the association between better compliance and fracture reduction would be underestimated, particularly given that patients hospitalized may be the most frail and likely to fracture. Another strategy may be to assume no treatment during hospitalization and consider full coverage in a sensitivity analysis. The best method to adjust for potential immeasurable time is database specific and will depend on the extent of missing data. In addition to periods of missing drug data during hospitalization, some databases may be susceptible to immeasurable time if it is difficult to capture when drug coverage eligibility changes, such as eligibility for Medicaid. Although not all healthcare utilization databases are susceptible to immeasurable time, it is important to discuss potential immeasurable time and clarify when it is not relevant.
Drug exposure and method of compliance measurement
Each drug class used to treat osteoporosis (bisphosphonates, calcitonin, hormone therapy, raloxifene, strontium ranelate, teriparatide), has a unique mechanism of action on bone, require different dosing regimens, and differ in fracture reduction efficacy [
MacLean et al. 2008;
O'Donnell et al. 2006;
Cranney et al. 2002]. When considering the impact of compliance to osteoporosis treatment on fracture risk, it is thus important to consider differences in drug action and efficacy. Pharmacology is also important when considering how to examine the impact of compliance to osteoporosis medication on fracture risk. Osteoporosis medication largely works by improving bone mineral density (BMD) and thus strengthening bone to withstand minimal trauma. Some agents, such as raloxifene, impact BMD by reducing bone loss during drug exposure. The bisphosphonates not only reduce bone loss during drug exposure, but they increase bone mass and persist in bone with a long half-life. Given that bisphosphonates persist in bone, a threshold effect may be relevant [
Geusens, 2009]. However, most studies measured compliance over the entire follow-up period and defined compliance as a dichotomous variable (≥ 80%), and none defined this dichotomy based upon pharmacological or clinical evidence [
Andrade et al. 2006]. In one case—control analysis, it was determined that optimal fracture prediction was observed at a PDC threshold of 68% rather than the standard use of 80% [
Cotte et al. 2008]. Further, three studies utilized time-varying compliance [
Curtis et al. 2008b;
Penning-van Beest et al. 2008;
Briesacher et al. 2007] and one documented that a nontime-dependent analysis overestimated the effect of compliance on fracture risk [
Curtis et al. 2008b]. More research is important to help guide the use of appropriate cut points and this is currently being reviewed by ISPOR [
International Society for Pharmacoeconomics and Outcomes Research, 2009].
Fracture identification after a treatment onset period
Requiring a 3–6 month treatment-onset period prior to fracture identification permits time for bisphosphonates to increase BMD and strengthen bone [
Harrington et al. 2004;
Pols et al. 1999]. In addition, a treatment onset period may provide strength in ability to identify incident fractures distinct from follow up for prevalent fractures, particularly if fracture rates are identified based only on diagnostic codes. Another strategy to improve the validity of incident fracture rates may be to require diagnostic and procedural codes within a defined time period [
Ray et al. 1992].
Confounders
When studying the effect of any exposure on fracture risk, it is important to control for potential confounders. An independent risk factor for osteoporotic fracture is a confounder when its prevalence is imbalanced between drug compliance groups under comparison. By failing to control for a confounding factor, the confounder's effect on fracture risk is falsely attributed to drug compliance. Major risk factors for fracture include age over 65, sex, low BMD, low body weight, prior fracture, frailty/falls risk, and comorbidities or concomitant medications related to fracture risk. Calcium and vitamin D supplementation and weight-bearing exercise may also impact BMD and fracture risk. All cohort studies controlled for each of age, sex, and prior fracture, and at least one other comorbidity or drug. However, BMD, body weight, lifestyle factors and measures of frailty are typically not available in healthcare utilization databases, and were not included in the studies reviewed. Prior work identifies that better compliance to placebo reduces mortality [
Granger et al. 2005] and hip fracture risk [
Curtis et al. 2008b]. It is therefore plausible that potential residual confounding exists when studying adherence to osteoporosis treatment on fracture risk. However, recent data suggest that there may be less room for healthy adherer effects to bias results in a homogeneous cohort of frail seniors taking osteoporosis medication to reduce fracture risk [
Cadarette et al. 2010]. More research is needed to clarify the potential for healthy adherer bias to inflate the association between better compliance to osteoporosis pharmacotherapy and fracture risk reduction. Each of the 14 studies reviewed appropriately discussed limitations due to possible residual confounding, with more recent studies emphasizing the potential for healthy adherer bias. Theoretical sensitivity analyses that consider the extent of unmeasured confounding needed to explain results are encouraged [
Schneeweiss, 2006], and was completed in one study [
Blouin et al. 2008].
Future research directions
Future research is warranted to investigate when, or if, treatment with bisphosphonates may be discontinued without impacting fracture risk. Most papers included in this review considered the impact of compliance within 1–2 years; however, these therapies persist in bone for extended periods after treatment discontinuation [
Geusens, 2009;
Watts et al. 2008;
Rodan et al. 2004]. Perhaps the best, most-compelling evidence comes from the Fracture Intervention Trial Long-term Extension (FLEX) study. FLEX identified that the majority of women who discontinued treatment with alendronate after 5 years of therapy had no significant increase in morphometric vertebral fracture risk compared to those who continued treatment for up to 5 years post-treatment [
Black et al. 2006]. Recent post-hoc subgroup analyses, however, suggest that the effect depends on vertebral fracture history and BMD after 5 years of treatment: women with no vertebral fracture after 5 years of alendronate treatment, yet BMD T-score ≤ −2.5 were found to have lower nonvertebral fracture risk (relative risk = 0.50, 95% confidence interval = 0.26–0.96) after continuation of alendronate for an additional 5 years [
Schwartz et al. 2010]. Nonetheless, there was little evidence of nonvertebral fracture reduction among women with higher BMD levels or with prior vertebral fracture, and little difference in morphometric vertebral fracture risk was identified after an additional 5 years of alendronate treatment. Further research is important to clarify these findings. Evidence from a real-world cohort study found that the increased risk of hip fracture following discontinuation of bisphosphonates was attenuated among women with higher compliance (e.g. PDC ≥ 80% at 2 years), as well as with longer duration of treatment persistence before treatment discontinuation [
Curtis et al. 2008a]. It is not clear, however, how long a patient must persist with therapy or how compliant they need to be before a physician-directed drug holiday may be permitted. The next greatest challenge may thus not be how to quantify compliance and the impact of compliance on fracture risk in general, but rather to determine if, when, how long and among which patients a physician-directed drug holiday may be appropriate.