PMCCPMCCPMCC

Search tips
Search criteria 

Advanced

 
Logo of nihpaAbout Author manuscriptsSubmit a manuscriptHHS Public Access; Author Manuscript; Accepted for publication in peer reviewed journal;
 
Curr Drug Abuse Rev. Author manuscript; available in PMC 2013 February 7.
Published in final edited form as:
PMCID: PMC3566575
NIHMSID: NIHMS439646

Quantifying Reinforcement Value and Demand for Psychoactive Substances in Humans

Abstract

Behavioral economics is an emerging cross-disciplinary field that is providing an exciting new contextual framework for researchers to study addictive processes. New initiatives to study addiction under a behavioral economic rubric have yielded variable terminology and differing methods and theoretical approaches that are consistent with the multidimensional nature of addiction. The present article is intended to provide an integrative overview of the behavioral economic nomenclature and to describe relevant theoretical models, principles and concepts. Additionally, we present measures derived from behavioral economic theories that quantify demand for substances and assess decision making processes surrounding substance use. The sensitivity of these measures to different contextual elements (e.g., drug use status, acute drug effects, deprivation) is also addressed. The review concludes with discussion of the validity of these approaches and their potential for clinical application and highlights areas that warrant further research. Overall, behavioral economics offers a compelling framework to help explicate complex addictive processes and it is likely to provide a translational platform for clinical intervention.

Keywords: Addiction, Alcohol, Behavioral Economics, Delay Discounting, Demand, Drugs, Impulsivity, Nicotine, Reinforcement

Introduction

Drug addiction is one of the most recalcitrant and devastating afflictions of the human condition. Despite years of research, addiction remains a perplexing behavioral phenomenon and the available treatments are limited. Drug abuse treatments are largely based on the conceptualization that humans are rational agents, hard-wired to make decisions based on available information concerning the future consequences [e.g., 1]. Yet, once in the throes of addiction, an individual makes the choice to use a substance despite the knowledge that this choice will likely lead to negative outcomes (e.g., job loss, strained relationships, poor health). Indeed, despite ample first-hand experience with these causal relationships, the affected individual continues to make the same costly choice even in light of the known negative consequences. Although on the face of it, such drug-seeking behavior is irrational and incompatible with our understanding of human behavior, researchers have begun to make sense of pathological consumption patterns under a behavioral economics lens.

Behavioral economics is defined broadly here, as the attempt to predict how individuals allocate limited resources (e.g., costs: money, time, effort) to obtain a commodity, under varying environmental constraints (e.g., price, availability), [e.g., 2]. Behavioral economics brings together psychological and economic principles, based on the idea that organisms engage in behaviors because there is an expected utility or a reinforcing value to doing so (e.g., in humans, that drinking alcohol will relieve negative affect). Importantly, each decision has an associated cost in terms of consequences [e.g., 3], but this cost is subjectively appraised and can differ widely across individuals and circumstances. In other words, the reinforcing value of substances and the choices that stem from these valuations depend greatly on the individual and the context. When applied to addictive behaviors, behavioral economics offers a rich opportunity to investigate dynamic variations in the reinforcing value of drugs and associated choice behaviors.

A core concept in addiction is that a progressive change in decision-making occurs with regard to the psychoactive substance of interest. That is, as experience with a substance mounts, the individual appears to lose control over use and engage in the apparently irrational behavior of using a substance despite growing costs. In behavioral economic terms, the relative reinforcement of a substance becomes disproportionately high compared to other options [e.g., 2, 4]. How do these decision-making processes change across the trajectory of substance use, from early experimentation through regular controlled use and to full-blown dependence? Identifying these processes may help develop and inform effective treatment strategies. Here, we will review the theories and methods used in these behavioral economic analyses of substance use, and highlight some of the advances that have resulted. Although many behavioral economic principles have been developed and extensively applied in nonhuman research [e.g., 5, 68], we will focus only on methods used in studies with humans.

Objectives

  • 1)
    Present the behavioral economic nomenclature
  • 2)
    Describe behavioral economic models and concepts used in substance use research
  • 3)
    Review measures and tasks derived from those theoretical models, including those with real and hypothetical rewards.
  • 4)
    Examine sensitivity of behavioral economic tasks to variables related to drug use (e.g., duration of drug experience, current drug use status, acute administration and deprivation).
  • 5)
    Evaluate the overall utility of these tools and their potential clinical implications
  • 6)
    Suggest areas of future research

I. Behavioral Economic Nomenclature

The below table (Table 1) provides definitions of terms used in behavioral economics and in this paper.

Table 1
Common Terms Used in Behavioral Economics

II. Behavioral Economic Models, Conceptual Frameworks and Related Methods

Behavioral economic models integrate microeconomic theories with behavioral analyses such as reinforcement and operant conditioning which refer only to overt relations between behavior and the environment. The former conceptualize choice behavior as a competition between inferred motivational states within an individual [Picoeconomics; 9, 10, 11] whereby some utility function is maximized [i.e., rational theories 12, 13]. Additionally behavioral economics does not assume humans exhibit consistent preferences over time [10]. As such, behavioral economics employs a molar paradigm for understanding choice behavior that connects controlling variables or constraining conditions (e.g., price, availability) to aggregations of behavioral units (e.g., substance use over time), integrating environmental constraints and variability over time [14, 15]. In contrast, molecular approaches connect specific controlling, explanatory variables (causes) to each behavioral event (e.g., each instance of alcohol consumption) [16] and they assume that events that cause behavior must be temporally contiguous with the behavior [cf. 17]. Examples of molecular approaches include strict behavioral perspectives such as non-mediational input-output analyses that avoid inferences about the internal operations of the “black box” as well as approaches implicating more inferential psychological processes or variables between stimuli and single behavioral events (e.g., social learning, expectations for the effects of substances, conditioned and unconditioned responses, appetitive or aversive motivational states). Importantly, in accounting for large-scale behavior patterns, molar theories presume that controlling variables representing the temporally extended environment are present and actively influencing each behavioral unit [16].

Reinforcement and Operant Conditioning

The relationship between rate of responding and reinforcing effects is complex, but here we offer a general introduction of behavioral analyses to illustrate how these molecular approaches have informed molar-level behavioral economic concepts. According to reinforcement `theory', events or stimuli that follow a response are reinforcers if they increase (or punishers if they decrease) the probability of repeating the response. The reinforcing value (or “essential value”) of a drug at a given dose is defined by the slope of its demand curve [i.e., by how much responding it elicits across a range of response requirements; 18]. For example, cocaine at 1 mg/kg has one slope as the response requirement changes and cocaine at 2 mg/kg has a different slope as the response requirement changes. However, the relationship between drug responding and dose at any single response requirement is biphasic: at low doses, responding increases with dose, whereas at higher doses, responding declines with further increases in dose. One interpretation is that high doses are less reinforcing though several different explanatory mechanisms have been advanced to explain this relationship [e.g., 19]. For instance, higher doses may disrupt ability to respond (direct effects of the drug – sedation, hyperexcitation); additionally, satiation is more likely to occur at higher doses.

Learning theorists have more recently begun to adopt behavioral economic principles as a means for scaling the value of a reinforcer [18]. Indeed, the basic contingencies that characterize behavioral analyses tend to parallel the constraints (prices, budget) modeled in economic theories [12] and the foundation remains constant such that as unit price increases, consumption positively decelerates. The `unit price' can be conceptualized as a ratio of the response requirement to the dose of drug per ingestion. Although different response requirements and reinforcer magnitudes can comprise the same unit price, consumption remains relatively equal across the different combinations. As such, within a certain range of doses of drug, response requirement and reinforcer magnitude are said to be functionally equivalent because manipulating response requirement (e.g., doubling the effort) it is the same as manipulating reinforcer magnitude in the opposite direction (halving the reward) [3, 20].

Behavioral Theories of Choice

In addition to assessing direct constraints on access to substances, molar accounts of behavioral choice also consider availability of reinforcers other than substances and the constraints imposed on access to them [21]. Behavioral Theories of Choice (BTC) consider how an individual's behavior is allocated among a set of available activities. The relative effort put forth to gain access to a particular consequence (substance use) is broadly defined as the reinforcing value [21]. BTC offer a picoeconomic approach [c.f. 10] that largely overlaps with traditional behavioral economic theories, but emphasizes the relative value of a commodity (e.g., substance) when more than one reinforcer is concurrently available [22]. This ecological emphasis is well suited for addiction research because it parallels real life situations in which users choose from an array of alternate reinforcers [23]. BTC include principles of the Matching Law and Relative Reinforcing Efficacy (described below), as well as the economic axiom that consumption decreases as access or availability of a reinforcer decreases.

Matching Law

The matching law is a mathematical relationship that quantifies choice behaviors. Although it originates from operant conditioning, it may be considered a BTC insomuch as it attempts to explain choice behavior in the larger context, predicting direct proportion between all emitted behavior directed towards a particular activity (relative responding) and all obtained reinforcement (relative reinforcement rate) from that activity [24]. Although it did not originate from economic theory, the focus on responses in the context of concurrent reinforcements is analogous to the hyperbolic discounting models (described later) that do originate from economic theory [c.f. 25, 26, 27].

The matching law equates response ratios to reinforcer ratios and posits that strength and duration of reinforcement affects behavior, which in turn is reflected in the relative rate of response. The relationship is directly proportional such that higher rates of positive reinforcement result in higher relative response rates [24]. This is best described with concurrent reinforcement schedules. A subject is presented with three images—a slice of cherry pie, apple pie, and lemon pie—which the subject chooses by pointing to an image. These images are presented for a given length of time. After viewing the image (e.g., 30 seconds time block), if the rate of monetary reinforcement was 100% of 10 dollars awarded every thirty seconds a subject selected the apple pie image, 80% of 10 dollars (8$) for selecting lemon, and 50% of 10 dollars (5$) for selecting cherry, matching predicts that the response rate will be higher for selecting the apple pie image, and in direct proportion to the reinforcement rate. The time interval of image exposure can also be varied with similar predicted outcomes.

The matching law, in its simplest form, does not account for other factors (e.g., financial need, negative memory associations with apple pie) and it has been revised to take into account other factors such as reinforcer bias and under-matching [28, 29]. The equations for the original strict matching form (1) and the more generalized function (2) appear below. The latter function takes into account bias “b” of reinforcement and alterations to strict matching (a). When a =1 and b=1, as predicted by Herrnstein, it is considered strict matching. Undermatching (a <1) and overmatching (a > 1) is present when the response ratio is less or more extreme than predicted by matching, respectively.

equation M1

[30].

equation M2

[28]. Herrnstein's matching principle [30] creates a framework to empirically study choice behavior, but is not without criticism. McDowell notes, for instance, a failure to incorporate important variables such as reinforcer magnitude [29].Additionally, matching is strongest when using concurrent, variable-interval schedules, but becomes less so under different schedules of reinforcement. A failure to conform to the principle can signify that some reinforcers are not accounted for in the model [31]. For instance, in a closed, one-sided discussion about juvenile delinquency, participants received statements of agreement (“I totally agree with you.”) from confederates at independent, variable-interval schedules; participants' response to the reinforcement was operationalized as amount of attending behavior demonstrated (eye contact, body orientation). Results showed that matching was only likely in the first five minutes of discussion and thus highlights some of the limitations in pure application of matching law [32]. Although the underlying framework of this principle informs much of behavioral economics, there has been a call for more precision in application of the principle [33]. Accordingly, extensions and modifications of the original law have been formulated, though the underlying principle remains valid [29].

The concept of reinforcement has also been extended to describe ecologically realistic situations whereby individuals are faced with behavioral choices in the context of other factors such as probability of reinforcement and reinforcement value relative to other commodities [e.g., food; 34] and opportunity cost [35]. Central to behavioral economics is the basic relationship between price and consumption of a commodity, a tenant from which the demand curve is based. In its simplest form, the relationship is inversely proportional. That is, as price decreases consumption increases (see Table 1). In much the same way as the matching law has been modified to improve utility, the simple proportion between consumption and price below can be modeled in various ways (e.g. linearly, exponentially) as the parameters require [36, 45]. The second equation is a variant of Hursh and colleagues' (1988) where C is the predicted consumption at a unit price of P, L is the price intercept, parameter a determines the slope and parameter b determines acceleration of the resulting function.

equation M3

equation M4

Relative Reinforcing Efficacy (RRE), RRE represents an ecologically-minded conceptualization of decision making that attempts to account for diverse phenomena related to the strengthening effects of reinforcement [37]. Within the purview of addiction, RRE refers to the ability of a drug or drug dosage to maintain or strengthen a behavior relative to other consequences [37]. This theoretical construct is not intrinsic to a drug or dose, but instead results from interactions between the drug and numerous biological and environmental factors [38]. RRE can be assessed by quantifying the amount of behavior an individual is willing to expend to obtain a certain drug or dose, relative to other reinforcers or other drug doses [4]. Measures of reward value or demand use an independent, quantifiable metric such as time, money, or enjoyment to scale the value of a given commodity/reinforcer (substances, social activity) and these factors are highly relevant to the substance-user's real life decision-making. More specifically, RRE measures assume that humans' valuation of rewards is related to the frequency of engagement in a particular activity (the element most consistent with orthodox definitions of reinforcement) as well as their subjective appraisal of the activity (some events may be performed out of obligation or a temporary contingency). Indeed, the relative subjective pleasure associated with drug versus drug-free rewards is an important element in some reinforcement based theories of addiction that are rooted in contemporary neuroscience approaches which view the diminished pleasure associated with drug free rewards as contributing to increasing substance abuse and vulnerability to relapse [39, 40].

Measures and Tasks

The below assessment tools have been described as cost and time efficient, can be administered in clinical settings [4] and have been used to assess the relative value of multiple reinforcers, including nicotine [e.g., 41, 42], caffeine [e.g., 43], alcohol [e.g., 36], and food [e.g., 44].

The Monetary Choice Task [MCT; 45] provides researchers with a tool for assessing the extent to which social information (i.e., opportunity to view others), an evolutionarily-oriented reward, can be substituted for money. Hayden and colleagues [46] quantified the reward value of social information in humans by determining the extent to which viewing images of members of the opposite sex on a computer screen could be substituted for money. More specifically, participants are given the option of viewing a grey square accompanied by a 500ms sound wave of money pouring from a slot machine or a photograph of an individual of varying attractiveness accompanied by the same sound but for variable time duration. Admittedly, although social information (e.g., what others look like) is hugely important in social decision making, it is a far different type of “reward” from substance use. However, the MCT is sensitive to changes in an individual's valuation of non-monetary rewards (social information) relative to monetary rewards, and with additional research it may provide yet another behavioral task for measuring the reinforcement value of substances relative to other rewards.

The Multiple Choice Procedure [MCP], originally developed as a laboratory measure [47, 48] and later as a questionnaire [49], is intended to provide a relative reinforcing value for substances by determining the relationship between substance preferences and alternative reinforcers. This assessment tool considers both the magnitude of substance reinforcer (i.e., the dose) as well as the length of delay associated with the alternative reinforcer (e.g., money). More specifically, the MCP presents the participant with a series of discrete choices between a dose of a substance or an increasing amount of money (e.g., for each choice below, select whether you would prefer to receive the cigarettes – 1 pack - or the monetary value – 59 cents). Experimenters can choose to include a delay element by comparing participants' choices when money will be delivered immediately (today) and when money will be delivered after a delay (a week later). The crossover point (main outcome variable expressed in dollar value) is reached once the participant chooses the money over the substance [47] and higher values indicate higher relative reinforcement value for the substance. Following completion of the form, one of the participant's choices is then randomly selected and the substance or money is awarded. MCP data with several substances have also been successfully analyzed as behavioral economic demand curves [see 50].

The MCP has been used with a variety of substances including cocaine [51], sedatives [48], caffeine [52] cigarettes [47], MDMA [53], opiates [54], marijuana [55, 56], methylphenidate [57] and IV nicotine [58]. Moreover, responses appear sensitive to reinforcer magnitude [47, 51, 57], drug dependence [52] and deprivation [47]. Correia & Little [59] attempted to modify both the laboratory and survey forms of the MCP to study the relative reinforcing value of alcohol. Although both forms were related to alcohol use variables and were sensitive to manipulations in reinforcer delays, college students had higher cross-over points on the survey version compared to the laboratory version (i.e., sensitivity to the amount of alcohol available differed) and correlations between the two forms were not significant. To address concern regarding the reliability of the effects of reinforcer magnitude (alcohol dose) on the relative reinforcing effects of alcohol, Benson, Little, Henslee and Correia [60] increased the range of alcohol doses available on the MCP (3 instead of 2) and subsequently demonstrated increased reliability between the laboratory and survey versions of the MCP.

The revised Pleasant Events Schedule [PES; 61, 62] assesses the frequency of participation in (e.g., never = 0, occasionally = 1, often = 2) and amount of “enjoyment/pleasure “(e.g., mild = 0, moderate = 1, extreme = 2) derived from 330 different activities (e.g., going naked, social drinking, being with friends) in the past 30 days. The items are completed twice so that separate ratings are collected for activities that took place during use of substances and for activities that did not (i.e., 4 data points for each activity). To calculate the level of reinforcement derived, the frequency and enjoyment ratings are multiplied so that two scores are generated for each activity (i.e., ExF while using, ExF not using). A Relative Reinforcing Efficacy (RRE) index can then be calculated by dividing the total substance-related reinforcement score by the sum of the total substance-related and substance-free reinforcement scores. Amount of reinforcement derived from non-substance related activities on the rPES has been found to inversely correlate with alcohol and substance use quantity, frequency and related problems [61]. Additionally, binge drinkers systematically reported lower levels of reinforcement from substance-free activities on the rPES compared to non-binge drinkers [63]. Interestingly, heavy college student drinking is associated more closely with non-substance related peer and sexual activity (social rewards) and not with global deficits in substance-free reinforcement [64].

The Relative Behavioral Allocation and Enjoyment - Adolescent Reinforcement Survey Schedule-Substance Use Version [ARSS-SUV; 23] is a significantly shortened version of the rPES modified to include activities that are more relevant to adolescents and young adults. Specifically, it measures an individual's frequency of participation in 45 different activities over the past month as well as the amount of enjoyment derived from those activities. Increases in proportional reinforcement derived from non-substance related activities have been documented among college students who decreased their drinking 6 months following a single session intervention [23]. Additionally, the ARSS-SUV index has been correlated with number of drinks per week and demand intensity (consumption when drinks are free), derived from an Alcohol Purchase Task (described below), among a sample of undergraduates [4].

An individual's allocation of discretionary (non-obligatory) monetary expenditures for substance use, versus savings, can be used to measure the reinforcement value of a substance relative to other available reinforcers for purchase as well as assess temporal discounting of future rewards [i.e., savings are required to gain access to future rewards; 65]. Substance specific expenditure indexes, such as the Alcohol and Savings Discretionary Expenditure [ASDE] index [65], are computed by gathering information about income from financial documents (e.g., pay-stubs, tax returns, sales receipts) and using U.S. federal consumer expenditure surveys [66] as well as Time Line Follow Back Interviews [67] to help participants recall monetary income and expenditure patterns over the past year. Expenditures are then categorized into obligatory (e.g., rent, utilities) or discretionary subcategories (e.g., consumable goods, alcohol, tobacco). The ASDE index is calculated by subtracting the proportion of discretionary expenditures spent on alcohol from the proportion of discretionary expenditures put into savings over the past year. Scores can then be compared against a subject's resolution to abstain from the substance or to moderate use. A lower ASDE score is theorized to reflect a greater balance between short-term (substance now) and long-term (savings for later) monetary allocations which in turn suggests more moderate use of a substance [68]. Thus the ASDE functions to bridge reinforcement value (immediate reward – money actually spent on alcohol) with temporal discounting (savings as a delayed reward: retirement, college funds, vacations, home improvements).

Hypothetical purchase tasks have been created for alcohol [Alcohol Purchase Task; 36] and cigarettes [Cigarette Purchase Task; 69]. In these tasks, a scenario is described in which a participant has the opportunity to purchase a substance at varying cost amounts. The question asked in each scenario is essentially, “how many X (drinks) would you consume if they were Y amount (1$) each?” The scenario can be modified to assess demand at the state (consume right now) or trait (consume in general) level. Hypothetical purchasing was first assessed by utilizing `play' money for purchase during interviews [70], but proved to be time-consuming and ill adapted for larger testing [69]. Currently, short questionnaires (administered via computer or pencil and paper) are employed to model demand for substances as a function of unit price. Demand curves are then generated with specialized software to provide graphic displays of consumption of substances as a function of cost. Five distinct indices of demand can then be determined from such a curve [37]: Pmax (point at which consumption moves from being inelastic to elastic), Omax (maximum expenditure), breakpoint (first price to completely suppress consumption), intensity (consumption when unit is free), and elasticity (sensitivity of consumption to increasing price). Sensitivity of these tasks to substance use status, craving, withdrawal and intervention is discussed below. Intensity of alcohol demand, but not the other four indices, has been found to correlate positively with delay discounting [71].

Delay discounting (DD) refers to the devaluation of a reward as a function of time between the response and the delivery of the reward (i.e. 10$ now is `worth more' than 20$ a month from now) [26, 72, 73]. The methodology has been successfully applied across populations and substances, and measures used to assess the extent of discounting tend to correlate with level of habitual drug use as well as self-report measures of impulsivity and even offer insight into elements of behavioral control that are typically compromised in addiction [73]. This latter feature makes DD paradigms especially applicable to substance use and drug dependence, as impulsive choices and “loss of control” are hallmarks of addictive behavior [74]. It is important to note that unlike measures that assess demand and reward value of a commodity, DD measures the role of delay in the relative valuation of a reward and in particular how the value of a given reward changes as a function of delay.

Two models of delay discounting have been proposed—exponential and hyperbolic. The exponential model assumes a constant rate of devaluing—the value of the reinforcer decreases by the same proportion across time [e.g., 75]. However, current research indicates that a hyperbolic function is more empirically supported and provides a better fit to actual substance use patterns [7680]. The hyperbolic function assumes that the proportion of devaluation decreases across time. And with this decrease in devaluation, preference reversals [see 73; e.g., less money now vs. more money later; more money for less alcohol now vs. less money for more alcohol later]— that ostensibly reflect reduced capacity for decision making and behavioral control—can be identified. By way of example: Offer (a) is 10$ right now or 20$ in six hours. Offer (b) is 10$ in 100 hours or 20$ in 106 hours. An exponential model predicts no difference in discounting between offer a and offer b. However, a hyperbolic model predicts that for time intervals far enough in the future (e.g., 100 hours), the delay to reward affects discounting less than a sooner time interval (i.e., offer a, waiting 6 hours now). The difference is in when this interval is placed in time. More specifically, even though the differences in amount of money and the time interval are equal in offers a and b, the hyperbolic model assumes that waiting 6 hours now (offer a) factors more heavily on decision-making than waiting 6 hours a hundred hours from now (offer b),

The equation used, as developed by Mazur [81], is of the form:

equation M5

Where vt is the discounted value of the reinforcer at the delayed time, t; V is the objective value of the delayed reinforcer; and k is the derived constant that determines the rate (or degree) of discounting. Procedures used to derive the discount rate (k) will present subjects with a choice of an immediate reward (either hypothetical or actual) or a delayed, larger reward. Then the amount of immediate reward is adjusted until the two amounts are chosen equally often. Alternatively, some measures incorporate probabilistic elements and adjust the delay to reward (e.g. Experiential discounting Task). In one such permutation, a large hypothetical monetary reward was offered with varying probability versus an immediate, smaller reward [82]. There are also tasks that offer dual types of reinforcers, splitting choices between monetary rewards and various substances, such as alcohol [Alcohol vs. Money Task; 83], cocaine [Cocaine vs. Money Task; 84], and nicotine [Smoking Behavioral Choice Task; 79, 85, 86]. A task may forego monetary rewards altogether and only offer drugs as either immediate or delayed rewards [79, 85, 87]. Whichever the approach, each equivalence obtained—termed the indifference point—can be aggregated and plotted as an indifference curve, and then used to derive the rate of discounting. This point of indifference refers to the value at which the subject chooses either option equally, and no value difference is associated with the choice.

The Kirby [88] is a short 27-item questionnaire of delay discounting that asks participants to choose between larger amounts of money that could be received at a later time and smaller amounts that could be available immediately. Three different indifference point values are identified for small, medium and large delayed-reward amounts though no discount function can be calculated because of limited indifference points. The Kirby has been used in the context of both hypothetical [89] and real-reward [90] assessments and responses on the measure strongly correlate with discount functions derived from questionnaire based hypothetical measures of delay discounting.

The Experiential Discounting Task [EDT; 91] exposes participants to choice consequences in real time (i.e., during the assessment period) to model naturalistic choice contexts associated with delayed and immediate outcomes. Multiple blocks of choices are administered for each delay assessed (0, 15, 30 or 60 seconds) in which the participant chooses between 1) a standard amount of money that would be delayed with a set probability of actually being received (e.g., 40%), and 2) a changing amount of money with no delay that is completely certain. Participants make enough choices in each block until a point of indifference is reached (i.e., equal number of choices recorded for each option). The EDT is sensitive to sleep-deprivation [91], acute effects of alcohol consumption [92] and cigarette smoking status [Smokers vs Non-smokers; 93]. The task also features a probabilistic component for the delayed choice, which may also more realistically represent choice conditions outside the laboratory. Another benefit of this task is that it might be more suitable to assess state changes in impulsive choice, including changes related to acute drug administration or withdrawal [74]. Of note though, there is mixed evidence about the concordance between discounting measured on the “experiential” task and more conventional discounting tasks [9294].

One consideration in DD tasks has been whether behavior is different when rewards used in the task are real versus hypothetical. For practical reasons, it is often not possible to offer real rewards (e.g., illegal substances, large sums of money) in the laboratory, and therefore researchers often use hypothetical rewards. Several studies have directly compared DD behavior with real and hypothetical rewards, in the same subjects, andhave found little difference between the two [9599]. Thus, a single equation can accurately measure indifference curves with both hypothetical and actual outcomes and the two methods yield comparable results [69, 73]. In practice, using hypothetical rewards is more cost efficient and allows for assessment of delayed outcomes that take place far into the future, which may better reflect decisions regarding drug use.

Table 2 lists and describes the various behavioral economic tasks and methods discussed above based on the theoretical frameworks from which they were derived.

Table 2
List of Tasks and Measures

III. Context: Who, What, When

The context in which choices are evaluated and selected represents a strong and important influence on the decision making process. The current section addresses contextual factors that may influence assessment and subsequent interpretation of data from behavioral economic paradigms of substance use.

Reliability within individuals

In contrast to many personality based risk factors for addiction that are often conceptualized as immutable traits, behavioral economic measures largely presume that the relative value of a substance varies as a function of both visceral states (e.g., craving) and the availability of alternative reinforcers. As such, there are limited data regarding the reliability of these measures within individuals over extended periods of time. The reliability of monetary delay discounting was deemed adequate within smokers [95] and non-drug dependent individuals [100] over a one-week period, whereas other studies report only moderate reliability over periods of 6 weeks to 3 months [101, 102]. On the Alcohol Purchase Task, 4 out of 5 indices of demand had acceptable reliability in college students over a two-week test period [4]. Further research is needed to determine the amount of with-in subject heterogeneity that characterizes behavioral economic measures throughout the substance use trajectory. Additionally, it is important to identify factors that co-vary with changes in reward value for substances over time (e.g., smoking behavior).

Acute effects of substances on behavioral economic tasks

Several studies have examined the acute effects of substances on behavioral economic measures using placebo controlled acute drug administration designs. Alcohol consumption has been shown to either decrease discounting [103] or to have no effect [92, 104]. No alterations in discounting were observed following variable amounts of marijuana consumption [56]. Additionally, relative to the placebo and low dose (10mg) conditions, D-amphetamine (20mg) was found to reduce delay discounting [105]. Of note, administration of alcohol (0.8 g/kg) increased discounting in a study using the experiential discounting task, a real-time measure of delay discounting [92]. It is possible that the real-time assessment of discounting may better capture state measures of discounting, such as those related to acute drug administration.

Relatively few studies have examined the acute effects of other illicit drugs on behavioral economic indices. In participants with a history of poly-substance use, the anti-convulsant levetiracetam (4000mg) increased the cross over point on the MCP whereas diazepam (30mg) did not [106]. In another study, cannabis users received placebo, marijuana, triazolam, methylphenidate, or hydromorphone over five sessions in a procedure providing choices between the drug and money. Marijuana significantly increased the dollar value at which subjects choose drug over money on the Multiple Choice Procedure, but demand did not change with the other drugs [107]. In that study, participants did not receive the outcome of their choice (money or drug) until the last day of the study, and they received only one of their many choices. The authors speculated that the long delay between a choice and receiving the reinforcer contributed to the modest effects observed. Finally, in a study of non-dependent cocaine users, researchers found that alcohol consumption significantly increased participants' choice of cocaine over an alternative substance-free reinforcer (money) and thus increased the reinforcing value of cocaine [108].

Initial Abstinence, Deprivation and Craving

In an attempt to explain decisions made against one's self-interest, with subsequent experiences of being `out of control,' the Visceral Theory of Addiction (VTA) posits that `visceral factors' induce drive states (hunger, thirst, sexual desire, physical pain, moods, craving for a substance) that can interfere with volitional decision-making [109]. Although visceral factors are largely autonomic triggers, the choice to act is still founded in volition; hence, visceral factors render choices both volitional and autonomic (e.g., eating pie is a willful choice but hunger is not). Briefly, the model is based on two ideas: 1. acute visceral factors (e.g., craving to smoke) are conceived as powerful motivation states that disproportionately influence behavior (e.g., stopping to buy cigarettes), and often to the detriment of other goals (e.g., not arriving to work on time), and 2. individuals tend to discount the influence of visceral factors on behavior [109]. An extension of the VTA focuses solely on craving as the primary visceral factor leading to addiction [110, 111]. Although there are many theories regarding what craving is, the construct is of particular relevance to the current paper as discounting or neglect of future craving can impact initial use of a substance [112] and visceral factors (e.g., craving) can increase the demand for and inflate the relative value of a substance [e.g., 71, 113].

Several behavioral economic measures have demonstrated sensitivity to acute craving and deprivation states and to cue-elicited craving paradigms. For instance, self-reported craving, a confirmed index of deprivation, has been associated with delayed reward discounting and intensity of demand on the Alcohol Purchase Task [71, 113] and with greater relative value of alcohol on a money versus alcohol task [111]. Similarly, craving, urge and desire to use have been related to behavioral economics assessments of the relative value for opiates [112] and cigarettes [86, 114]. Several other studies have shown that short-term abstinence increases demand for substances. Within-subject designs have illustrated that nicotine deprivation, relative to ad-libitum smoking, is associated with increases in delay discounting of both money and cigarettes [115] and increased preference for immediate cigarettes over delayed money [116]. Additionally, deprivation from opiates, in opiate-dependent participants, increased discounting on a hypothetical purchase task for both money and heroin relative to the satiated state [117].

IV. Populations and Drug Types

Patterns of behavior also differ in drug users (e.g., never user, current user, ex-user; dependence, abuse, sober) compared to nonusers, and across drug types [e.g., nicotine, alcohol, illicit drugs; 74]. These differences may reflect either changes in reinforcing value of the substance or changes in reinforcing value of the drug relative to other reinforcers associated with repeated use and pathological consumption patterns or they may reflect pre-existing group differences.

BE measures between chronic users and never users and between drug types

Numerous studies have sought to determine whether behavioral economic tasks can discriminate between use status across several types of drug. In general, current substance users exhibit more discounting on behavioral economics tasks than never users or ex-users. For instance, heroin-users discount at significantly higher rates than never-users [79, 85, 87, 88, 118], and smokers discount more than nonsmokers (although ex-smokers resemble nonsmokers more than smokers) [87, 95, 119122], active amphetamine and heroin injectors more than never users [118], and crack cocaine users more than never users [123]. The only exception to this pattern has been with marijuana use [124, 125]. Interestingly though, Kollins [125] found that younger age of first marijuana use was associated with steeperdiscounting.

Behavioral economic measures by current users and ex users

Research attempting to distinguish between current and former users has yielded mixed results. Although current and ex users of cocaine [90, 126], alcohol [90] and marijuana [124] do not appear to have different discount rates, differences have been reported between current and past users of heroin and opium [79, 90] and heroin and amphetamines [118]such that current users evidence higher discount rates than ex users. In one study, current smokers discounted at the same rate as past smokers [87] whereas in another, current smokers discounted more [127]. It remains to be determined whether quitting use of a drug decreases the level of discounting.

BE measures between different types of drug use

Several studies have compared discount rates across samples of users of different substances of abuse. Bornavalova [89] found that crack-cocaine abusers discounted significantly more than heroin abusers after both groups abstained from their drugs for one week. Kirby and Petry [90] found that current and past cocaine abusers and heroin abusers discounted more than both nondrug users and current or past alcoholics (alcoholics did not differ from the controls). Finally, Businelle and colleagues [119] found that there were no differences in discounting among drug users who were dependent on one substance versus more than one substance at the same time. Although these findings suggest that discount rates may vary across users of different classes of drugs, numerous other variables could affect the behavior independently of the drug type, including but not limited to duration and chronicity of drug use, lifestyle factors, socioeconomic status and use of multiple drugs.

BE measures by different patterns of drug use

Discounting measures have been not only been used to compare substances users to controls, but also drug users with different levels of use. Heavy smokers show steeper discounting for money than chippers (those who smoke with regularity but do not develop nicotine dependence) [86], and discounting rates are positively correlated with daily nicotine intake [80, 128, 129]. Heavier smoking and higher nicotine dependence among adolescent smokers was associated with higher scores on measures of demand on the Cigarette Purchase Task [130]. At the same time, MacKillop and colleagues [71] reported that discounting did not vary in relation to number of alcoholic drinks per day in heavy drinkers who consumed between 18 and 60 drinks per week.

V. Validity of the Behavioral Economics Approach

To what extent does behavioral economics provide a valid model to explain addictive behavior? As discussed at the outset of this paper, the “problem” that a behavioral economics perspective purports to describe is the inherent irrationality of the addict, of engaging in behavior that results in detrimental consequences. As eloquently articulated by Rachlin [12], [see also 131], a behavioral economics model may shed light on this perplexing problem. Indeed, the separate constructs and measures used in behavioral economics (e.g., discounting, demand, relative reinforcing efficacy, savings and discretionary expenditures) each appear to have some predictive (e.g., treatment outcome, attrition, relapse, response to intervention), and external validity (e.g., convergent – correlated with measures of impulsivity and risk taking; divergent – lower in populations without substance dependence compared to those with substance dependence). Specific evidence for validity includes the observation that substance-dependent individuals discount more steeply than never users [132, 133]. As described above this applies to smokers [87], heavy drinkers [134] and opioid dependent individuals [88, 118]. Moreover, a recent meta-analysis of studies comparing delayed reward discounting between control groups and groups exhibiting addictive behavior confirmed that it is higher in the latter group and even higher among individuals who meet criteria for an addictive disorder [133]. With regards to construct validity (e.g., Alcohol Purchase Task - five distinct indices capture the theorized structure of the demand construct), it remains to be determined whether the measures presented in this review reflect perturbations in the same construct or whether they reflect different dimensions underlying related processes. Epstein and colleagues [135] posit that delay discounting and reinforcing value are closely related in that the two approaches share a common metric of unit price and both assess the same process but do so with different temporal characteristics. This interpretation would then suggest that discounting and demand tap the same construct but do so through a different means of assessment.

Several questions remain concerning the validity of these measures across substance s of abuse, phases of use and in the context of acute use as well as deprivation. Behavioral economic measures may be useful predictors of behavior controlled by only some drug classes and not others such as those with lower abuse potential [e.g., 133]. Additionally, the basic principles may apply differently depending on where the users are on the developmental trajectory (from occasional user to dependence). Finally, there is growing yet limited evidence that acute administration of drugs increases discounting [e.g., 92], and that cue-elicited craving [e.g., 113] and drug deprivation effects [e.g., 115, 116, 117] increase discounting as well as demand.

VI. Clinical Implications

Behavioral economic theories and the tools derived from them offer potential to inform and guide substance use intervention and treatment. They may help to identify individuals who are more vulnerable to problematic substance use or more resistant to treatment. For example, one study of heavy-drinking college students found that indices derived from an alcohol demand curve (i.e., maximum alcohol expenditure, sensitivity of consumption to increasing price) predicted alcohol treatment response 6 months later [136]. That is, students who demonstrated greater demand for alcohol at baseline (i.e., willing to pay more for a drink, less sensitive to increasing cost) were less likely to change their drinking behavior following the intervention. Furthermore, adolescents who discounted monetary rewards more on the Experiential Discounting Task were less successful in abstaining in a smoking cessation program [137]. Among a sample of adolescents enrolled in a clinical trial for marijuana abuse and dependence, delay discounting predicted several different treatment outcomes [138]. Also of note, even after controlling for nicotine dependence and sensation-seeking, delayed reward discounting (Monetary Choice Questionnaire) predicted days to first smoking lapse in a sample of heavy drinkers undergoing smoking cessation treatment [139]. Finally, greater discounting at baseline predicted smoking status (currently smoking) 24 weeks later in a treatment sample of post-partum women [140]. Together, these findings suggest that behavioral economic measures can potentially serve as a more implicit marker for treatment readiness and may help predict outcomes (percent days abstinent, time to relapse, treatment retention). Additionally, elevated scores could help clinicians identify higher-risk patients for specialized skill-building to increase inhibition, improve planning and decision making, heighten financial precautions and increase involvement in alternative non-substance related activities.

Behavioral economic methods may also be valuable in the assessment of treatment medications. As noted by Bickel and colleagues [141], changes in price sensitivity or elasticity of demand for a substance measured in the laboratory may provide proxies for the efficacy of drug abuse medications (e.g., methadone). Effective medications would be expected to shift (reduce) the demand for the abused drug as price increases. Demand curves can also be used to evaluate the relative motivation for substances versus other rewarding alternatives [141, 142]. For instance, adolescent smokers with lower motivation to change smoking behavior exhibited greater demand intensity (number of cigarettes consumed when free) on the Cigarette Purchase Task [130]. Behavioral economic measures of demand and elasticity may therefore provide an objective and sensitive index of motivation to reduce or abstain from substance use. Accordingly, systematic data on the relationship between behavioral economic indices and self-report measures of motivation to change behavior (e.g., quit or reduce substance use) would be valuable in the context of treatment.

Behavioral Theories of Choice and related tools may also inform prevention policy and interventions [143]. For instance, encouraging increased participation in alternative enjoyable, alcohol-free activities may help reduce actual alcohol consumption [36]. This idea was supported by a study in a nonclinical sample, in which increasing the number of available substance-free activities led to decreases in drinking [144]. In another study comparing the effects of contingency payments for 1 day versus 14 days of abstinence, adult smokers assigned to the latter condition demonstrated a larger increase in the amount of delayed hypothetical money they would accept over different cigarettes choices and were less likely to choose the smoking over the money option [145]. Additionally, the Alcohol Savings and Discretionary Expenditure index has proven to be sensitive in predicting resolutions across groups with variable drinking intensity (i.e., light, moderate, or heavy drinking), at follow-up times of one and two years, as well as among groups of problem drinkers who have and have not undergone interventions [65, 68, 146].

More recently, researchers have begun applying computer-based cognitive remediation strategies to target the executive dysfunction (poor planning, sequencing, inhibition) typically observed in chronic substance-dependent populations [see 147, 148]. For instance, in a sample of stimulant dependent individuals, those who received working memory training showed significantly reduced delay discounting compared to participants in the control condition [149]. Interestingly, one study has tested a substance abuse treatment intervention behaviorally targeting delay discounting [Advisor-Teller Money Manager; 150]. Participants who received individualized feedback about spending or substance use had significantly lower rates of delay discounting and less cocaine use over time, compared to controls. Furthermore, for the sample as a whole, steeper increases in delay discounting were associated with increased cocaine use (i.e., decreased abstinence) over time suggesting that changes in discounting predicted a return to drug use. This study provides promising evidence for the feasibility of designing treatment programs around the principles derived from behavioral economics and suggests that changes in discounting may be associated with changes in substance use.

Behavioral economic measures can also help elucidate decision making processes underlying behavioral addictions and other health-risk behaviors (e.g., binge eating, compulsive shopping; failure to protect against pregnancy or sexually transmitted diseases, riding with an intoxicated driver, sharing a needle) by quantifying the reinforcing value or discount rate for specific behaviors. Burgeoning research in the area of obesity suggests that application of behavioral economics tools may be useful in this regard [see 135]. For instance, obese women have demonstrated greater delay discounting than controls [151] and percent body fat has been associated with discounting for food, but not money [152]. Additionally, obese teenage smokers discount significantly more than non-obese teenage smokers which suggests that temporal discounting may be a trans-disease phenomenon [153].

Finally, some behavioral economic paradigms are starting to use non-monetary rewards that are specific to the addictive behavior under study (e.g., eating a food – binge eating disorder). Methods that assess response patterns to rewards specific to the behavior of interest have recently been developed to characterize decisions for hypothetical sexual activity [e.g., choice of different amount of sexual activity available after different delays or with different probabilities; 154]. One advantage of employing addiction-specific choice patterns over monetary outcomes is that impulsive decision making can be examined as it directly relates to the behavioral outcome of interest. Accordingly it is important to determine how behavior and addiction-specific response patterns are influenced by context (e.g., arousal, hunger, social environment) or whether they can be used to study ecologically valid behavioral outcomes (e.g., engagement in risky sex, binge eating). For intervention purposes, such measures could help identify at-risk individuals before they consistently engage in these risky behaviors or develop full-blown behavioral addictions (e.g., gambling, shopping).

VII. Recommendations for Future Research

Temporal sequencing

Most of the research on behavioral economics in drug abuse addresses relatively stable individual differences. However, there is evidence to suggest that these processes are dynamic and change throughout the drug use trajectory. As described above, with some forms of drug use, former users resemble nonusers on measures of discounting, indicating that the behavior may be influenced by the drug and return to baseline when the drug is removed. With other drugs, however, ex-users more closely resemble users, suggesting that in these cases, the discounting may reflect a pre-existing trait that contributed to the initial use of the drug. Further studies examining the time course of changes in discounting and demand among drug users will shed light on the question of whether drug use is a determinant, or a consequence of these traits [155].

Research with adolescents is ideal for exploring the role of discounting behavior across the developmental trajectory of substance use behavior. In a cross-sectional study comparing adolescent smokers (daily use), experimenters (no more than 3 cigarettes total for the first time in the past three months) and non-smokers, findings revealed that experimenters' rate of discounting did not significantly differ from that of current smokers but was higher than discounting rates observed for non-smokers [156]. Two longitudinal studies have examined the relationship between behavioral economic measures and substance use. Audrain-McGovern and colleagues [157] examined the likelihood of smoking progression from 9th to 11th grade in relation to involvement in substitute reinforcements including school-related clubs, perceived academic performance, and physical activity. In line with theories of relative reinforcing efficacy, they found a two-fold reduction in smoking among participants involved in other activities. Conversely, higher involvement in complementary reinforcers such as alcohol and drug use and peer smoking was related to increased likelihood of smoking progression over time. Whereas adolescents who were regular smokers exhibited steeper delay discounting at baseline, discounting did not directly predict smoking progression. Instead, delay discounting indirectly influenced smoking progression through its effects on complementary reinforcers such that adolescents with higher discounting rates had more involvement in complimentary reinforcers. Another study by the same research team measured cigarette smoking and delay discounting several times throughout the transition from adolescence to young adulthood [158]. Results indicated that delay discounting was stable over the time span and did not discriminate between the three different smoking trajectory groups identified with latent growth mixture modeling. These data suggest that delay discounting rate is more trait-like than state-like during the transition to young adult-hood and that despite being a strong predictor of smoking status and smoking patterns, does not appear to be altered by smoking (i.e., delay discounting is a facilitator of substance use). It remains to be determined how chronic drug use alters delay discounting rates and other behavioral economic measures. To what extent does the preexisting trait predict risk for use, escalation, or relapse, and to what extent does discounting change over the course of drug use?

Individual Differences

There is also much to be learned about individual differences in discounting and other behavioral economic measures. Sources of individual variability include personality variables, such as impulsivity [155, 159], neuroticism [160], extraversion [161] and sensation seeking [162]. Other contributing variables include psychiatric symptoms or psychopathology [163] and motives and outcome expectancies for substance use (e.g., enhancement, coping). There is also potential for research to identify genetic variants that influence discounting and other reward-related behaviors [e.g., 111]. Individual differences in delay discounting for instance may also map on to treatment preferences and inform treatment matching initiatives. In the context of a 12-week treatment of opioid dependence combined with contingency management, individuals with higher rates of DD at intake redeemed their voucher earnings significantly more often than participants who had lower rates of DD [164]. Additionally, in a treatment sample of cocaine-dependent outpatients, baseline DD predicted fewer days abstinent in a low-magnitude contingency management voucher condition (maximal value = $499/12 weeks) but this relation was not observed in a high-magnitude voucher condition (maximal value = $1995/12 weeks) [165].

Relation to emotion

Lastly, another fruitful avenue for research is the relation between reinforcing efficacy of drugs and mood state. In general, decision making abilities are influenced by emotional activation presumably because higher order cognitive functions (e.g., information processing, problem solving, task sequencing, mental flexibility) are less accessible. Negative emotions such as anxiety, tension and stressful life events likely increase the marginal utility of addictive goods and anticipation of future stress may result in increased immediate consumption [166]. Hirsch and colleagues [167] reported that participants high in extraversion discounted more steeply, but this effect was moderated by positive affect, such that individuals were even more likely to prefer an immediate reward when first put in a positive mood. Findings from a recent study also suggest that neuroticism interacts with unpleasant state affect in guiding decision making in a temporal discounting task such that among individuals higher in neuroticism, a larger reaction to a negative affect prime resulted in higher discounting rates than did a lesser reaction [160]. Additionally, induction of negative mood states was found to increase alcohol choice in the Multiple Choice Procedure among individuals reporting high levels of drinking-to-cope motives [168]. Affectively “hot” and “cold” decision making [see 169] appears to be captured by these measures and thus highlights the dynamic influence of cognitive and emotional interactions. These relationships between mood states, decision-making and the reinforcing effects of drugs and alcohol will likely further benefit from studies conducted in natural, non-laboratory environments that employ ecological assessments [see 170].

VIII. Conclusion

Throughout our review of the literature, it becomes apparent that the perspective offered by a behavioral economics view of drug abuse and addiction goes a long way toward answering questions reflecting the inherent irrationality of such behavior. Indeed, when viewed through a rational lens, the behavior manifested by those who abuse drugs just doesn't seem to make sense. Yet, the rapid growth of behavioral economics paradigms in recent years has demystified this behavior in many critically important ways. For instance, Rachlin's Relative Addiction Theory [12, 171, 172] suggests that the choices of addicted individuals may be considered rational depending on the time frame used to assess the utility maximization of a behavior [see also 166]. That is, choosing to consume drugs may offer the highest rate of return in the short run, especially in an environment deprived of sources of substance-free rewards, or among individuals with long histories of substance use who would experience little immediate utility from engaging in substance-free activities. Additionally, steep discounting may not always be an irrational choice, depending on the environment/learning history and the likelihood of obtaining the delayed reward. Hence, addiction might be viewed as a rational behavior in the short run, and prove irrational when viewed in the context of a longer time frame. Accordingly, addiction is irrational to the extent that substance users fail to make predictions and take actions that maximize reinforcement in the long run [12].

Moreover, and as discussed throughout this article, the data and resultant implications hold tremendous potential for shaping prevention, intervention, and even public policy efforts aimed at curtailing destructive substance use. As such, we strongly believe that the future is bright for implementation of behavioral economic approaches to the problem of addiction. It is our hope that this review will help provide researchers with an overview of the theories and tools needed to do so. No doubt though, many questions remain unanswered: To what extent can these methods be adapted for other health-risk behaviors or behavioral addictions? Can they serve as a reliable proxy for treatment motivation and outcomes? Can cognitive remediation strategies reduce discounting of future consequences and in turn reduce the addictive behavior? Furthermore, do behavioral economic indicators reflect stable personality traits and/or are they more state-like, shaped by drug use itself [see 173, 174, 175]? And to what extent do such relationships vary as a function of drug class or user status (e.g., experimenter vs. dependent user)? Future research will need to address these and other as yet unanswered questions. We believe that the potential that the behavioral economics stance brings to both theoretical and applied realms is great and should be built upon to stem the tide of these destructive behaviors.

Acknowledgements

This work was supported in part by the US National Institute on Alcohol Abuse and Alcoholism F31 AA018918 and the VA Office of Academic Affairs and Health Services Research and Development research funds. We also acknowledge Dr. David Epstein for providing consultation on behavioral analyses.

References

[1] Sloan FA, Wang Y. Economic theory and evidence on smoking behavior of adults. Addiction. 2008;103(11):1777–85. [PubMed]
[2] Vuchinich RE, Heather N. In: Choice, behavioural economics, and addiction. Vuchinich RE, Heather N, editors. Pergamon/Elsevier Science Inc; Amsterdam, Netherlands: 2003.
[3] Bickel WK, Hughes JR, De Grandpre RJ, Higgins ST, Rizzuto P. Behavioral economics of drug self-administration: A unit price analysis of cigarette smoking. Psychopharmacology (Berl) 1991;107(2):211–6. [PubMed]
[4] Murphy JG, MacKillop J, Skidmore JR, Pederson AA. Reliability and Validity of a Demand Curve Measure of Alcohol Reinforcement. Experimental and clinical psychopharmacology. 2009;17(6):396–404. [PubMed]
[5] Aparicio CF. Haloperidol, dynamics of choice, and the parameters of the matching law. Behavioural processes. 2007;75(2):206–12. [PubMed]
[6] Phillips PEM, Walton ME, Jhou TC. Calculating utility: preclinical evidence for cost-benefit analysis by mesolimbic dopamine. Psychopharmacology (Berl) 2007;191(3):483–95. [PubMed]
[7] Salamone JD, Correa M, Farrar AM, Nunes EJ, Pardo M. Dopamine, behavioral economics, and effort. Frontiers in behavioral neuroscience. 2009;3:1–12. [PMC free article] [PubMed]
[8] Soto PL, Grandy DK, Hursh SR, Katz JL. Behavioral economics of food reinforcement and the effects of prefeeding, extinction, and eticlopride in dopamine D 2 receptor mutant mice. Psychopharmacology (Berl) 2011:1–10. [PubMed]
[9] Ainslie G. Beyond microeconomics: Conflict among interests in a multiple self as a determinant of value. In: Elster J, editor. The multiple self. Cambridge University Press; Cambridge: 1986. pp. 133–75.
[10] Monterosso J, Ainslie G. The picoeconomic approach to addictions: Analyzing the conflict of successive motivational states. Addiction Research & Theory. 2009;17(2):115–34.
[11] Ainslie G. Picoeconomics: The strategic interaction of successive motivational states within the person. Cambridge University Press; 1992.
[12] Rachlin H. In what sense are addicts irrational? Drug Alcohol Depend. 2007;90:S92–S9. [PMC free article] [PubMed]
[13] Rachlin H. Four teleological theories of addiction. Psychonomic bulletin & review. 1997;4(4):462–73.
[14] Rachlin H. Molar Behaviorism. In: Fishman DB, Rotgers F, Franks CM, editors. Paradigms in behavior therapy: Present and promise. Springer; New York: 1988. pp. 77–105.
[15] Baum WA. Molar and molecular views of choice. Behavioural Processes. 2004;66(3):349–59. [PubMed]
[16] Vuchinich RE. Alcohol-Abuse as molar choice - An update of a1982 proposal. Psychology of Addictive Behaviors. 1995;9(4):223–35.
[17] Lacey HM, Rachlin H. Behavior, cognition and theories of choice. Behaviorism. 1978;6:177–202.
[18] Hursh SR, Silberberg A. Economic demand and essential value. Psychol Rev. 2008;115(1):186–98. [PubMed]
[19] Calabrese EJ. U-shaped dose response in behavioral pharmacology: Historical foundations. Crit Rev Toxicol. 2008;38(7):591–8. [PubMed]
[20] Hursh SR. Economic concepts for the analysis of behavior. J Exp Anal Behav. 1980;34(2):219–38. [PMC free article] [PubMed]
[21] Vuchinich RE, Tucker JA. Behavioral theories of choice as a framework for studying drinking behavior. J Abnorm Psychol. 1983;92(4):408–16. [PubMed]
[22] Vuchinich RE, Tucker JA. Contributions from behavioral theories of choice to an analysis of alcohol abuse. J Abnorm Psychol. 1988;97(2):181–95. [PubMed]
[23] Murphy JG, Correia CJ, Colby SM, Vuchinich RE. Using behavioral theories of choice to predict drinking outcomes following a brief intervention. Experimental and clinical psychopharmacology. 2005;13(2):93–101. [PubMed]
[24] Herrnstein RJ. On the law of effect. J Exp Anal Behav. 1970;13(2):243–66. [PMC free article] [PubMed]
[25] Rachlin H. Self-control. Behaviorism. 1974;2(1):94–107.
[26] Rachlin H, Green L. Commitment, choice and self-control. J Exp Anal Behav. 1972;17(1):15–22. [PMC free article] [PubMed]
[27] Vuchinich RE, Heather N. Choice, behavioural economics, and addiction. Pergamon Pr; 2003.
[28] Baum WM. On two types of deviation from the matching law: Bias and undermatching. J Exp Anal Behav. 1974;22(1):231–42. [PMC free article] [PubMed]
[29] McDowell J. On the falsifiability of matching theory. J Exp Anal Behav. 1986;45(1):63–74. [PMC free article] [PubMed]
[30] Herrnstein RJ. Formal properties of the matching law. J Exp Anal Behav. 1974;21(1):159–64. [PMC free article] [PubMed]
[31] Rachlin H. On the tautology of the matching law. J Exp Anal Behav. 1971;15(2):249–51. [PMC free article] [PubMed]
[32] Borrero JC, Crisolo SS, Tu Q, et al. An application of the matching law to social dynamics. J Appl Behav Anal. 2007;40(4):589. [PMC free article] [PubMed]
[33] Killeen P. The matching law. J Exp Anal Behav. 1972;17(3):489–95. [PMC free article] [PubMed]
[34] Hursh SR, Raslear TG, Shurtleff D, Bauman R, Simmons L. A cost-benefit analysis of demand for food. J Exp Anal Behav. 1988;50(3):419–40. [PMC free article] [PubMed]
[35] Bickel WK, DeGrandpre RJ, Higgins ST, Hughes JR. Behavioral economics of drug self-administration. I. Functional equivalence of response requirement and drug dose. Life Sci. 1990;47(17):1501–10. [PubMed]
[36] Murphy JG, MacKillop J. Relative reinforcing efficacy of alcohol among college student drinkers. Experimental and clinical psychopharmacology. 2006;14(2):219–27. [PubMed]
[37] Bickel WK, Marsch LA, Carroll ME. Deconstructing relative reinforcing efficacy and situating the measures of pharmacological reinforcement with behavioral economics: a theoretical proposal. Psychopharmacology (Berl) 2000;153(1):44–56. [PubMed]
[38] Stafford D, LeSage MG, Glowa JR. Progressive-ratio schedules of drug delivery in the analysis of drug self-administration: a review. Psychopharmacology (Berl) 1998;139(3):169–84. [PubMed]
[39] Koob GF. The neurobiology of addiction: a neuroadaptational view relevant for diagnosis. Addiction. 2006;101:23–30. [PubMed]
[40] Volkow ND, Fowler JS, Wang GJ. The addicted human brain: insights from imaging studies. J Clin Invest. 2003;111(10):1444–52. [PMC free article] [PubMed]
[41] Ray R, Jepson C, Patterson F, et al. Association of OPRM1 A118G variant with the relative reinforcing value of nicotine. Psychopharmacology (Berl) 2006;188(3):355–63. [PubMed]
[42] Shahan TA, Bickel WK, Madden GJ, Badger GJ. Comparing the reinforcing efficacy of nicotine containing and de-nicotinized cigarettes: a behavioral economic analysis. Psychopharmacology (Berl) 1999;147(2):210–6. [PubMed]
[43] Griffiths RR, Bigelow GE, Liebson IA. Reinforcing effects of caffeine in coffee and capsules. J Exp Anal Behav. 1989;52(2):127–40. [PMC free article] [PubMed]
[44] Epstein LH, Leddy JJ, Temple JL, Faith MS. Food reinforcement and eating: a multilevel analysis. Psychol Bull. 2007;133(5):884. [PMC free article] [PubMed]
[45] Deaner RO, Khera AV, Platt ML. Monkeys pay per view: adaptive valuation of social images by rhesus macaques. Curr Biol. 2005;15(6):543–8. [PubMed]
[46] Hayden BY, Parikh PC, Deaner RO, Platt ML. Economic principles motivating social attention in humans. Proceedings of the Royal Society B: Biological Sciences. 2007;274(1619):1751. [PMC free article] [PubMed]
[47] Griffiths RR, Rush CR, Puhala KA. Validation of the multiple-choice procedure for investigating drug reinforcement in humans. Experimental and clinical psychopharmacology. 1996;4(1):97–106.
[48] Griffiths RR, Troisi JR, Silverman K, Mumford GK. Multiple-choice procedure: An efficient approach for investigating drug reinforcement in humans. Behav Pharmacol. 1993;4(1):3–13. [PubMed]
[49] Chutuape MA, Silverman K, Stitzer ML. Survey assessment of methadone treatment services as reinforcers. The American Journal of Drug and Alcohol Abuse. 1998;24(1):1–16. [PubMed]
[50] Greenwald MK. Behavioral economic analysis of drug preference using multiple choice procedure data. Drug Alcohol Depend. 2008;93(1–2):103–10. [PMC free article] [PubMed]
[51] Jones HE, Garrett BE, Griffiths RR. Subjective and physiological effects of intravenous nicotine and cocaine in cigarette smoking cocaine abusers. J Pharmacol Exp Ther. 1999;288(1):188–97. [PubMed]
[52] Garrett BE, Griffiths RR. Physical dependence increases the relative reinforcing effects of caffeine versus placebo. Psychopharmacology (Berl) 1998;139(3):195–202. [PubMed]
[53] Tancer M, Johanson CE. The effects of fluoxetine on the subjective and physiological effects of 3, 4-methylenedioxymethamphetamine (MDMA) in humans. Psychopharmacology (Berl) 2007;189(4):565–73. [PubMed]
[54] Greenwald MK, Hursh SR. Behavioral economic analysis of opioid consumption in heroin-dependent individuals: Effects of unit price and pre-session drug supply. Drug Alcohol Depend. 2006;85(1):35–48. [PubMed]
[55] Greenwald MK, Stitzer ML. Antinociceptive, subjective and behavioral effects of smoked marijuana in humans. Drug Alcohol Depend. 2000;59(3):261–75. [PubMed]
[56] McDonald J, Schleifer L, Richards JB, de Wit H. Effects of THC on behavioral measures of impulsitivity in humans. Neuropsychopharmacology. 2003;28(7):1356–65. [PubMed]
[57] Stoops WW, Glaser PEA, Rush CR. Reinforcing, subject-rated, and physiological effects of intranasal methylphenidate in humans: A dose-response analysis. Drug Alcohol Depend. 2003;71(2):179–86. [PubMed]
[58] Jones HE, Griffiths RR. Oral caffeine maintenance potentiates the reinforcing and stimulant subjective effects of intravenous nicotine in cigarette smokers. Psychopharmacology (Berl) 2003;165(3):280–90. [PubMed]
[59] Correia CJ, Little C. Use of a multiple-choice procedure with college student drinkers. Psychology of Addictive Behaviors. 2006;20(4):445–52. [PubMed]
[60] Benson TA, Little CS, Henslee AM, Correia CJ. Effects of reinforcer magnitude and alternative reinforcer delay on preference for alcohol during a multiple-choice procedure. Drug Alcohol Depend. 2009;100(1–2):161–3. [PubMed]
[61] Correia CJ, Carey KB, Borsari B. Measuring substance-free and substance-related reinforcement in the natural environment. Psychology of Addictive Behaviors. 2002;16(1):28–34. [PMC free article] [PubMed]
[62] Correia CJ, Simons J, Carey KB, Borsari BE. Predicting drug use: Application of behavioral theories of choice. Addict Behav. 1998;23(5):705–9. [PubMed]
[63] Correia CJ, Carey KB, Simons J, Borsari BE. Relationships between binge drinking and substance-free reinforcement in a sample of college students: A preliminary investigation. Addict Behav. 2003;28(2):361–8. [PMC free article] [PubMed]
[64] Skidmore JR, Murphy JG. Relations between heavy drinking, gender, and substance-free reinforcement. Experimental and Clinical Psychopharmacology. 2010;18(2):158–66. [PubMed]
[65] Tucker JA, Vuchinich RE, Rippens PD. Predicting Natural Resolution of Alcohol-Related Problems: A Prospective Behavioral Economic Analysis. Experimental and clinical psychopharmacology. 2002;10(3):248–57. [PubMed]
[66] Vuchinich RE, Tucker J. The molar context of alcohol abuse. In: Green L, Kagel JH, editors. Advances in behavioral economics: Vol. 3. Substance use and abuse. Ablex; Norwood, NJ: 1996.
[67] Sobell LC, Sobell MB. Timeline Follow-back: A technique for assessing self-reported ethanol consumption. In: Allen J, Litten RZ, editors. Measuring alcohol consumption. Humana Press; Totowa, NJ: 1992. pp. 41–72.
[68] Tucker JA, Roth DL, Vignolo MJ, Westfall AO. A Behavioral Economic Reward Index Predicts Drinking Resolutions: Moderation Revisited and Compared With Other Outcomes. J Consult Clin Psychol. 2009;77(2):219–28. [PubMed]
[69] Jacobs EA, Bickel WK. Modeling drug consumption in the clinic using simulation procedures: demand for heroin and cigarettes in opioid-dependent outpatients. Experimental and clinical psychopharmacology. 1999;7(4):412–26. [PubMed]
[70] Petry NM, Bickel WK. Polydrug abuse in heroin addicts: a behavioral economic analysis. Addiction. 1998;93(3):321–35. [PubMed]
[71] MacKillop J, Miranda R, Jr., Monti PM, et al. Alcohol demand, delayed reward discounting, and craving in relation to drinking and alcohol use disorders. J Abnorm Psychol. 2010;119(1):106–14. [PMC free article] [PubMed]
[72] Ainslie G. Specious reward: A behavioral theory of impulsiveness and impulse control. Psychol Bull. 1975;82(4):463–96. [PubMed]
[73] Bickel WK, Marsch LA. Toward a behavioral economic understanding of drug dependence: delay discounting processes. Addiction. 2001;96(1):73–86. [PubMed]
[74] Reynolds B. A review of delay-discounting research with humans: relations to drug use and gambling. Behav Pharmacol. 2006;17(8):651–67. [PubMed]
[75] Meyer R. Preference over time. In: Keeney R, Raiffa H, editors. Decisions with Multiple Objectives: Preferences and Value Trade-Offs. Wiley; New York: 1976. pp. 473–89.
[76] Berns GS, Laibson D, Loewenstein G. Intertemporal choice-toward an integrative framework. Trends in cognitive sciences. 2007;11(11):482–8. [PubMed]
[77] Kirby KN. Bidding on the Future: Evidence Against Normative Discounting of Delayed Rewards. J Exp Psychol Gen. 1997;126(1):54–70.
[78] Kirby KN, Maraković NN. Modeling myopic decisions: Evidence for hyperbolic delay-discounting within subjects and amounts. Organ Behav Hum Decis Process. 1995;64(1):22–30.
[79] Madden GJ, Bickel WK, Jacobs EA. Discounting of Delayed Rewards in Opioid-Dependent Outpatients: Exponential or Hyperbolic Discounting Functions? Experimental and clinical psychopharmacology. 1999;7(3):284–93. [PubMed]
[80] Ohmura Y, Takahashi T, Kitamura N. Discounting delayed and probabilistic monetary gains and losses by smokers of cigarettes. Psychopharmacology (Berl) 2005;182(4):508–15. [PubMed]
[81] Mazur JE. An adjusting procedure for studying delayed reinforcement. In: Commons M, Mazur J, Nevin A, Rachlin H, editors. Quantitative analysis of behavior: Vol 5. The effect of delay and intervening events on reinforcement value. Erlbaum; Hillsdale: NJ: 1987. pp. 55–73.
[82] Rachlin H, Raineri A, Cross D. Subjective probability and delay. J Exp Anal Behav. 1991;55(2):233–44. [PMC free article] [PubMed]
[83] De Wit H, Chutuape M. Increased ethanol choice in social drinkers following ethanol preload. Behav Pharmacol. 1993;4(1):29–36. [PubMed]
[84] Higgins ST, Bickel WK, Hughes JR. Influence of an alternative reinforcer on human cocaine self-administration. Life Sci. 1994;55(3):179–87. [PubMed]
[85] Madden GJ, Petry NM, Badger GJ, Bickel WK. Impulsive and self-control choices in opioid-dependent patients and non-drug-using control patients: Drug and monetary rewards. Experimental and clinical psychopharmacology. 1997;5(3):256–62. [PubMed]
[86] Sayette MA, Martin CS, Wertz JM, Shiffman S, Perrott MA. A multi-dimensional analysis of cue-elicited craving in heavy smokers and tobacco chippers. Addiction. 2001;96(10):1419–32. [PMC free article] [PubMed]
[87] Bickel WK, Odum AL, Madden GJ. Impulsivity and cigarette smoking: delay discounting in current, never, and ex-smokers. Psychopharmacology (Berl) 1999;146(4):447–54. [PubMed]
[88] Kirby KN, Petry NM, Bickel WK. Heroin addicts have higher discount rates for delayed rewards than non-drug-using controls. J Exp Psychol Gen. 1999;128(1):78–87. [PubMed]
[89] Bornovalova MA, Daughters SB, Hernandez GD, Richards JB, Lejuez CW. Differences in impulsivity and risk-taking propensity between primary users of crack cocaine and primary users of heroin in a residential substance-use program. Experimental and clinical psychopharmacology. 2005;13(4):311–8. [PubMed]
[90] Kirby KN, Petry NM. Heroin and cocaine abusers have higher discount rates for delayed rewards than alcoholics or non-drug-using controls. Addiction. 2004;99(4):461–71. [PubMed]
[91] Reynolds B, Schiffbauer R. Measuring state changes in human delay discounting: an experiential discounting task. Behavioural processes. 2004;67(3):343–56. [PubMed]
[92] Reynolds B, Richards JB, de Wit H. Acute-alcohol effects on the Experiential Discounting Task (EDT) and a question-based measure of delay discounting. Pharmacology Biochemistry and Behavior. 2006;83(2):194–202. [PubMed]
[93] Reynolds B. The Experiential Discounting Task is sensitive to cigarette-smoking status and correlates with a measure of delay discounting. Behav Pharmacol. 2006;17(2):133–42. [PubMed]
[94] Lane SD, Cherek DR, Pietras CJ, Tcheremissine OV. Measurement of delay discounting using trial-by-trial consequences. Behavioural processes. 2003;64(3):287–303. [PubMed]
[95] Baker F, Johnson MW, Bickel WK. Delay discounting in current and never-before cigarette smokers: Similarities and differences across commodity, sign, and magnitude. J Abnorm Psychol. 2003;112(3):382–92. [PubMed]
[96] Hinvest NS, Anderson IM. The effects of real versus hypothetical reward on delay and probability discounting. The Quarterly journal of experimental psychology. 2010;63(6):1072–2010. [PubMed]
[97] Johnson MW, Bickel WK. Within-subject comparison of real and hypothetical money rewards in delay discounting. J Exp Anal Behav. 2002;77(2):129–46. [PMC free article] [PubMed]
[98] Lagorio CH, Madden GJ. Delay discounting of real and hypothetical rewards III: Steady-state assessments, forced-choice trials, and all real rewards. Behavioural processes. 2005;69(2):173–87. [PubMed]
[99] Madden GJ, Begotka AM, Raiff BR, Kastern LL. Delay discounting of real and hypothetical rewards. Experimental and clinical psychopharmacology. 2003;11(2):139–45. [PubMed]
[100] Simpson CA, Vuchinich RE. Reliability of a measure of temporal discounting. Psychological Record. 2000;50(1):3–16.
[101] Beck RC, Triplett MF. Test-Retest Reliability of a Group-Administered Paper-Pencil Measure of Delay Discounting. Experimental and clinical psychopharmacology. 2009;17(5):345–55. [PubMed]
[102] Ohmura Y, Takahashi T, Kitamura N, Wehr P. Three-month stability of delay and probability discounting measures. Experimental and clinical psychopharmacology. 2006;14(3):318–28. [PubMed]
[103] Ortner CNM, MacDonald TK, Olmstead MC. Alcohol intoxication reduces impulsivity in the delay-discounting paradigm. Alcohol Alcohol. 2003;38(2):151–6. [PubMed]
[104] Richards JB, Zhang L, Mitchell SH, De Wit H. Delay or probability discounting in a model of impulsive behavior: effect of alcohol. J Exp Anal Behav. 1999;71(2):121–43. [PMC free article] [PubMed]
[105] de Wit H, Enggasser JL, Richards JB. Acute Administration of d-Amphetamine Decreases Impulsivity in Healthy Volunteers. Neuropsychopharmacology. 2002;27(5):813–25. [PubMed]
[106] Feltner DE, Haig G. Evaluation of the subjective and reinforcing effects of diphenhydramine, levetiracetam, and valproic acid. J Psychopharmacol (Oxf) 2010;25(6):763–73. [PubMed]
[107] Lile JA, Kelly TH, Hays LR. The reinforcing, self-reported performance and physiological effects of Delta(9)-tetrahydrocannabinol, triazolam, hydromorphone, and methylphenidate in cannabis users. Behav Pharmacol. 2010;21(1):29–38. [PMC free article] [PubMed]
[108] Higgins S, Roll J, Bickel W. Alcohol pretreatment increases preference for cocaine over monetary reinforcement. Psychopharmacology (Berl) 1996;123(1):1–8. [PubMed]
[109] Loewenstein G. Out of control: Visceral influences on behavior. Organ Behav Hum Decis Process. 1996;65(3):272–92.
[110] Loewenstein G, Weber EU, Hsee CK, Welch N. Risk as feelings. Psychol Bull. 2001;127(2):267–86. [PubMed]
[111] Mackillop J, Menges DP, McGeary JE, Lisman SA. Effects of craving and DRD4 VNTR genotype on the relative value of alcohol: an initial human laboratory study. Behavioral and brain functions. 2007;3(11):1–12. [PMC free article] [PubMed]
[112] Badger GJ, Bickel WK, Giordano LA, et al. Altered states: The impact of immediate craving on the valuation of current and future opioids. J Health Econ. 2007;26(5):865–76. [PubMed]
[113] MacKillop J, O'Hagen S, Lisman SA, et al. Behavioral economic analysis of cue-elicited craving for alcohol. Addiction. 2010;105(9):1599–607. [PubMed]
[114] Perkins KA, Epstein LH, Grobe J, Fonte C. Tobacco abstinence, smoking cues, and the reinforcing value of smoking. Pharmacology Biochemistry and Behavior. 1994;47(1):107–12. [PubMed]
[115] Field M, Santarcangelo M, Sumnall H, Goudie A, Cole J. Delay discounting and the behavioural economics of cigarette purchases in smokers: the effects of nicotine deprivation. Psychopharmacology (Berl) 2006;186(2):255–63. [PubMed]
[116] Mitchell SH. Effects of short-term nicotine deprivation on decision-making: Delay, uncertainty and effort discounting. Nicotine & Tobacco Research. 2004;6(5):819–28. [PubMed]
[117] Giordano LA, Bickel WK, Loewenstein G, et al. Mild opioid deprivation increases the degree that opioid-dependent outpatients discount delayed heroin and money. Psychopharmacology (Berl) 2002;163(2):174–82. [PubMed]
[118] Bretteville-Jensen AL. Addiction and discounting. J Health Econ. 1999;18(4):393–407. [PubMed]
[119] Businelle MS, McVay MA, Kendzor D, Copeland A. A comparison of delay discounting among smokers, substance abusers, and non-dependent controls. Drug Alcohol Depend. 2010;112(3):247–50. [PMC free article] [PubMed]
[120] Mitchell SH. Measures of impulsivity in cigarette smokers and non-smokers. Psychopharmacology (Berl) 1999;146(4):455–64. [PubMed]
[121] Reynolds B, Richards JB, Horn K, Karraker K. Delay discounting and probability discounting as related to cigarette smoking status in adults. Behavioural processes. 2004;65(1):35–42. [PubMed]
[122] Bickel WK, Yi R, Kowal BP, Gatchalian KM. Cigarette smokers discount past and future rewards symmetrically and more than controls: Is discounting a measure of impulsivity? Drug Alcohol Depend. 2008;96(3):256–62. [PMC free article] [PubMed]
[123] Coffey SF, Gudleski GD, Saladin ME, Brady KT. Impulsivity and rapid discounting of delayed hypothetical rewards in cocaine-dependent individuals. Experimental and clinical psychopharmacology. 2003;11(1):18–25. [PubMed]
[124] Johnson MW, Bickel WK, Baker F, et al. Delay Discounting in Current and Former Marijuana-Dependent Individuals. Experimental and clinical psychopharmacology. 2010;18(1):99–107. [PMC free article] [PubMed]
[125] Kollins SH. Delay discounting is associated with substance use in college students. Addict Behav. 2003;28(6):1167–73. [PubMed]
[126] Heil SH, Johnson MW, Higgins ST, Bickel WK. Delay discounting in currently using and currently abstinent cocaine-dependent outpatients and non-drug-using matched controls. Addict Behav. 2006;31(7):1290–4. [PubMed]
[127] Yi R, Johnson MW, Giordano LA, et al. The effects of reduced cigarette smoking on discounting future rewards: An initial evaluation. The Psychological Record. 2008;58:163–74. [PMC free article] [PubMed]
[128] Epstein LH, Richards JB, Saad FG, et al. Comparison between two measures of delay discounting in smokers. Experimental and clinical psychopharmacology. 2003;11(2):131–7. [PubMed]
[129] Reynolds B. Do high rates of cigarette consumption increase delay discounting?:: A cross-sectional comparison of adolescent smokers and young-adult smokers and nonsmokers. Behavioural processes. 2004;67(3):545–9. [PubMed]
[130] Murphy JG, MacKillop J, Tidey JW, Brazil LA, Colby SM. Validity of a demand curve measure of nicotine reinforcement with adolescent smokers. Drug Alcohol Depend. 2011;113:207–14. [PMC free article] [PubMed]
[131] Monterosso J, Ainslie G. The behavioral economics of will in recovery from addiction. Drug Alcohol Depend. 2007;90(S1):S100–S11. [PMC free article] [PubMed]
[132] Ainslie G, Haendel V, Gottheil E, Druley K, Skodola T, Waxman H. Etiologic aspects of alcohol and drug abuse. Charles C. Thomas; Springfield, IL: 1983. The motives of the will; pp. 119–40.
[133] MacKillop J, Amlung MT, Few LR, et al. Delayed reward discounting and addictive behavior: a meta-analysis. Psychopharmacology (Berl) 2011;216(3):305–21. [PMC free article] [PubMed]
[134] Vuchinich RE, Tucker JA, Miller W, Heather N. Treating addictive behaviors. Plenum Press; New York: 1998. Choice, behavioral economics, and addictive behavior patterns; pp. 93–104.
[135] Epstein LH, Salvy SJ, Carr KA, Dearing KK, Bickel WK. Food reinforcement, delay discounting and obesity. Physiol Behav. 2010;100(5):438–45. [PubMed]
[136] Mackillop J, Murphy JG. A behavioral economic measure of demand for alcohol predicts brief intervention outcomes. Drug Alcohol Depend. 2007;89(2):227–33. [PubMed]
[137] Krishnan-Sarin S, Reynolds B, Duhig AM, et al. Behavioral impulsivity predicts treatment outcome in a smoking cessation program for adolescent smokers. Drug Alcohol Depend. 2007;88(1):79–82. [PMC free article] [PubMed]
[138] Stanger C, Ryan SR, Fu HY, et al. Delay Discounting Predicts Adolescent Substance Abuse Treatment Outcome. Experimental and Clinical Psychopharmacology. 2012;20(3):205–12. [PMC free article] [PubMed]
[139] MacKillop J, Kahler CW. Delayed reward discounting predicts treatment response for heavy drinkers receiving smoking cessation treatment. Drug Alcohol Depend. 2009;104(3):197–203. [PMC free article] [PubMed]
[140] Yoon JH, Higgins ST, Heil SH, et al. Delay discounting predicts postpartum relapse to cigarette smoking among pregnant women. Experimental and clinical psychopharmacology. 2007;15(2):176–86. [PubMed]
[141] Bickel WK, DeGrandpre RJ, Higgins ST. Behavioral economics: a novel experimental approach to the study of drug dependence. Drug Alcohol Depend. 1993;33(2):173–92. [PubMed]
[142] Hursh SR. Behavioral economics of drug self-administration: an introduction. Drug Alcohol Depend. 1993;33(2):165–72. [PubMed]
[143] Murphy JG, Correia CJ, Barnett NP. Behavioral economic approaches to reduce college student drinking. Addict Behav. 2007;32(11):2573–85. [PubMed]
[144] Correia CJ, Benson TA, Carey KB. Decreased substance use following increases in alternative behaviors: A preliminary investigation. Addict Behav. 2005;30(1):19–27. [PubMed]
[145] Yoon JH, Higgins ST, Bradstreet MP, Badger GJ, Thomas CS. Changes in the relative reinforcing effects of cigarette smoking as a function of initial abstinence. Psychopharmacology (Berl) 2009;205(2):305–18. [PubMed]
[146] Tucker JA, Vuchinich RE, Black BC, Rippens PD. Significance of a behavioral economic index of reward value in predicting drinking problem resolution. J Consult Clin Psychol. 2006;74(2):317–26. [PubMed]
[147] Bickel WK, Christensen DR, Marsch LA. A Review of Computer-Based Interventions Used in the Assessment, Treatment, and Research of Drug Addiction. Subst Use Misuse. 2011;46(1):4–9. [PMC free article] [PubMed]
[148] Bickel WK, Jarmolowicz DP, Mueller ET, Gatchalian KM. The Behavioral Economics and Neuroeconomics of Reinforcer Pathologies: Implications for Etiology and Treatment of Addiction. Current Psychiatry Reports. 2011;13(5):406–15. [PubMed]
[149] Bickel WK, Yi R, Landes RD, Hill PF, Baxter C. Remember the Future: Working Memory Training Decreases Delay Discounting Among Stimulant Addicts. Biol Psychiatry. 2011;69(3):260–5. [PMC free article] [PubMed]
[150] Black AC, Rosen MI. A money management-based substance use treatment increases valuation of future rewards. Addict Behav. 2010;36:125–8. [PMC free article] [PubMed]
[151] Weller RE, Cook Iii EW, Avsar KB, Cox JE. Obese women show greater delay discounting than healthy-weight women. Appetite. 2008;51(3):563–9. [PubMed]
[152] Rasmussen EB, Lawyer SR, Reilly W. Percent body fat is related to delay and probability discounting for food in humans. Behavioural processes. 2010;83(1):23–30. [PubMed]
[153] Fields SA, Sabet M, Peal A, Reynolds B. Relationship between weight status and delay discounting in a sample of adolescent cigarette smokers. Behav Pharmacol. 2011;22(3):266–8. [PMC free article] [PubMed]
[154] Lawyer SR, Williams SA, Prihodova T, Rollins JD, Lester AC. Probability and delay discounting of hypothetical sexual outcomes. Behavioural processes. 2010;84(3):687–92. [PubMed]
[155] De Wit H. Impulsivity as a determinant and consequence of drug use: a review of underlying processes. Addiction Biology. 2009;14(1):22–31. [PMC free article] [PubMed]
[156] Reynolds B, Fields S. Delay Discounting by Adolescents Experimenting with Cigarette Smoking. Addiction. 2012;107(2):417–24. [PMC free article] [PubMed]
[157] Audrain-McGovern J, Rodriguez D, Tercyak KP, et al. Applying a Behavioral Economic Framework to Understanding Adolescent Smoking. Psychology of Addictive Behaviors. 2004;18(1):64–73. [PubMed]
[158] Audrain-McGovern J, Rodriguez D, Epstein LH, et al. Does delay discounting play an etiological role in smoking or is it a consequence of smoking? Drug Alcohol Depend. 2009;103(3):99–106. [PMC free article] [PubMed]
[159] Smith AE, Martens MP, Murphy JG, et al. Reinforcing Efficacy Moderates the Relationship Between Impulsivity-Related Traits and Alcohol Use. Experimental and clinical psychopharmacology. 2010;18(6):521–9. [PubMed]
[160] Augustine AA, Larsen RJ. Affect regulation and temporal discounting: Interactions between primed, state, and trait affect. Emotion. 2011;11(2):403. [PubMed]
[161] Hirsh JB, Morisano D, Peterson JB. Delay discounting: Interactions between personality and cognitive ability. Journal of Research in Personality. 2008;42(6):1646–50.
[162] Skidmore JR, Murphy JG. The Effect of Drink Price and Next-Day Responsibilities on College Student Drinking: A Behavioral Economic Analysis. Psychology of Addictive Behaviors. 2011;25(1):57–68. [PMC free article] [PubMed]
[163] Melanko S, Leraas K, Collins C, Fields S, Reynolds B. Characteristics of psychopathy in adolescent nonsmokers and smokers: Relations to delay discounting and self reported impulsivity. Experimental and clinical psychopharmacology. 2009;17(4):258–65. [PubMed]
[164] Bickel WK, Jones BA, Landes RD, et al. Hypothetical Intertemporal Choice and Real Economic Behavior: Delay Discounting Predicts Voucher Redemptions During Contingency-Management Procedures. Experimental and Clinical Psychopharmacology. 2010;18(6):546–52. [PubMed]
[165] Washio Y, Higgins S, Heil S, et al. Delay discounting is associated with treatment response among cocaine-dependent outpatients. Experimental and Clinical Psychopharmacology. 2011;19:243–8. [PMC free article] [PubMed]
[166] Becker GS, Murphy KM. A theory of rational addiction. Journal of Political Economy. 1988;96(4):675–700.
[167] Hirsh JB, Guindon A, Morisano D, Peterson JB. Positive mood effects on delay discounting. Emotion. 2010;10(5):717–21. [PubMed]
[168] Rousseau GS, Irons JG, Correia CJ. The reinforcing value of alcohol in a drinking to cope paradigm. Drug Alcohol Depend. 2011;118(1):1–4. [PubMed]
[169] Heinz AJ, Beck A, Meyer-Lindenberg A, Sterzer P, Heinz A. Cognitive and neurobiological mechanisms of alcohol-related aggression. Nature Reviews Neuroscience. 2011;12(7):400–13. [PubMed]
[170] Bogg T, Finn PR. An ecologically based model of alcohol-consumption decision making: Evidence for the discriminative and predictive role of contextual reward and punishment information. Journal of studies on alcohol and drugs. 2009;70(3):446. [PubMed]
[171] Rachlin H. Self and Self-Control. Ann N Y Acad Sci. 1997;818(1):85–97.
[172] Rachlin H. The lonely addict. Reframing health behavior change with behavioral economics. 2000:145–66.
[173] Odum AL. Delay discounting: Trait variable? Behavioural Processes. 2011;87(1):1–9. [PMC free article] [PubMed]
[174] Odum AL. Delay Discounting: I'm a K, you're a K. J Exp Anal Behav. 2011;96(3):427–39. [PMC free article] [PubMed]
[175] Peters J, Buchel C. The neural mechanisms of inter-temporal decision-making: understanding variability. Trends in Cognitive Sciences. 2011;15(5):227–39. [PubMed]
[176] Roane HS, Falcomata TS, Fisher WW. Applying the behavioral economics principle of unit price to DRO schedule thinning. J Appl Behav Anal. 2007;40(3):529–34. [PMC free article] [PubMed]