Obsessive-compulsive disorder (OCD) is a highly heritable neuropsychiatric disorder, with risk to first-degree relatives much greater than for the general population (
1,
2). OCD may constitute part of a spectrum of disorders characterized by overlapping comorbidity, familiarity, and difficulties suppressing inappropriate repetitive behaviors (
2,
3). So far, attempts to identify contributory genes have met with limited success (
4). This may be because OCD comprises a heterogeneous illness that cannot easily be differentiated into genetically homogenous subgroups by using outward symptoms or signs (phenotypic markers). There is an ongoing search in psychiatry for intermediate markers of brain dysfunction (endophenotypes) that represent vulnerability markers for disease development and lie closer to the genetic origins of the disorder (
5). In the context of OCD, it has been hypothesized that impairments in motor inhibition and cognitive flexibility may be useful in this regard (
2,
6). Impairments in these domains have been identified in OCD patients with a variety of objective tests dependent upon integrity of frontal-striatal circuitry (
2,
7,
8). To date, studies have not assessed the performance of unaffected first-degree relatives of OCD patients—a vital step in the identification of putative endophenotypes (
5).
We assessed cognitive flexibility, motor inhibition, and decision making in unaffected first-degree relatives of OCD patients, patient probands, and matched healthy comparison subjects without a family history of OCD. Cognitive flexibility was assessed with the Intradimensional/Extradimensional Shift task, originally developed from the Wisconsin Card Sorting Test of frontal lobe integrity. This paradigm examines different components of attentional flexibility, including reversal learning, set formation, and the ability to inhibit and shift attention between stimulus dimensions (extradimensional shifting) (
9). Prior studies have demonstrated that extradimensional shifting is impaired in OCD but not in trichotillomania (
7,
8). Motor inhibition was assessed by using the Stop-Signal task, which provides a sensitive estimate of the time taken to internally suppress motor responses. This paradigm has been shown to be sensitive to motor impulsivity associated with attention deficit hyperactivity disorder, OCD, trichotillomania, and damage to the right inferior frontal gyrus (
8,
10). Decision making was assessed by using the Cambridge Gamble task, which is sensitive to abnormal decision making in substance abuse, mania, and frontal lesions (
7,
11-
13). Prior work has identified intact decision making in OCD using this task (
7). It was predicted that unaffected first-degree relatives may, like OCD patients themselves, show impaired cognitive flexibility and motor inhibition, thereby supporting such measures as trait markers.