Search tips
Search criteria 


Logo of nihpaAbout Author manuscriptsSubmit a manuscriptHHS Public Access; Author Manuscript; Accepted for publication in peer reviewed journal;
Arch Gen Psychiatry. Author manuscript; available in PMC 2013 July 17.
Published in final edited form as:
PMCID: PMC3713233

Reading Affect in the Face and Voice

Neural Correlates of Interpreting Communicative Intent in Children and Adolescents With Autism Spectrum Disorders



Understanding a speaker’s communicative intent in everyday interactions is likely to draw on cues such as facial expression and tone of voice. Prior research has shown that individuals with autism spectrum disorders (ASD) show reduced activity in brain regions that respond selectively to the face and voice. However, there is also evidence that activity in key regions can be increased if task demands allow for explicit processing of emotion.


To examine the neural circuitry underlying impairments in interpreting communicative intentions in ASD using irony comprehension as a test case, and to determine whether explicit instructions to attend to facial expression and tone of voice will elicit more normative patterns of brain activity.

Design, Setting, and Participants

Eighteen boys with ASD (aged 7–17 years, full-scale IQ >70) and 18 typically developing (TD) boys underwent functional magnetic resonance imaging at the Ahmanson-Lovelace Brain Mapping Center, University of California, Los Angeles.

Main Outcome Measures

Blood oxygenation level– dependent brain activity during the presentation of short scenarios involving irony. Behavioral performance (accuracy and response time) was also recorded.


Reduced activity in the medial prefrontal cortex and right superior temporal gyrus was observed in children with ASD relative to TD children during the perception of potentially ironic vs control scenarios. Importantly, a significant group X condition interaction in the medial prefrontal cortex showed that activity was modulated by explicit instructions to attend to facial expression and tone of voice only in the ASD group. Finally, medial prefrontal cortex activity was inversely related to symptom severity in children with ASD such that children with greater social impairment showed less activity in this region.


Explicit instructions to attend to facial expression and tone of voice can elicit increased activity in the medial prefrontal cortex, part of a network important for understanding the intentions of others, in children with ASD. These findings suggest a strategy for future intervention research.

Impairments in social communication are core features of autism spectrum disorders (ASD). Even high-functioning individuals with ASD who have advanced formal language skills (ie, phonology, morphology, and syntax) are impaired in pragmatics (ie, the social use of language in context).1 Understanding the communicative intentions of others is particularly difficult for individuals with ASD when nonliteral language is used, as in the case of irony.25

In everyday social interactions, appreciating irony is likely to require both attending to the speaker’s facial expression and tone of voice and integrating the information gleaned from these cues with the context of the situation at hand. Typically developing (TD) children are sensitive to affect conveyed through the human face and voice from very early on.6 Individuals with ASD, however, do not show the same early preference for faces7,8 and voices9,10 and often have difficulty extracting the affect expressed through these cues.1115 Accordingly, neuroimaging studies have found that individuals with ASD show reduced activity in brain regions that respond selectively to the face and voice. Specifically, children1618 and adults1923 with ASD typically exhibit hypoactivation of the lateral fusiform gyrus (FG), the so-called fusiform face area, when viewing faces and facial emotions. With regard to voice perception, adults with autism fail to show voice-selective activity in the superior temporal sulcus despite a normal response to nonvocal sounds.24 Other studies of higher-level abilities that build on face and voice perception, such as language and “theory of mind,” have shown reduced activity in prefrontal regions, ineluding the left inferior frontal gyrus25,26 and medial prefrontal cortex (MPFC).25,2729

Evidence is emerging, however, to suggest that individuals with ASD can show more typical levels of neural activity in regions important for processing facial and vocal emotions if task demands allow for more cognitive or explicit processing. In a prior functional magnetic resonance imaging study, we asked children and adolescents with ASD to perform 2 tasks.16,17 In the matching task, participants selected 1 of 2 facial expressions to match the emotion shown in a target face. In the labeling task, they picked 1 of 2 words to describe the target expression. The ASD group showed reduced activity in the FG relative to TD controls during the more automatic matching task but not during the more cognitive or explicit labeling task. Similarly, Critchley et al19 observed hypoactivation of the amygdala when adults with autism labeled the gender of emotional faces (implicit condition) but comparable activity when labeling the emotion in the same faces (explicit condition). In the domain of language, children with ASD activated right frontotemporal regions typically associated with prosodic processing30,31 when attention to intonational cues was integral to the task.5 However, when automatic processing of prosody was required, individuals with ASD showed abnormal electrophysiological responses relative to controls.32,33

Thus, there is some evidence to indicate that individuals with ASD may engage more normative neural networks when task demands require the explicit processing of emotion. However, in previous studies, facial and prosodic cues were presented in isolation. Little is known about the use of these cues in interpreting the communicative intent of others. We recently examined the role of prosody in understanding irony and found that individuals with ASD did activate regions recruited by TD controls when task demands required them to rely on the strong intonational cues provided.5 However, understanding the mental state of a speaker in a conversational setting typically also involves drawing on the important information conveyed through facial expression. As the number and complexity of available cues increases, children with ASD have been observed to make more errors in social perception, perhaps due to deficits in attention.34 Indeed, individuals with autism have demonstrated abnormal visual fixation patterns when viewing social scenes.35

The goals of this study were thus 2-fold. First, we sought to examine the neural correlates of inferring the communicative intent behind a potentially ironic remark in children with ASD using a naturalistic context where facial, prosodic, and contextual cues were available. Second, and perhaps most importantly, we examined whether explicit instructions to attend to facial expression and tone of voice would elicit more normative activation patterns in children and adolescents with ASD.

Based on the results of a recent study using the same paradigm with TD children and adults,36 we expected scenarios involving irony detection to elicit greater activity in the MPFC and superior temporal gyrus (STG) than scenarios containing only literal utterances in TD children. Given behavioral research indicating that individuals with ASD are more likely than controls to interpret an ironic utterance literally,37 we expected less selective activity for potentially ironic scenarios compared with unambiguous scenarios in the ASD group. We further predicted that explicit directions to attend to important social cues would yield increased activity in regions important for processing emotion or intent in the ASD group. In contrast, the TD group should exhibit high levels of activity in these networks regardless of task instructions. Based on previous research described earlier, candidate regions for showing the predicted group × condition interaction include the MPFC, FG, amygdala, and frontotemporal networks.



The ASD group comprised 18 right-handed boys with a mean (SD) chronological age of 12.5 (3.0) years (range, 7–17 years) and a mean (SD) receptive language age of 13.4 (4.9) years (range, 7–22 years) measured by the Peabody Picture Vocabulary Test, third edition.38 Participants were recruited through the Autism Evaluation Clinic at the University of California, Los Angeles and flyers posted at regional centers throughout Los Angeles. A diagnosis of ASD was established using the Autism Diagnostic Observation Schedule39 and the Autism Diagnostic Interview–Revised40 and supported by expert clinical opinion following DSM-IV criteria. We used the Social Responsiveness Scale41 to evaluate the severity of social impairment, although this information was not obtained for 3 participants. All of the subjects had fluent language skills (based on parental report and direct observation during the Autism Diagnostic Observation Schedule) and a full-scale IQ higher than 70 based on the Wechsler Abbreviated Scale of Intelligence,42 which has recently been shown to have excellent predictive accuracy for high-functioning individuals with autism, even for those with an atypical subtest profile.43 Participants had no reported history of neurological disorders (eg, epilepsy), psychiatric disorders other than autism (eg. schizophrenia, attention-deficit/hyperactivity disorder [ADHD]), or structural brain abnormalities.

For the comparison group, 18 right-handed TD boys (mean [SD] age, 11.8 [1.9] years; range, 9–15 years) were recruited from the community through flyers posted at the university and in the Los Angeles area. None had a history of head trauma or medical, neurological, or psychiatric disorders, including ADHD, according to parental report. The Social Communication Questionnaire44 was used to screen for the presence of autistic symptoms.

The ASD and TD groups did not differ significantly in chronological age, performance IQ, or full-scale IQ (Table 1), although the mean verbal IQ (VIQ) was higher in TD children than in children with ASD (t1,34=2.9, P=.007, Cohen d>0.90; for all other comparisons, P>. 10). Seven participants with ASD were receiving psychotropic medications (including selective serotonin reuptake inhibitors, stimulants, and new-generation neuroleptics). We performed all of the analyses without these subjects and found that the pattern of results remained the same. As such, we report the findings with the full sample of 18 subjects in each group. Participants and their parents gave written informed consent to participate in the study according to the guidelines of the institutional review board. Subjects were paid $25 per hour (up to $75) for participating.

Table 1
Subject Characteristics


Participants viewed cartoon drawings of children in conversational settings while listening to short vignettes ending with a potentially ironic remark (Figure 1). Each scenario had an ironic version and a sincere version that shared the same neutral setup. The ironic ending contained an undesirable outcome and a final remark uttered in a clearly ironic tone of voice. The sincere ending had a positive outcome with a final comment made in a sincere, complimentary tone of voice. Following the sincere or ironic comment, participants decided whether the speaker really meant what he or she said. Yes or no judgments were indicated on a handheld response pad. Instructions were clear that a yes response should be given for a sincere comment that should be taken literally, whereas a no response should indicate an ironic remark that meant the opposite of what was said. Participants were shown examples of sincere and ironic scenarios not used during the scan and all answered correctly.

Figure 1
Example scenario. The setup (top) is shared by both the sincere and ironic versions of the scenario. The sincere ending is shown at the bottom left, and the ironic ending is displayed at the bottom right. The text below the drawings represents the accompanying ...

To verify that the final comments sounded sincere or ironic as intended, 12 adult volunteers listened to the remarks presented without the surrounding context and rated them on a scale of 1 to 7 (1 was the anchor for ironic and 7 for sincere or complimentary). Mean (SD) ratings were 1.4 (0.7) for ironic remarks and 6.6 (0.7) for sincere comments. Sincere and ironic versions of each scenario were matched in terms of syntactic structure, semantic complexity, and length. To examine the neural circuitry underlying the interpretation of irony per se, we also included a no irony condition comprising scenarios ending in straightforward, unambiguous remarks (eg, “Ashley and Zack are riding their bikes. When it starts to get dark out, Ashley says, ‘Let’s go home.’”) These remarks were not easily interpretable in a non-literal light and were made in a neutral tone of voice. All of the scenarios were tested previously in 12 normal adults and 12 TD children in a study of developmental change in the neural basis of interpreting communicative intent.36


Four activation blocks were interspersed with 5 rest periods. The first 3 blocks each contained 6 different scenarios (3 ironic, 3 sincere) ending in a potentially ironic remark (eg, “Thanks a lot!”). Instructions given before the first block were simply to pay attention (neutral instructions condition). Before the second and third blocks, participants were told to pay attention to the facial expression (attend face condition) or to the tone of voice (attend prosody condition). We chose to put the neutral instructions condition first to be able to examine participants’ natural response to potentially ironic scenarios without any carryover effect of instructions to attend to a specific cue. The order of instructions to attend to the face or voice in the second and third blocks was counterbalanced across subjects. The fourth and last activation block comprised 6 no irony control scenarios ending in an unambiguous statement (eg, “Please pass the crayons.”). To avoid any specific item effects, scenarios were used equally often in each of the 3 irony conditions across subjects. Furthermore, participants saw only 1 version (sincere or ironic) of each scenario. There were 18 potentially ironic and 6 control scenarios in all; each lasted 15 seconds. Activation blocks were interspersed with 21-second rest periods for a total length of 7 minutes 45 seconds. Response times and accuracy were recorded during scanning.


Images were acquired on an Allegra 3-T scanner (Siemens Medical Systems, Malvern, Pa). A T2-weighted sagittal scout was used to prescribe the planes of the functional images and rule out structural abnormalities. For each subject, the functional data were 155 whole-brain axial volumes collected parallel to the anterior-posterior commissure line using a gradient-echo, echoplanar imaging sequence (repetition time, 3000 ms; echo time. 25 ms; 3-mm section thickness with 1-mm gap; 64 × 64 matrix size; field of view, 20 cm). A coplanar, high-resolution structural volume was also acquired using echo-planar imaging (repetition time, 5000 ms; echo time, 33 ms; 128 × 128 matrix size; field of view, 20 cm). No between-group differences were observed in mean head motion detected during the functional scan.


Imaging data were analyzed using SPM99 (Wellcome Department of Cognitive Neurology, London, England; Functional images were realigned to correct for head motion, spatially transformed into a Talairach-compatible atlas for intersubject averaging,45 and smoothed (6-mm full-width half-maximum isotropic gaussian kernel) using Automated Image Registration.46 For each subject, condition effects were estimated according to the general linear model using a 6-second delayed boxcar reference function. Response time and accuracy scores collected during scanning were entered as regressors to ensure that differential activation observed between conditions or groups were not due to differences in task difficulty. The resulting contrast images were entered into group analyses using a random-effects model to allow for population-level inferences.47 Results were initially explored using liberal thresholds of P<.05 uncorrected for multiple comparisons for both magnitude and spatial extent. However, we consider significant and discuss only those activations that survived a more stringent extent threshold of P<.05 corrected for multiple comparisons at the cluster level (at least 115 contiguous voxels) with peaks of regional activity having a magnitude of t greater than 2.57 at the voxel level. For each group, 1-sample t tests were conducted to identify clusters of significant activity for each condition. Between-group differences were examined using 2-sample t tests within regions where significant activation was detected in either group across all conditions. This was accomplished by creating an image file for each group consisting of significant activity across all activation conditions vs rest and combining these images to create an inclusive mask.

Because verbal ability was higher in the TD group than in the ASD group, we used analyses of covariance to confirm that any between-group differences observed were not driven by differences in VIQ. For children with ASD, a multiple regression was conducted to identify regional activity associated with symptom severity controlling for VIQ. Based on previous research, regions implicated in reasoning about others’ intentions (ie, MPFC. superior temporal sulcus, and temporal poles) and processing facial expression (ie, FG, amygdala, and superior temporal sulcus) and tone of voice (frontotemporal networks) were considered regions of interest. Within these regions for which we had a priori hypotheses, we used a small volume correction to test for significance using a sphere with an 8-mm radius centered at the local maxima (corresponding to a minimum of 55 contiguous voxels).48 To assess the robustness of our findings, effect sizes were computed for all of the significant between-group differences. All of the effect sizes exceeded the traditional benchmark qualifying large effect (ie, Cohen d>0.80).



No significant between-group differences were observed for response time or accuracy, defined as the proportion of correct responses divided by total responses, either overall or in any of the conditions (Table 2) (P>.10; data unavailable for 1 participant with ASD). However, across all irony conditions, children with ASD answered significantly fewer questions correctly than children in the TD group (ASD group: mean [SD] number of correct answers, 16.1 [1.0]; median, 16; TD group: mean [SD] number of correct answers, 17.1 [1.4]; median, 18; F1,33=6.95, P = .01). This reflects the fact that children with ASD had a significantly greater number of no responses than TD children (t33=2.71, P = .01). Although participants in the ASD group did not differ from controls in the accuracy of their judgments when they responded, the greater number of no responses may reflect more difficulty inferring the communicative intent of the speaker.

Table 2
Behavioral Performance

Accuracy was positively correlated with VIQ in both the ASD (r15=0.51, P = .04) and TD (r16=0.48, P=.04) groups. Because the number of correct responses differed significantly between the groups, we used regression analyses to probe for a relationship between this variable and brain activity and found no significant correlations in any of our regions of interest.


Effect of Irony

To examine the networks specific to processing irony, we compared the activity summed across the 3 irony conditions (neutral instructions, attend to face, attend to prosody) with the no irony condition within each group. As expected, TD children showed significant activity bilaterally in the STG and in the dorsal and ventral MPFC. In contrast, despite showing similar activity in primary auditory and visual cortices during the no irony condition compared with TD children, participants with ASD did not recruit any brain regions during the irony conditions beyond those engaged during the no irony condition, where the speaker’s intent was unambiguous.

A less selective neural response to ironic scenarios relative to nonironic scenarios in the ASD group was confirmed using a 2-sample t test. Activity in bilateral temporal regions and the MPFC was indeed greater in TD children than in children with ASD for the irony vs no irony comparison. An analysis of covariance confirmed that the TD group showed a stronger differential response to ironic scenarios in the MPFC and right STG, although between-group differences in the left temporal regions were no longer significant after controlling for VIQ (Table 3).

Table 3
Peaks of Activation for the All Irony vs No Irony Comparison*

Effect of Attentional Modulation

In the neutral instructions condition, interpreting a speaker’s communicative intent was associated with activity in temporal and occipital cortices bilaterally in both groups. However, TD children also recruited prefrontal regions, including the MPFC and inferior frontal gyrus bilaterally. In contrast, participants with ASD did not show any frontal activity when instructions were neutral (Table 4 and Figure 2A), even when the spatial extent threshold was lowered to P<. 05 uncorrected for multiple comparisons.

Table 4
Peaks of Activation During Irony Conditions*

As predicted, when explicitly instructed to attend to the facial expression or tone of voice, children with ASD did show significant activity in regions recruited by TD children when instructions were neutral, specifically in the MPFC and inferior frontal gyrus. Increases in activity in the inferior frontal gyrus were bilateral in the attend to face condition and restricted to the right hemisphere in the attend to prosody condition. Because instructions to attend to facial expression and tone of voice yielded very similar effects overall (both within and between groups), we present the data averaged across the 2 attend conditions compared with rest (Table 4 and Figure 2B).

Figure 2
Brain activity during potentially ironic scenarios relative to rest. A, Significant activity was observed in the medial prefrontal cortex and the left inferior frontal gyrus in the typically developing (TD) group but not the autism spectrum disorders ...

Direct comparisons between groups confirmed that TD children did recruit the MPFC and STG more strongly than children with ASD during the neutral instructions condition. Greater cerebellar activity was also observed in the TD group relative to the ASD group. No regions were more strongly activated in children with ASD than in controls. For the attend conditions, TD children engaged the STG, cerebellum, and visual cortices more strongly than children with ASD. However, MPFC activity was no longer significantly different between the groups once specific instructions were provided. A group × condition interaction in the MPFC revealed that activity in this region differed significantly between the groups when specific vs neutral instructions were given. That is, whereas children with ASD showed significantly greater activity in the MPFC when told explicitly to attend to the facial expression or tone of voice than when instructions were neutral, children with TD showed the same amount of activity in this region regardless of instructions (Table 5).

Table 5
Peaks of Differential Activity During Irony Conditions Given Neutral and Specific Instructions*

Analyses of covariance confirmed that the group × condition interaction in the MPFC was not due to between-group differences in verbal abilities. Likewise, the significant main effect of group (TD>ASD) in the STG was confirmed both when instructions were neutral and when they were specific to attend to the face or voice (relative to rest). However, after accounting for VIQ, between-group differences were no longer significant in the MPFC or cerebellum during the neutral instructions vs rest comparison or in the cerebellum or visual cortex during the attend to face or prosody vs rest comparison.

Correlations With Social Responsiveness

To relate brain activity to autistic symptoms, we conducted a multiple regression analysis in the ASD group. Controlling for VIQ, a significant negative correlation was found across all irony conditions between activity in the MPFC and social impairment as assessed by the Social Responsiveness Scale.41 That is, participants with a higher level of social functioning showed greater MPFC activity when attempting to infer a speaker’s communicative intent (Figure 3). Activity in the posterior middle temporal gyrus (Brodmann area 37) was also negatively correlated with the degree of social impairment.

Figure 3
Activity in the medial prefrontal cortex as a function of symptom severity. A negative correlation was found in children with autism spectrum disorders between activity in the medial prefrontal cortex and scores on the Social Responsiveness Scale (higher ...


We found significant differences in brain activity in children and adolescents with ASD compared with TD controls during the interpretation of a speaker’s communicative intent. First, as compared with TD children, children with ASD exhibited a less selective response to potentially ironic scenarios relative to unambiguous scenarios as indicated by reduced activity in the MPFC and right STG. Second, a significant group × condition interaction in the MPFC showed that regional activity was modulated by explicit instructions to attend to facial expression and tone of voice only in children with ASD. However, regardless of instructions, less activity was observed in the STG bilaterally in children with ASD relative to TD children during the irony conditions compared with rest. Finally, MPFC activity was inversely related to symptom severity in the ASD group such that greater social competence was associated with greater activity in the MPFC across all irony conditions. Importantly, these differences were significant after controlling for VIQ.

A less selective neural response to ironic scenarios relative to straightforward scenarios in children with ASD coheres with behavioral evidence that these individuals often mistakenly attribute a literal meaning to ironic utterances.37,49 Previous research suggests that the MPFC is important for understanding others’ mental states50 and that right-hemisphere temporal regions are engaged when coherence seeking is required.5154 Selective activity in these regions in TD children for ironic scenarios likely reflects a greater need to integrate facial, prosodic, and contextual cues to infer the speaker’s intent when the literal meaning of a remark conflicts with other available information. Reduced differential activity in this network in children with ASD may indicate less integrative reasoning about intent. Several other studies have also observed abnormalities in MPFC activity in individuals with ASD using a variety of tasks, including theory of mind5,2729 and semantic processing.25 The one region where the ASD group showed greater selective activity than the TD group for ironic vs control scenarios was the angular gyrus, known to play an important role in semantic processing. Greater activity in the right angular gyrus in children with ASD than in controls could reflect more reliance on semantic processing at the word or sentence level, perhaps at the expense of integrative processing. However, once VIQ was taken into account, between-group differences in this region were no longer significant. This suggests that increased activity in the ASD group may reflect impaired verbal abilities rather than a true difference in semantic representation.

Perhaps most interesting is the finding that for children with ASD, explicit instructions to attend to facial expression or tone of voice elicited significantly greater activity in the MPFC than neutral instructions simply to pay attention. In contrast, TD children showed significant MPFC activity irrespective of instructions, consistent with evidence that this region is normally recruited automatically when processing communicative intentions.55 Our findings extend previous work suggesting that attention to crucial aspects of social stimuli can yield increased activity in regions that typically respond preferentially to such stimuli. Hadjikhani et al56 observed comparable levels of FG activity in individuals with ASD and controls when faces were presented with a red fixation cross at approximately eye level. Similarly, Dalton et al18 found that in individuals with ASD, FG activity increased with time spent looking at the eyes. With respect to understanding others’ intentions, we recently found that children with ASD engaged neurocircuitry similar to that of TD controls when task demands implicitly required attention to prosodic or contextual cues to detect ironic intent.5 However, in a natural communicative setting, relevant cues are not experimentally highlighted. Interpreting irony correctly is likely to involve selectively attending to crucial cues (eg, facial expression and tone of voice) in a dynamic environment and integrating this information to reason about mental states.57 Here, increased MPFC activity in the ASD group following explicit instructions to attend to facial expression and tone of voice may reflect more reasoning about a speaker’s communicative intent afforded by increased attention to these important cues. The significant association between MPFC activity during irony conditions and social competence in the ASD group suggests that recruitment of this region when inferring communicative intent is indicative of greater success in real-world social situations.

Regardless of task instructions, reduced activity was observed in the STG bilaterally in the ASD group relative to controls. Previous research has demonstrated that the superior temporal sulcus or STG plays a role in polymodal sensory integration and shows a greater response to congruent audiovisual stimuli than to either auditory or visual stimuli alone.5860 Reduced STG activity during irony conditions in children with ASD could reflect difficulty detecting the correspondence between facial expression and tone of voice. This notion is consistent with behavioral studies suggesting that children with autism are impaired in matching facial and vocal affect.61,62

To our knowledge, this study is the first to demonstrate that explicit instructions to attend to important social stimuli can elicit greater activity in the MPFC, a region normally recruited automatically while attempting to infer the communicative intent of another person. Along with other work,1619,56 our results suggest that previous reports of hypoactivation in regions supporting the processing of socially relevant information may result from a primary impairment in social interest rather than a fundamental deficit in neural functioning. A lack of attention to faces, voices, and other social stimuli may impair the development of expertise in perceiving and using social cues as well as the automatic engagement of relevant neural circuitry.63,64

The finding that specific instructions to attend to important social cues resulted in a normalization of MPFC activity in children and adolescents with ASD suggests a strategy for intervention. Adolphs et al65 recently showed that explicitly instructing a patient with bilateral amygdala damage to look at the eyes enabled normal recognition of fearful expressions. Similarly, our findings suggest that instructing individuals with ASD to attend to faces and voices may facilitate the extraction of information necessary for interpreting others’ communicative intentions. An approach that combines instruction to use top-down cognitive strategies with perceptual training and reinforcement to facilitate bottom-up attentional processes could capitalize on cognitive strengths while addressing weaknesses in automatic mechanisms. Attentional training in different contexts should result in greater recruitment of the MPFC, perhaps enabling more efficient integration of socially relevant cues. In turn, this may lead to greater success in understanding others’ intentions in everyday interactions. Attention to faces and voices may then become more rewarding and more automatic for individuals with ASD, ultimately leading to higher levels of social responsiveness.

This study has some limitations. First, instructions to attend to the face and voice did not result in enhanced behavioral performance in the ASD group. This is likely due to the simplicity of the scenarios, which had a visual depiction of the event outcome. Performance was excellent even when no attentional guidance was provided. Although prompting the ASD group to attend to facial and prosodic cues may lead to the recruitment of more normative neurocircuitry, behaviorally, more time and practice may be needed before a performance benefit is derived. Compensatory mechanisms developed over time by individuals with ASD are likely to be effective for simple scenarios similar to those used here but are unlikely to be adequate for inferring intent in more dynamic social situations. A second limitation is that the TD and ASD groups differed significantly in VIQ. This leaves open the possibility that our results could be influenced by differences in verbal abilities because task performance increased significantly with VIQ in both groups. However, across all irony conditions, neither VIQ nor accuracy was significantly related to activity in the MPFC, the main site of differences, in either group. A third limitation concerns the possible comorbidity of ASD and ADHD. Although we excluded individuals with a concurrent ADHD diagnosis, some participants were receiving medication, including stimulants. Given that excluding individuals receiving medication did not significantly alter the results and that impairment in theory of mind has not been associated with ADHD,66,67 we feel it is unlikely that comorbid ADHD significantly impacted our findings. A fourth limitation is that the length of the scenarios in our activation paradigm precluded the use of an event-related design, which would have allowed us to tease apart the neural response to ironic vs sincere scenarios. This compromise was made in the framework of examining the neural processes involved in interpreting communicative intent as a whole rather than assuming that inferring irony and inferring sincerity are independent functional processes.68 Finally, the age of our participants varied considerably. Although chronological age was not significantly associated with activity in regions where between-group differences were observed, future research should explore developmental changes in the neural networks supporting the interpretation of communicative intent in ASD.


We thank the Brain Mapping Medical Research Organization, Brain Mapping Support Foundation, Pierson-Lovelace Foundation, Ahmanson Foundation, William M. and Linda R. Dietel Philanthropic Fund at the Northern Piedmont Community Foundation, Tamkin Foundation, Jennifer Jones-Simon Foundation, Capital Group Companies Charitable Foundation, Robson Family, and Northstar Fund for their generous support. The project described was supported in part by grants RR12169, RR13642, and RR00865 from the National Center for Research Resources, a component of the National Institutes of Health; its contents are solely the responsibility of the authors and do not necessarily represent the official views of National Center for Research Resources or the National Institutes of Health.

Funding/Support: This study was supported in part by grant P01 HD035470 from the National Institute of Child Health and Human Development, grant R03 DC005159 from the National Institute on Deafness and Other Communication Disorders, and grants from the National Alliance for Autism Research, the Cure Autism Now Foundation, and the University of California, Davis MIND Institute.

Role of the Sponsor: The contents of this article are solely the responsibility of the authors and do not necessarily represent the official views of the sponsors.


Financial Disclosure: None reported.

Previous Presentation: This work was presented in part at the International Meeting for Autism Research; May 6, 2005; Boston, Mass.


1. Lord C, Paul R. Language and communication in autism. In: Cohen DJ, Volkmar FR, editors. Handbook of Autism and Pervasive Developmental Disorders. 2nd ed. New York, NY: John Wiley & Sons; 1997. pp. 195–225.
2. Tantam DJH. Asperger’s syndrome in adulthood. In: Frith U, editor. Autism and Asperger Syndrome. Cambridge, England: Cambridge University Press; 1991. pp. 147–183.
3. Martin I, McDonald S. An exploration of causes of non-literal language problems in individuals with Asperger Syndrome. J Autism Dev Disord. 2004;34:311–328. [PubMed]
4. Happe FG. An advanced test of theory of mind: understanding of story characters’ thoughts and feelings by able autistic, mentally handicapped, and normal children and adults. J Autism Dev Disord. 1994;24:129–154. [PubMed]
5. Wang AT, Lee SS, Sigman M, Dapretto M. Neural basis of irony comprehension in children with autism: the role of prosody and context. Brain. 2006;129:932–943. [PMC free article] [PubMed]
6. Walker-Andrews AS. Infants’ perception of expressive behaviors: differentiation of multimodal information. Psychol Bull. 1997;121:437–456. [PubMed]
7. Dawson G, Meltzoff AN, Osterling J, Rinaldi J, Brown E. Children with autism fail to orient to naturally occurring social stimuli. J Autism Dev Disord. 1998;28:479–485. [PubMed]
8. Osterling J, Dawson G. Early recognition of children with autism: a study of first birthday home videotapes. J Autism Dev Disord. 1994;24:247–257. [PubMed]
9. Klin A. Young autistic children’s listening preferences in regard to speech: a possible characterization of the symptom of social withdrawal. J Autism Dev Disord. 1991;21:29–42. [PubMed]
10. Kuhl PK, Coffey-Corina S, Padden D, Dawson G. Links between social and linguistic processing of speech in preschool children with autism: behavioral and electrophysiological measures. Dev Sci. 2005;8:F1–F12. [PubMed]
11. Capps L, Yirmiya N, Sigman M. Understanding of simple and complex emotions in non-retarded children with autism. J Child Psychol Psychiatry. 1992;33:1169–1182. [PubMed]
12. Hobson RP, Ouston J, Lee A. Naming emotion in faces and voices: abilities and disabilities in autism and mental retardation. Br J Dev Psychol. 1989;7:237–250.
13. Macdonald H, Rutter M, Howlin P, Rios P. Recognition and expression of emotional cues by autistic and normal adults. J Child Psychol Psychiatry. 1989;30:865–877. [PubMed]
14. Rutherford MD, Baron-Cohen S, Wheelwright S. Reading the mind in the voice a study with normal adults and adults with Asperger syndrome and high functioning autism. J Autism Dev Disord. 2002;32:189–194. [PubMed]
15. Van Lancker DR, Cornelius C, Kreiman J. Recognition of emotional-prosodic meanings in speech by autistic, schizophrenic, and normal children. Dev Neuropsychol. 1989;5:207–226.
16. Piggot J, Kwon H, Mobbs D, Blasey C, Lotspeich L, Menon V, Bookheimer S, Reiss AL. Emotional attribution in high-functioning individuals with autistic spectrum disorder: a functional imaging study. J Am Acad Child Adolesc Psychiatry. 2004;43:473–480. [PubMed]
17. Wang AT, Dapretto M, Hariri AR, Sigman M, Bookheimer SY. Neural correlates of facial affect processing in children and adolescents with autism spectrum disorder. J Am Acad Child Adolesc Psychiatry. 2004;43:481–490. [PubMed]
18. Dalton KM, Nacewicz BM, Johnstone T, Schaefer HS, Gernsbacher MA, Goldsmith HH, Alexander AL, Davidson RJ. Gaze fixation and the neural circuitry of face processing in autism. Nat Neurosci. 2005;8:519–526. [PubMed]
19. Critchley HD, Daly EM, Bullmore ET, Williams SC, Van Amelsvoort T, Robertson DM, Rowe A, Phillips M, McAlonan G, Howlin P, Murphy DG. The functional neuroanatomy of social behaviour: changes in cerebral blood flow when people with autistic disorder process facial expressions. Brain. 2000;123:2203–2212. [PubMed]
20. Hall GB, Szechtman H, Nahmias C. Enhanced salience and emotion recognition in Autism: a PET study. Am J Psychiatry. 2003;160:1439–1441. [PubMed]
21. Hubl D, Bolte S, Feineis-Matthews S, Lanfermann H, Federspiel A, Strik W, Poustka F, Dierks T. Functional imbalance of visual pathways indicates alternative face processing strategies in autism. Neurology. 2003;61:1232–1237. [PubMed]
22. Pierce K, Muller RA, Ambrose J, Allen G, Courchesne E. Face processing occurs outside the fusiform “face area” in autism: evidence from functional MRI. Brain. 2001;124:2059–2073. [PubMed]
23. Schultz RT, Gauthier I, Klin A, Fulbright RK, Anderson AW, Volkmar F, Skudlar-ski P, Lacadie C, Cohen DJ, Gore JC. Abnormal ventral temporal cortical activity during face discrimination among individuals with autism and Asperger syndrome. Arch Gen Psychiatry. 2000;57:331–340. [PubMed]
24. Gervais H, Belin P, Boddaert N, Leboyer M, Coez A, Sfaello I, Barthelemy C, Brunelle F, Samson Y, Zilbovicius M. Abnormal cortical voice processing in autism. Nat Neurosci. 2004;7:801–802. [PubMed]
25. Harris GJ, Chabris CF, Clark J, Urban T, Aharon I, Steele S, McGrath L, Con-douris K, Tager-Flusberg H. Brain activation during semantic processing in autism spectrum disorders via functional magnetic resonance imaging. Brain Cogn. 2006;61:54–68. [PubMed]
26. Just MA, Cherkassky VL, Keller TA, Minshew NJ. Cortical activation and synchronization during sentence comprehension in high-functioning autism: evidence of underconnectivity. Brain. 2004;127:1811–1821. [PubMed]
27. Castelli F, Frith C, Happe F, Frith U. Autism, Asperger syndrome and brain mechanisms for the attribution of mental states to animated shapes. Brain. 2002;125:1839–1849. [PubMed]
28. Happe F, Ehlers S, Fletcher P, Frith U, Johansson M, Gillberg C, Dolan R, Frack-owiak R, Frith C. “Theory of mind” in the brain: evidence from a PET scan study of Asperger syndrome. Neuroreport. 1996;8:197–201. [PubMed]
29. Nieminen-von Wendt T, Metsahonkala L, Kulomaki T, Aalto S, Autti T, Vanhala R, von Wendt L. Changes in cerebral blood flow in Asperger syndrome during theory of mind tasks presented by the auditory route. Eur Child Adolesc Psychiatry. 2003;12:178–189. [PubMed]
30. Mitchell RLC, Elliott R, Barry M, Cruttenden A, Woodruff PWR. The neural response to emotional prosody, as revealed by functional magnetic resonance maging. Neuropsychologia. 2003;41:1410–1421. [PubMed]
31. Wildgruber D, Riecker A, Hertrich I, Erb M, Grodd W, Ethofer T, Ackermann H. Identification of emotional intonation evaluated by fMRI. Neuroimage. 2005;24:1233–1241. [PubMed]
32. Kujala T, Lepisto T, Nieminen-von Wendt T, Naatanen P, Naatanen R. Neuro-physiological evidence for cortical discrimination impairment of prosody in Asperger syndrome. Neurosci Lett. 2005;383:260–265. [PubMed]
33. Lepisto T, Silokallio S, Nieminen-von Wendt T, Alku P, Naatanen R, Kujala T. Auditory perception and attention as reflected by the brain event-related potentials in children with Asperger syndrome. Clin Neurophysiol. 2006;117:2161–2171. [PubMed]
34. Pierce K, Glad KS, Schreibman L. Social perception in children with autism: an attentional deficit? J Autism Dev Disord. 1997;27:265–282. [PubMed]
35. Klin A, Jones W, Schultz R, Volkmar F, Cohen D. Visual fixation patterns during viewing of naturalistic social situations as predictors of social competence in individuals with autism. Arch Gen Psychiatry. 2002;59:809–816. [PubMed]
36. Wang AT, Lee SS, Sigman M, Dapretto M. Developmental changes in the neural basis of interpreting communicative intent [published online September 12,2006] Soc Cogn Affect Neurosci [PMC free article] [PubMed]
37. Happe FG. Communicative competence and theory of mind in autism: a test of relevance theory. Cognition. 1993;48:101–119. [PubMed]
38. Dunn LM, Dunn LM. Peabody Picture Vocabulary Test. 3rd. Circle Pines, Minn American Guidance Service; 1997.
39. Lord C, Risi S, Lambrecht L, Cook EH, Jr, Leventhal BL, DiLavore PC, Pickles A. RutterM. The Autism Diagnostic Observation Schedule-Generic: a standard measure of social and communication deficits associated with the spectrum of autism J Autism Dev Disord. 2000;30:205–223. [PubMed]
40. Lord C, Rutter zM, Le Couteur A. Autism Diagnostic Interview-Revised: a revised version of a diagnostic interview for caregivers of individuals with possible pervasive developmental disorders. J Autism Dev Disord. 1994;24:659–685. [PubMed]
41. Constantino JN, Davis SA, Todd RD, Schindler MK, Gross MM, Brophy SL, Metzger LM, Shoushtari CS, Splinter R, Reich W. Validation of a brief quantitative measure of autistic traits: comparison of the social responsiveness scale with the Autism Diagnostic Interview-Revised. J Autism Dev Disord. 2003;33:427–433. [PubMed]
42. Wechsler D. Wechsler Abbreviated Scale of Intelligence. San Antonio, Tex: Psychological Corp; 1999.
43. Minshew NJ, Turner CA, Goldstein G. The application of short forms of the Wechsler Intelligence scales in adults and children with high functioning autism. J Autism Dev Disord. 2005;35:45–52. [PubMed]
44. Rutter M, Bailey A, Berument SK, Le Couteur A, Lord C, Pickles A. Social Communication Questionnaire (SCQ) Los Angeles, Calif: Western Psychological Services; 2003.
45. Woods RP, Dapretto M, Sicotte NL, Toga AW, Mazziotta JC. Creation and use of a Talairach-compatible atlas for accurate, automated, nonlinear intersubject registration, and analysis of functional imaging data. Hum Brain Mapp. 1999;8:73–79. [PubMed]
46. Woods RP, Grafton ST, Holmes CJ, Cherry SR, Mazziotta JC. Automated image registration, I: general methods and intrasubject, intramodality validation. J Com-put Assist Tomogr. 1998;22:139–152. [PubMed]
47. Friston KJ, Holmes AP, Price CJ, Buchel C, Worsley KJ. Multisubject fMRI studies and conjunction analyses. Neuroimage. 1999;10:385–396. [PubMed]
48. Worsley KJ, Marrett S, Neelin P, Vandal AC, Friston KJ, Evans AC. A unified statistical approach for determining significant signals in images of cerebral activation. Hum Brain Mapp. 1996;4:58–73. [PubMed]
49. Landa R. Social language use in Asperger syndrome and high-functioning autism. In: Klin A, Volkmar F, Sparrow S, editors. Asperger Syndrome. New York, NY: Guilford Press; 2000. pp. 125–155.
50. Frith U, Frith CD. Development and neurophysiology of mentalizing. Philos Trans R Soc Lond B Biol Sci. 2003;358:459–473. [PMC free article] [PubMed]
51. St George M, Kutas M, Martinez A, Sereno MI. Semantic integration in reading engagement of the right hemisphere during discourse processing. Brain. 1999;122:1317–1325. [PubMed]
52. Caplan R, Dapretto M. Making sense during conversation: an fMRI study. Neuroreport. 2001;12:3625–3632. [PubMed]
53. Kircher TT, Brammer M, Tous Andreu N, Williams SC, McGui re PK. Engagement of right temporal cortex during processing of linguistic context. Neuropsychologia. 2001;39:798–809. [PubMed]
54. Rodd JM, Davis MH, Johnsrude IS. The neural mechanisms of speech comprehension: fMRI studies of semantic ambiguity. Cereb Cortex. 2005;15:1261–1269. [PubMed]
55. Kampe KK, Frith CD, Frith U. “Hey John”: signals conveying communicative intention toward the self activate brain regions associated with “mentalizing,” regardless of modality. J Neurosci. 2003;23:5258–5263. [PubMed]
56. Hadjikhani N, Joseph RM, Snyder J, Chabris CF, Clark J, Steele S, McGrath L, Vangel M, Aharon I, Feczko E, Harris GJ, Tager-Flusberg H. Activation of the fusiform gyrus when individuals with autism spectrum disorder view faces. Neuroimage. 2004;22:1141–1150. [PubMed]
57. Sabbagh MA. Understanding orbitofrontal contributions to theory-of-mind reasoning: implications for autism. Brain Cogn. 2004;55:209–219. [PubMed]
58. Wright TM, Pelphrey KA, Allison T, McKeown MJ, McCarthy G. Polysensory interactions along lateral temporal regions evoked by audiovisual speech. Cereb Cortex. 2003;13:1034–1043. [PubMed]
59. Calvert GA, Brammer MJ, Bullmore ET, Campbell R, Iversen SD, David AS. Response amplification in sensory-specific cortices during crossmodal binding. Neuroreport. 1999;10:2619–2623. [PubMed]
60. Calvert GA, Campbell R, Brammer MJ. Evidence from functional magnetic resonance imaging of crossmodal binding in the human heteromodal cortex. Curr Biol. 2000;10:649–657. [PubMed]
61. Haviland JM, Walker-Andrews AS, Huffman LR, Toci L. Intermodal perception of emotional expressions by children with autism. J Dev Phys Disabil. 1996;8:77–88.
62. Loveland KA, Tunali-Kotoski B, Chen R, Brelsford KA. Intermodal perception of affect in persons with autism or Down syndrome. Dev Psychopathol. 1995;7:409–418.
63. Dawson G, Carver L, Meltzoff AN, Panagiotides H, McPartland J, Webb SJ. Neural correlates of face and object recognition in young children with autism spectrum disorder, developmental delay, and typical development. Child Dev. 2002;73:700–717. [PMC free article] [PubMed]
64. Grelotti DJ, Gauthier I, Schultz RT. Social interest and the development of cortical face specialization: what autism teaches us about face processing. Dev Psychobiol. 2002;40:213–225. [PubMed]
65. Adolphs R, Gosselin F, Buchanan TW, Tranel D, Schyns P, Damasio AR. A mechanism for impaired fear recognition after amygdala damage. Nature. 2005;433:68–72. [PubMed]
66. Charman T, Carroll F, Sturge C. Theory of mind, executive function and social competence in boys with ADHD. Emot Behav Difficulties. 2001;6:31–49.
67. Perner J, Kain W, Barchfeld P. Executive control and higher-order theory of mind in children at risk of ADHD. Infent Child Dev. 2002;11:141–158.
68. Small SL, Nusbaum HC. On the neurobiological investigation of language understanding in context. Brain Lang. 2004;89:300–311. [PubMed]