Involvement of left inferior frontal gyrus in sentence-level semantic integration
Introduction
In recent years, there has been an increasing interest in language processing and its neural correlates (e.g., Constable et al., 2004, Hagoort, 2003, Hagoort, 2005, Hickok and Poeppel, 2004, Jung-Beeman, 2005, Spitsyna et al., 2006, Wang et al., 2008, Willems et al., 2008). As a result, different models have been postulated on the basis of the findings in cognitive neuroscience research.
A major model on the topic is the Bilateral Activation, Integration, and Selection (BAIS) model, which proposes that semantic processing in language comprehension consists of three distinct but highly interactive components (i.e., activation, selection, and integration), each of which is supported by different brain areas (Jung-Beeman, 2005). Specifically, bilateral Wernicke's areas are considered to be responsible for activating or retrieving lexical and semantic information, the inferior frontal gyrus (IFG) for selection among competing semantic activations, and anterior temporal areas for semantic integration to compute semantic overlap among multiple semantic activations and to construct higher-order semantic relations.
Another major model on the same topic is the one proposed by Hagoort and colleagues (Hagoort, 2003, Hagoort, 2005, Hagoort and van Berkum, 2007), in which they argue that a different set of three major components (i.e., memory, unification, and control) is crucial for language comprehension and production. According to this Memory, Unification, and Control (MUC) model, the left temporal cortex underlies the memory component in retrieving word information from long-term memory, the LIFG underlies the unification component in combining retrieved information into larger units, and the anterior cingulate cortex and dorsolateral prefrontal cortex (DLPFC) underlie the control component in planning verbal actions and allocating attention.
Semantic integration is a key component in the construction of sentence-level meaning representations, but different researchers attribute this process to different brain areas (i.e., anterior temporal cortex vs. LIFG). To examine which one of the two mentioned cortical areas is connected with semantic integration in language processing, the present study adopted a violation paradigm commonly used for studying semantic processing (e.g., Dapretto and Bookheimer, 1999, Hagoort et al., 2004, Kutas and Hillyard, 1980; see review in Kaan and Swaab (2002) and Kutas et al. (2006)). The violation paradigm typically involves comparison of normal sentences with anomalous sentences that have been violated in a certain manner (e.g., a semantic violation in the present study). The basic assumption is that participants are subject to increasing demand on and recruit more cognitive resources for integration in reading anomalous sentences. Following the same logic, brain regions more strongly activated by the anomalous sentences relative to the normal sentences are generally interpreted as possible neural correlates of a particular type of reading related operations (e.g., Baumgaertner et al., 2002, Hagoort et al., 2004, Homae et al., 2002).
It is important to note, however, that there are two potential problems in using the above mentioned violation paradigm to investigate semantic integration in language processing. First, normal sentences and semantically violated sentences differ not only in semantic integration, but also in other aspects. For example, anomalous sentences may recruit processes not engaged by normal sentences at all, such as violation detection and violation repairing (Indefrey et al., 2001, Kaan and Swaab, 2003). These processes, though unrelated to semantic integration, may also show up in the anomalous vs. normal comparison. Although similar problems have been recognized in previous syntactic violation studies (e.g., Indefrey et al., 2001), no attempt has been made so far to deal with it in semantic studies.
Another potential problem is that, when comparing the anomalous and normal sentences, the two types of sentences are actually associated with different responses. In fact, in making semantically acceptable or unacceptable judgments, participants are essentially matching the constructed sentence meaning with some previously established, semantic representations so that semantically acceptable sentences require a match or positive response and semantically unacceptable sentences require a mismatch or negative response. It has been well established in cognitive psychology that positive and negative decisions may involve different cognitive processes (see, e.g., Farell, 1985, Sternberg, 1966) and Treisman and Gormican (1988) for evidence in behavioral studies; e.g., Zhang et al. (2003) for evidence in brain imagining studies), and that making positive and negative responses may be influenced by factors such as task demand, response bias, and response strategy (see review in Farell (1985)). Hence, comparison of anomalous and normal sentences may reflect general decision-making processes not specific to semantic integration. In other words, semantic integration is only one of several factors that may differentiate anomalous and normal conditions, if the two conditions require different responses. Under this situation, one should be cautious in interpreting brain activation differences across the two conditions.
In the present study, we attempted to make use of the principle of parametric design to compare two sentence types with different degrees of semantic violation. Table 1 illustrates the experimental conditions, each with a sample sentence. The anomalous sentences were constructed by changing a target noun in a normal sentence. For example, when the normal sentence is as follows: “The construction workers use pump to draw underground water” (English translation), the target word “pump” is replaced with “iron” to produce a relatively small semantic violation, and with “salt” to produce a relatively large semantic violation.
Although neither “iron” nor “salt” can be integrated with the rest of the sentence to produce a coherent meaning representation, the former word is semantically related to the original word “pump”, and is more likely to fit the sentence context, relative to the latter, which is semantically unrelated to the original word (see similar manipulations in Federmeier and Kutas (1999)). Consequently, we expected that it would be more difficult for participants to detect the violation in a small semantically violated sentence and reject the sentence as semantically acceptable, relative to a large semantically violated sentence. This is because participants would need to engage more semantic integration in order to make sense of the sentence in the small violation condition than in the large violation condition.
Relative to the anomalous vs. normal contrast, the small vs. large violation contrast would be much more comparable, because they involve the same processes of violation detection, semantic repair, and require the same negative response. Therefore, the contrast between the small vs. large violation should be more appropriate to reveal the neural correlates of semantic integration and to test the specific predictions from models such as the MUC and the BAIS.
Section snippets
Participants
Sixteen right-handed native Chinese speakers (8 males and 8 females, aged between 20 and 27 years, with a mean age of 23.7 years) participated in this study. All had normal or corrected-to-normal vision and none had any history of psychiatric or neurological disorders. Written informed consent was obtained from each participant following a protocol approved by the IRB of the Medical College of Shantou University, Shantou, China.
Stimuli
The stimuli consisted of three types of sentences, including normal
Behavioral results
There was a significant effect of sentence type for both response time (F (2, 30) = 32.46, p < 0.001) and accuracy (F (2, 30) = 6.20, p < 0.01). The average reaction times and accuracy are shown in Table 1. The normal sentences (M = 2820 ms) produced longer reaction times than did the two types of anomalous sentences (ps < 0.05). In addition, those sentences with a small violation produced longer reaction times than did the sentences with a large violation (2575 ms vs. 2346 ms, p < 0.05). The mean accuracies
Discussion
The present study demonstrated that participants were significantly slower in responding to the sentences with a small degree of semantic violation relative to those with a large violation. Consistent with the RT results, the accuracy for the small violation condition was 92.1%, significantly lower than the 97.7% in the large violation condition. This pattern suggests that small violations were more difficult to detect relative to large violations, and confirms that the sentences with a small
Conclusion
In summary, although the anomalous vs. normal comparison may identify brain regions responsible for semantic integration, we took an alterative approach to manipulate the degree of semantic violation and compared two conditions with differential semantic integration involvement in order to remove the impact of non-semantic processing. As expected, we observed increased difficulty in behavioral performance for rejecting sentences with a small semantic violation requiring more integration
Acknowledgments
This research was supported by grants from the National Natural Science Foundation of China (#30670700, #30670702), the Guangdong (China) Natural Science Foundation (#06200524), Program for New Century Excellent Talents in University of China (#NCET-08-0645), the Chinese University of Hong Kong (Direct grant #2020911), and the Research Grants Council of the Hong Kong Special Administrative Region, China (CUHK4142/04H and CUHK441008). We thank Qiulin Wu, Linfa Wu, Shaoxing Chen in Medical
References (64)
- et al.
Event-related fMRI reveals cortical sites involved in contextual sentence integration
NeuroImage
(2002) - et al.
Specialization of phonological and semantic processing in Chinese word reading
Brain Res.
(2006) - et al.
Processing of visually presented sentences in Mandarin and English studied with fMRI
Neuron
(1999) - et al.
Sentence complexity and input modality effects in sentence comprehension: an fMRI study
NeuroImage
(2004) AFNI: software for analysis and visualization of functional magnetic resonance neuroimages
Comput. Biomed. Res.
(1996)- et al.
Form and content: dissociating syntax and semantics in sentence comprehension
Neuron
(1999) - et al.
Susceptibility-induced loss of signal: comparing PET and fMRI on a semantic task
NeuroImage
(2000) - et al.
A rose by any other name: long-term memory structure and sentence processing
J. Mem. Lang.
(1999) - et al.
Effects of word form on brain processing of written Chinese
NeuroImage
(2002) On Broca, brain, and binding: a new framework
Trends Cogn. Sci.
(2005)
Dorsal and ventral streams: a framework for understanding aspects of the functional anatomy of language
Cognition
From perception to sentence comprehension: the convergence of auditory and visual information of language in the left inferior frontal cortex
NeuroImage
Syntactic processing in left prefrontal cortex is independent of lexical meaning
NeuroImage
Bilateral brain processes for comprehending natural language
Trends Cogn. Sci.
The brain circuitry of syntactic comprehension
Trends Cogn. Sci.
Reading anomalous sentences: an event-related fMRI study of semantic processing
NeuroImage
Neuroanatomical distinctions within the semantic system during sentence comprehension: evidence from functional magnetic resonance imaging
NeuroImage
Psycholinguistics electrified II: 1994–2005
Rethinking the neurological basis of language
Lingua
The neural system underlying Chinese logograph reading
NeuroImage
Broca's area plays a role in syntactic processing during Chinese reading comprehension
Neuropsychologia
Language in context: emergent features of word, sentence, and narrative comprehension
NeuroImage
Frontal activations associated with accessing and evaluating information in working memory: an fMRI study
NeuroImage
Triangulating a cognitive control network using diffusion-weighted magnetic resonance imaging (MRI) and functional MRI
J. Neurosci.
A common system for the comprehension and production of narrative speech
J. Neurosci.
Effects of reading span and textual coherence on rapid-sequential reading
Mem. Cognit.
How do readers of Chinese process words during reading for comprehension
Language processing: implications from the study of Chinese
Effects of presentation complexity on rapid-sequential reading
Percept. Psychophys.
Effects of antecedent order and semantic context on Chinese pronoun resolution
Mem. Cognit.
Language control in the bilingual brain
Science
FMRI of past tense processing: the effects of phonological complexity and task difficulty
J. Cogn. Neurosci.
Cited by (51)
Prediction of semantic features is modulated by global prediction reliability: Evidence from the N400 effect
2023, Journal of NeurolinguisticsLanguage and action in Broca's area: Computational differentiation and cortical segregation
2021, Brain and CognitionCitation Excerpt :At the cytoarchitectonic level, Broca’s area can be differentiated in two neighboring regions: Brodmann Areas (BA) 44 and 45 (Amunts & Zilles, 2012; Brodmann, 1909). The more anterior BA45 has been often associated to the processing of various types of semantic information during different tasks and manipulations such as plausibility judgment or semantic acceptability (Bookheimer, 2002; Caplan, Chen, & Waters, 2008; Friederici, 2011; Hagoort, 2005; Hagoort & Indefrey, 2014; Zhu et al., 2009). The more posterior BA44 has been conversely strongly associated to the processing of syntactic hierarchies (Zaccarella, Schell, & Friederici, 2017).
Semantic unification modulates N400 and BOLD signal change in the brain: A simultaneous EEG-fMRI study
2019, Journal of Neurolinguistics