The Influence of Action Video Gaming Experience on the Perception of Emotional Faces and Emotional Word Meaning

Yan, Yuening; Li, Yi; Lou, Xinyu; Li, Senqi; Yao, Yutong; Gong, Diankun; Ma, Weiyi; Yan, Guojian

doi:https://doi.org/10.1155/2021/8841156

Neural Plasticity

On this page

Abstract Introduction Results Discussion Conclusions Data Availability Ethical Approval Conflicts of Interest Acknowledgments References Copyright Related Articles

Special Issue

Large-Scale Neuroscience and Neural Plasticity

View this Special Issue

Research Article | Open Access

Volume 2021 | Article ID 8841156 | https://doi.org/10.1155/2021/8841156

The Influence of Action Video Gaming Experience on the Perception of Emotional Faces and Emotional Word Meaning

Yuening Yan,^1,2Yi Li,^1,2Xinyu Lou,^1,2Senqi Li,^1,2Yutong Yao,³Diankun Gong,^1,2Weiyi Ma ,⁴and Guojian Yan^1,2

Academic Editor: Jianzhong Su

Received31 Aug 2020

Revised30 Dec 2020

Accepted06 May 2021

Published22 May 2021

Abstract

Action video gaming (AVG) experience has been found related to sensorimotor and attentional development. However, the influence of AVG experience on the development of emotional perception skills is still unclear. Using behavioral and ERP measures, this study examined the relationship between AVG experience and the ability to decode emotional faces and emotional word meanings. AVG experts and amateurs completed an emotional word-face Stroop task prior to (the pregaming phase) and after (the postgaming phase) a 1 h AVG session. Within-group comparisons showed that after the 1 h AVG session, a more negative N400 was observed in both groups of participants, and a more negative N170 was observed in the experts. Between-group comparisons showed that the experts had a greater change of N170 and N400 amplitudes across phases than the amateurs. The results suggest that both the 1 h and long-term AVG experiences may be related to an increased difficulty of emotional perception. Furthermore, certain behavioral and ERP measures showed neither within- nor between-group differences, suggesting that the relationship between AVG experience and emotional perception skills still needs further research.

1. Introduction

Video gaming is becoming an increasingly important part of our entertainment experience. Population-based research suggests that 79.9% of 5- to 17-year-olds and 31.3% of adults spend some time on video gaming on a daily basis [1]. A report of the Entertainment Software Association shows that 63% of U.S. households surveyed have at least one frequent gamer (http://www.theesa.com/about-esa/esa-annual-report/). Video gaming offers a new approach to acquiring knowledge and to facilitating cognitive development, thus providing us with a new, important venue for understanding learning-related cognitive and neural plasticity. Using both behavioral and neuroscience methods, this study explores the relationship between action video gaming (AVG) experience and emotional perception performance.

A major genre of video gaming, AVG emphasizes physical and cognitive challenges, such as hand-eye coordination [2], stimulus detection and analysis [3], and decision-making under time pressure [4], just like traditional sports. Researchers have proposed that AVG experience induces plasticity of brain function and structure [5]. This proposition is supported by the findings that AVG experience is related to improvements in various cognitive functions (e.g., selective attention [6, 7], spatial distribution of visuospatial attention [8, 9], attentional capture [10], and behavioral performance in tasks of working memory and vision [11]) and the plasticity of brain structure and neutral network connectivity (e.g., increased gray matter volume of insula [12] and strengthened connection between sensorimotor and attentional networks [13]).

These studies have improved our knowledge of the influence of AVG experience on sensorimotor and attentional development—essential components of physical and cognitive development. However, human development consists of four domains: physical, cognitive, social, and emotional developments [14]. A holistic approach to human development encompasses all the four domains [14]. Then, an important question arises: How does AVG experience influence emotional perception development? An examination of this question is essential for any complete theories on the learning-related cognitive and brain plasticity.

This study examines the influence of AVG experience on the development of emotional perception skills. Essential to human experience [15], emotions guide us through complex social environment and help us adapt our behavior to optimize survival, health, and development [16]. Emotional information can be encoded visually and auditorily. For example, emotional information can be visually communicated through facial expressions [17], body postures [18], and written language [19]. Emotional information can also be encoded through the modulations of acoustic attributes (e.g., pitch, intensity, rate, stress, and pause) in speech, music, and even environmental sounds [20–22]. This study examines the decoding of emotional faces and emotional word meanings in both AVG experts and amateurs.

There are two competing positions on the effect of AVG experience on emotional skill development. One position suggests that video gaming experience may hinder emotional skill development [23]. For example, excessive video game use is related to low self-esteem [24], low self-efficacy [25], anxiety and aggression [26], and symptoms of depression and anxiety disorders [27], all contributing to socioemotional deficits. Video gaming experience is also related to a lack of real-life friends [28], stress and maladaptive coping [29], lower psychosocial well-being and loneliness [30], and psychosomatic problems [29, 31]. Video gaming experience may be inversely related to socioemotional skill development because research suggests that individuals with weak socioemotional skills may use video games to avoid real-life socioemotional problems [32] and that video gaming reduces the time allocated for real-life socioemotional interaction [33], thus decreasing the opportunity to develop adequate socioemotional skills. Furthermore, the exposure to the violent content of AVG may increase aggressive cognition and decrease empathy, thus hindering socioemotional skill development [34–36]. However, some of these findings are based on individuals with excessive video game use (e.g., [24–26]), who may have psychological issues that also contribute to socioemotional skill deficits [23]. For example, since the individuals with excessive video game use may have video gaming addiction, it is unclear whether their socioemotional skill deficits are due to video gaming experience per se or a general addiction effect.

However, a competing position suggests that video gaming experience may improve emotional skill development. Research suggests that playing puzzle and role-play video games can improve mood and increase positive emotion in the players (e.g., [37–39]). Furthermore, video games can be used to promote emotional intelligence in the 14-year-olds [40]. Video gaming may promote socioemotional skill development because it can help players relieve stress after real-life socioemotional problems (e.g., [38, 41]). Additionally, video gaming can improve emotional regulation strategies because it rewards overcoming frustration and anxiety [42]. Furthermore, team video gaming offers a social environment that can foster social bond, emotional communication, empathy, and prosocial behavior in players [43, 44]. Finally, a successful video gaming experience induces feelings of achievement in players—beneficial to emotional skill development [45]. All these socioemotional elements are relevant to AVG.

Thus, the effect of AVG experience on socioemotional skill development is still unclear. This study examines the relationship between action real-time strategy gaming (ARSG) experience and the perception of emotional faces and emotional word meanings. This study is aimed at determining whether emotional perception performance changes after a brief ARSG session within a participant and whether emotional perception performance differs between the ARSG experts and amateurs. ARSG is examined in this study because (i) as a new AVG subgenre that is highly popular, ARSG still remains understudied; (ii) ARSG includes “action” elements, allowing us to examine the effect of action video gaming on emotional skill development; and (iii) ARSG also includes “strategy” elements that offer players a socioemotional environment for socioemotional communication ([46]), thus allowing us to hypothesize that ARSG may enhance emotional skill development. Recently, research found that the “action” elements of ARSG may enhance the salience network (SN) and the central executive network (CEN)—two networks essential for attention and working memory [47], while the “strategy” elements of ARSG may enhance the functional integration between the CEN and the default mode network (DMN) [48]. However, these findings do not speak to emotional perception skills.

Using behavioral (i.e., response time, accuracy) and ERP measures, this study examined ARSG experts’ and amateurs’ performance in a Stroop task. This study used an established experimental procedure [49], referred to as an emotional face-word (EFW) Stroop task hereafter, in which participants see a face across which a word is projected—where the emotional meaning of the word and the facial expression is either congruent or incongruent—and are asked to decode the emotional meaning of the face or the word. A Stroop effect is the delay in response between the congruent and incongruent stimuli. An EFW Stroop task uses facial expressions and written texts because they are two primary channels of emotional communication. Facial expressions—realized through motions or positions of the muscles beneath the skin of the face—are a nonverbal means of emotional communication for humans [50], other mammals [51, 52], and species [53]. In addition, written language is a verbal means of emotional communication specific to humans [54].

This study used ERP measures because the high temporal resolution of ERP allows us to examine temporally sensitive indicators [55]. According to past findings [56–59], two ERP components (N400, N170) were analyzed in this study. The N400 was analyzed because (i) a clear N400 can be evoked by the incongruent color interference in a color-word Stroop task [56], (ii) the N400 may reflect the process of resolving the response conflict by suppressing the word response [57], and (iii) the N400 amplitude may increase with semantic and associative distance between a target word and its preceding context, suggesting that the N400 reflects the degree of conflict and thereby the processing difficulty [58]. Thus, the N400 is a sensitive measure of semantic processing in an EFW Stroop task. This study also analyzed the N170—an ERP component with a latency of about 170 ms poststimulus—because it is closely related to face perception and emotion processing, as the N170 may reflect late stages in the structural encoding of faces [59]. In addition, research has demonstrated that a clear N170 can be evoked in the incongruent condition in an EFW Stroop task [49]. Thus, the N170 can effectively indicate face perception in an EFW Stroop task.

In this study, both ARSG experts and amateurs completed a 1 h ARSG session. They were also administered an EFW Stroop task prior to (the pregaming phase) and after (the postgaming phase) the 1 h ARSG session. The influence of the 1 h ARSG session on emotional perception performance can be illuminated through cross-phase comparisons of the participants’ pregaming and postgaming emotional perception performance. The influence of the long-term ARSG experience on emotional perception performance can be addressed through between-group comparisons of the participants’ emotional perception performance. The interaction between the long-term and brief ARSG experience can be revealed by between-group comparisons of the amount of cross-phase change. If ARSG experience is related to a disadvantage of emotional perception, we predict that (i) cross-phase comparisons should show an increased response time, a decreased accuracy rate, and a more negative N400 and N170 in both groups of participants, all of which indicate an increased difficulty of emotional perception; (ii) compared to the amateurs, the experts should have a slower response time, a lower accuracy rate, and a more negative N400 and N170; and (iii) the experts should have a greater amount of cross-phase change than the amateurs. By contrast, if ARSG experience is related to improvements in emotional perception skills, an opposite pattern of results should emerge.

2. Method

2.1. Participants

Participants were recruited using the procedure established in previous research [60–62]. Prior to this study, a survey was given to a number of participants who were asked to report the following: (i) their video gaming experience (in years) and Expertise Ranking of League of Legends (LOL (the LOL, a video game that requires players to cooperate with teammates to destroy the opposing team’s towers, is a typical ARSG game, which is also commonly referred to as the Multiplayer Online Battle Arena (MOBA) genre; the LOL consists of three game modes: Summoner’s Rift (Ranked Matchmaking), Twisted Treeline, and Howling Abyss (Normal Matchmaking); players’ gaming experience and expertise are indicated by their Ranked Matchmaking level which is calculated based on the Elo rating system—a method for calculating the relative skill levels of players in competitor-versus-competitor games; the experts and amateurs can be defined based on the Elo rating of their Ranked Matchmaking level, which is available from an online inventory (http://www.lol91.com/duanweibilv.html); the ELO rating system has multiple stages—Bronze, Silver, Gold, Platinum, Diamond, Master, and Challenger—across which the expertise level increases sequentially. Each stage has five phases ranging from V to I; in the Ranked Matchmaking mode, players who win (or lose) a game will gain (or lose) a certain amount of points depending on the champion’s performance; wining each 100 points activates the promotion competition, the successful completion of which promotes the player to the next stage or level; the successful maintenance of points requires one to play LOL on a regular and frequent basis))—the ARSG program used in this study; (ii) the amount of time spent on LOL and other ARSGs in the most recent week; (iii) their LOL ID that was used to verify their self-reported LOL gaming experience and ranking information, since their LOL Expertise Ranking is provided by the LOL game; (iv) their experience (in years) of playing video games other than LOL, which was used to exclude multigenre gamers to ensure LOL was the primary game genre for all participants in this study; and (v) their video gaming addiction status, using a 7-item Game Addiction Scale. Only the individuals who were identified as either LOL experts or amateurs and who had no gaming addiction were invited to participate in this study. Unlike past research that recruited individuals who had no action video gaming experience [6, 63, 64], this study recruited amateurs who had some LOL experience to minimize the influence of novel experience on amateurs’ performance. This is an established procedure used in past cross-sectional research where both experts and amateurs were administered a brief video gaming session [60].

The participants were 27 male college students ( years) of the University of Electronic Science and Technology of China (UESTC), consisting of 13 LOL experts and 14 amateurs. Following the procedure established by previous research [60–62], the group membership was defined based on both time- and skill-based criteria. The experts had at least 2 years of LOL while the amateurs had less than 0.5 years of LOL experience. Furthermore, according to the Expertise Ranking information provided by the LOL software—ranging between rank 1 and rank 27, all the experts were above rank 17, and all the amateurs were below rank 8, thus further verifying their group membership. All participants spent around 7–21 hours on ARSG in the week when they participated in this study. In addition, all participants were right-handed as confirmed by the Edinburgh Handedness Questionnaire [65], reported having normal or corrected-to-normal vision, and had no history of neurological problems. This study complied with the ethical standards outlined by the Declaration of Helsinki and was approved by the UESTC Ethics Board and performed in accordance with the Code of Ethics of the World Medical Association ([66]). Informed consent was obtained from all participants prior to the experiment.

2.2. Stimuli and Procedure

An experiment consisted of three sequential phases: a pregaming Stroop test, a 1 h ARSG session, and a postgaming Stroop test. A monitor (Model Lenovo L2250PWD, 20 inches, height: 47.4 cm, wide 29.6 cm) was placed in the testing booth and used for stimulus presentation.

2.2.1. Stimuli Preparation

The stimuli were presented using the established EFW Stroop procedure [49]. The stimuli were selected from an existent face database designed for an EFW Stroop task [49]. Based on the valence of emotion [67], a face was either positive (e.g., happiness), or negative (e.g., sad), or neutral (e.g., calmness). A two-character Chinese word in prominent red color was projected across each face, one character on each side of the face (Figure 1) [49]. The word was either an emotional adjective (e.g., “愉快” [“yu-kuai” meaning happy], “悲伤” [“bei-shang” meaning sad], or “镇定” [“zhen-ding” meaning calm]) or a noun without an explicit emotional connotation (e.g., “苹果” [“ping-guo” meaning apple]). There were three types of trials: (i) congruent trials where the valence of the face and the word meaning was both positive, or both negative, or both neutral; (ii) incongruent trials where the valence of the face and the word meaning was inconsistent (e.g., a happy face paired with an adjective of “悲伤” [sad] or “镇定” [calm]); and (iii) unrelated trials where a face was paired with a noun (e.g., “苹果” [apple]). The size of the face was about , and the size of the character was about , when presented on the computer screen.

2.2.2. Emotional Face-Word (EFW) Stroop Task

Each EFW task had four blocks (two face blocks and two word blocks), each containing 96 trials. In a face block, the participants were asked to read the word loudly and respond as quickly and accurately as possible by pressing one of the three buttons on the computer keyboard corresponding to “positive,” “negative,” and “neutral” for the effect expressed on the face. The participants responded to the facial expression while the valence of the word meaning was either in conflict with, or consistent with, or irrelevant to that of the facial expression. Thus, a face block was in essence a face perception task. Therefore, the N170—which is closely related to face perception [49]—was used as the ERP measure in the face blocks.

In a word block, the participants were asked to first orally describe the face using an adjective they thought about and then judge the word’s emotional connotation using the keyboard as quickly and accurately as possible. The participants responded to the word meaning while the valence of the facial expression was either in conflict with, or consistent with, or irrelevant to that of the word meaning. Thus, a word block was in essence a semantic processing task. Therefore, the N400—which is closely related to semantic processing [68, 69]—was used as the ERP measure in the word blocks.

The face blocks and the word blocks differed in the response target in the Stroop task (face vs. word) and the source of the potential distraction (word vs. face). Thus, we used different ERP measures in the two types of blocks. Nevertheless, both types of blocks assessed emotional perception with potential conflict information.

2.2.3. Procedure

The participants were tested individually in a sound attenuated, dim lit, and electrically shielded testing booth. To familiarize them with the Stroop task, an experiment started with a familiarization phase containing seven word trials and seven face trials. Each trial started with the presentation of a fixation square at the center of the display for 1 s. Then, the test stimulus appeared at the center of this display. The presentation of the test stimulus, which could maintain for a maximal duration of 8 s, terminated once the participant made a response. Then, the next trial started after a random response-stimulus interval (RSI), ranging from 0.85 s to 1.25 s. The familiarization phase ended with a 10 m break, during which the participants were asked to rest with their eyes closed.

(1) Pregaming Stroop Task. The experiment then proceeded to the pregaming EFW Stroop task that contained two face blocks and two word blocks. The presentation order of the trials within a block was randomized within a participant and counterbalanced across participants. Two presentation orders of blocks were used (order 1: a face block, a word block, a word block, a face block; order 2: a word block, a face block, a face block, a word block). There was a 10 s break after each block.

(2) A 1 h ARSG Session. The participants then completed a 1 h LOL session, using the Normal 5v5 Matchmaking—a LOL game model referred to as Howling Abyss (version: 8.5)—where two teams, each consisting of five members, competed with each other. Each player controlled a character to destroy the opponent team’s tower by working with his four teammates. Since the participants were tested individually, the feature “Random Pick” was activated to randomly team the participant with four online players who were also playing LOL at that given time regardless of their physical location, competing against the opponent team who was also randomly assigned by LOL. The feature “Random Pick” ensured that all 10 players in a 1 h LOL session had a similar level of experience, expertise, and ranking.

(3) Postgaming Stroop Task. Finally, the participants completed another EFW Stroop task. The procedure of the postgaming EFW Stroop task was identical to that of the pregaming Stroop task, except that the presentation orders of the four blocks and the test trials within each block differed across phases.

2.3. Data Recording and Preprocessing

The EEG data was collected using an electrode cap (Brain Products GmbH) of 32 Ag-AgCl electrodes following the 10-20 system [70]. Contact impedance was kept below 5kΩ. The EEG signals were digitized with a sampling rate of 1000 Hz and filtered through 50 Hz notch filter. To control eye movement artifacts, vertical electrooculogram (EOG) was recorded above the right eye. All recording was completed through Brain Vision Record version 2.0.1 (Brain products GmbH), and off-line EEG analysis was performed using Brain Vision Analysis version 2.0.1 (Brain products GmbH).

EEG signals were rereferenced to average reference and digitally band-pass filtered between 0.1 and 30 Hz using FIR filter. Then, raw EEG signals were segmented into two parts according to the first and the second Stroop tasks. To remove EOG artifacts, the segmented data was corrected through ocular correction, excluding all signal of which amplitude exceeded 90 μV in any channel from additional analysis. After raw data inspection, all epochs under “incongruent” condition were extracted as 1000 ms (200 ms prestimulus and 800 ms poststimulus) for further analysis. For each epoch, baseline correction for the period 200 ms before the appearance of stimulus was applied. Averaging epochs of face blocks and word blocks, respectively, in the first and the second tasks, we can obtain four ERPs (see details in 2.5) of each participant as the research objects. In every group, participants’ ERPs were averaged again for contrasting the two groups.

2.4. Behavioral and ERP Analysis

In this study, data analysis and reporting were focused on the incongruent condition because it is where the Stroop interference effect occurred. In total, 1248 trials () were averaged for the pre- and postgaming EFW Stroop tasks, respectively, within the experts, and 1344 trials (14 participants x 96 trials) were averaged the pre- and postgame EFW Stroop tasks, respectively, within the amateurs. This study used two behavioral dependent variables—response time (i.e., the delay between stimuli onset and button pressing) and accuracy rate—which were recorded by E-prime Data analysis. The ERP analysis was focused on the N170 (for the face blocks [71]) and the N400 (for the word blocks [72, 73]). Based on the time of stimulus appearance as time-locked point, the average amplitude was calculated according to the time window and recording electrodes as shown in Table 1.

2.5. Statistical Analysis

A repeated measures ANOVA was conducted. If significant main effects or a interaction emerged, post hoc analyses were conducted through paired sample -tests on cross-phase differences within each group and/or independent samples -tests on between-group differences. Adjusted values were used in multiple comparisons throughout this study. This study used cross-phase comparisons to explore the effect of the 1 h ARSG session on emotional perception performance, and between-group comparisons to examine the effect of the long-term ARSG experience on emotional perception performance.

3. Results

3.1. Behavior Results

3.1.1. The Face Blocks

A repeated measures ANOVA on response time found that the main effect of Group was not significant (, ), suggesting that response time did not differ between groups. Furthermore, the main effect of Phase was significant (, ), but the interaction (, ) was not significant, suggesting that responses time differed across phases and that the same pattern of results emerged in the two groups. Then, paired sample -tests showed that response time decreased across phases in both groups (Table 2). In addition, a repeated measures ANOVA on accuracy rate showed that neither the main effects of Group (, ) and Phase (, ) nor the interaction (, ) approached significance, suggesting that accuracy rate did not differ between groups or across phases (the experts: , ; the amateurs: ; ).

3.1.2. The Word Blocks

A repeated measures ANOVA on response time found that the main effect of Group (, ) was not significant, suggesting that response time did not differ between groups. Furthermore, the main effect of Phase was significant (, ), but the interaction (, ) was not significant, suggesting that response times differ across phases and that the same pattern of results emerged in the two groups. Then, paired sample -tests found that response time decreased across phases in both groups (Table 3). In addition, a repeated measures ANOVA on accuracy rate found that neither the main effects of Group (, ) and Phase (, ) nor the interaction (, ) approached significance, suggesting that accuracy rate did not differ between groups or across phases within a group (the experts: , ; the amateurs: ; ) (Table 3).

Thus, the behavioral data showed that neither response time nor accuracy rate differed between groups. In addition, both the experts’ and amateurs’ response time decreased after the 1 h gaming session.

3.2. N170 (the Face Blocks)

The N170 was recorded by the P7 electrode. Figure 2 shows the ERP contrast between the pre- and postgaming Stroop tasks on the incongruent face trials in the experts and amateurs. Table 4 shows the descriptive and deductive results. A repeated measures ANOVA on the N170 amplitude showed that the main effect of Group (, ) was not significant, but the main effect of Phase (, ) and the interaction (, ) were significant. To decompose this interaction, paired sample -tests compared the N170 amplitude across phases within each group. Results showed that the N170 amplitude increased across phases in the experts but not in the amateurs (Table 4). Then, separate independent samples -tests found that the N170 amplitude did not significantly differ between groups in either the pre- or postgaming phase. However, an independent samples -test on the altered value of the N170 amplitude (the postgaming phase data minus the pregaming phase data) showed that the experts had a greater altered value than the amateurs.

(a)

(b)

(c)

Figure 2

(a) The N170 in the face block: solid blue lines (experts in the pregaming phase), red solid lines (experts in the postgaming phase), blue dashed lines (amateurs in the pregaming phase), and red dashed lines (amateurs in the postgaming phase). (b) The paired sample -test results that the N170 amplitude increased across phases in the experts but not in the amateurs. (c) The independent sample -test results that the altered values of the N170 amplitude were greater in the experts than in the amateurs.

3.3. N400 (the Word Blocks)

The N400 was recorded by the Fz electrode [73]. Figure 3 shows ERP contrast between the pre- and postgaming Stroop tasks on the incongruent word trials in the experts and amateurs. Table 5 shows the descriptive and deductive results. A repeated measures ANOVA on the N400 amplitude showed that the main effect of Group (, ) was not significant, but the main effect of Phase (, ) and the interaction (, ) were significant. To decompose this interaction, paired sample -tests compared the N400 amplitude across phases within each group. Results showed that the N400 amplitude increased across phases in both groups (Table 5). Then, separate independent samples -tests found that the N400 amplitude was greater in the amateurs than in the experts in the pregaming phase, but it did not differ between groups in the postgaming phase. In addition, an independent t samples test on the altered value of the N400 amplitude (the postgaming task data minus the pregaming task data) showed that the experts had a greater altered value than the amateurs (past research also used N2 and MFN as the index of the proactive cognitive control in a Stroop task; however, the current study found no significant between- or within-group differences for either N2 (recorded by Fz) or MFN (recorded by Cz)).

(a)

(b)

(c)

Figure 3

(a) The N400 in the word block: solid blue lines (experts in the pregaming phase), red solid lines (experts in the postgaming phase), blue dashed lines (amateurs in the pregaming phase), and red dashed lines (amateurs in the postgaming phase). (b) The paired sample -test results that the N400 amplitude increased across phases in both groups of participants. (c) The independent sample -test results that the altered values of the N400 amplitude were greater in the experts than in the amateurs.

4. Discussion

This study examined the relationship between ARSG experience and emotional perception performance. The ARSG experts and amateurs were administered an EFW Stroop task prior to (the pregaming phase) and after (the postgaming phase) a 1 h ARSG session. The influence of the 1 h ARSG session on emotional perception performance was examined through cross-phase comparisons within each group, while the influence of the long-term ARSG experience on emotional perception performance was explored through between-group comparisons.

4.1. Was the 1 h ARSG Experience Related to Emotional Perception Performance?

Results showed that the N170 amplitude increased across phases in the experts but not in the amateurs. In an EFW Stroop task, the N170 amplitude may reflect recognition difficulty and cognitive resource consumption for processing emotional faces [49]. Indeed, an increased N170 amplitude is often observed in the incongruent condition in a Stroop task [49]. The face-language conflict may complicate emotional face perception, leading to an increased difficulty of emotional face perception that requires a greater cognitive resource consumption [49]. Thus, the current findings suggest that after the 1 h ARSG session, an increased difficulty of emotional processing of facial expressions may be observable in the experts but not in the amateurs. Perhaps, compared to the amateurs, the experts processed more gaming information in the 1 h ARSG session, which might have biased their brain toward a greater allocation of cognitive resources for gaming information perception. This bias might have maintained in the postgaming phase, thereby deprioritizing the experts’ perception of nongaming information (e.g., emotion) in the postgaming Stroop task.

Furthermore, a more negative N400 was observed across phases in both groups of participants, revealing an increased difficulty of emotional perception of word meaning after the 1 h ARSG session. The N400 is a classic ERP component in response to semantic anomaly [74]. The N400 can also be elicited by word-picture incongruency [68] and inaccurate arithmetic results [69]. Furthermore, EFW Stroop research found a stronger N400 in the incongruent condition than in the congruent condition [57], suggesting that the N400 may reflect the degree of incongruency in the Stroop paradigm. Perhaps, video gaming prioritized the processing of gaming information, which decreased the allocation of cognitive resources for emotional perception in both the experts and amateurs. This pattern of cognitive resource allocation might have maintained in the postgaming phase, leading to an increased difficulty of emotional perception and thereby a more negative N400 in both groups of participants.

Thus, the current findings confirmed the prediction that the 1 h ARSG session may be related to an increased difficulty of emotional perception of word meaning in both groups of participants according to the N400 data. Furthermore, the 1 h ARSG session may be related to an increased difficulty of emotional perception of facial expressions in the experts according to the N170 data, suggesting that the effect of a brief ARSG session on emotional perception performance may interact with one’s long-term gaming experience. However, it is unclear whether the increased difficulty of emotional perception was due to the 1 h action video gaming session per se or a general screen media experience unspecific to video gaming. Future research should evaluate this issue.

4.2. Was the Long-Term ARSG Experience Related to Emotional Perception Performance?

This study used between-group comparisons to evaluate the effect of the long-term ARSG experience on emotional perception performance. Results showed that the altered values of the N400 and N170 amplitude across phases (postgaming Stroop task minus pregaming Stroop Task) were greater in the experts than in the amateurs, suggesting that the experts had a greater increase in the difficulty of emotional perception than the amateurs after the 1 h ARSG session.

However, there is also evidence against the claim that ARSG experience is related to an increased difficulty of emotional perception. First, neither response time nor accuracy rate differed between groups. Nevertheless, these behavioral measures may not be sensitive enough to reveal the potential between-group differences in emotional perception performance. Second, the N170 amplitude did not differ between groups in either the pregaming phase or the postgaming phase. In addition, the N400 amplitude did not differ between groups in the postgaming phase. These results do not support the prediction that long-term AVG experience is related to emotional perception performance. Third, we even found a more negative N400 in the amateurs than in the experts in the pregaming Stroop task, suggesting that the amateurs might have a greater difficulty of emotional perception of word meaning than the experts in the pregaming phase, which is inconsistent with the altered value data showing that long-term AVG experience is related to an increased difficulty of emotional perception. It should be noted that although past research suggests that compared with amateurs, AVG experts have faster processing and responses in space detection [75], task switching [76], or could better detect changes to objects stored in visual short-term memory [76], these findings are not about emotional perception. Nevertheless, these findings suggest that the relationship between AVG experience and emotional perception skills still requires further research.

5. Conclusions

Using behavioral and ERP measures, this study explored the relationship between AVG experience and the ability to decode emotional meaning of facial expressions and emotional words. This study revealed evidence that both the brief and long-term AVG experiences may be related to an increased difficulty of emotional perception. Nevertheless, the relationship between AVG experience and emotional perception skills still needs further research.

Data Availability

Data available are on request.

Ethical Approval

The authors acknowledge the statements and guidelines on ethical publication and confirm that this report is consistent with these guidelines.

Conflicts of Interest

None of the authors has any conflicts of interest to disclose.

Acknowledgments

This work was supported by Sichuan Science and Technology Program (2020ZYD013 and 2021YJ0167) and the 111 Project (No. B12027).

References

S. Fullerton, A. W. Taylor, E. D. Grande, and N. Berry, “Measuring physical inactivity: do current measures provide an accurate view of sedentar video game time?” Journal of obesity, vol. 2014, Article ID 287013, 5 pages, 2014.
View at: Publisher Site | Google Scholar
N. D. Bowman, R. Weber, R. Tamborini, and J. Sherry, “Facilitating game play: how others affect performance at and enjoyment of video games,” Media Psychology, vol. 16, no. 1, pp. 39–64, 2013.
View at: Publisher Site | Google Scholar
J. A. Anguera, J. Boccanfuso, J. L. Rintoul et al., “Video game training enhances cognitive control in older adults,” Nature, vol. 501, no. 7465, pp. 97–101, 2013.
View at: Publisher Site | Google Scholar
C. S. Green, The effects of action video game experience on perceptual decision making, Doctoral dissertation, Retrieved from ProQuest Dissertations and Theses database, 2008, UMI No. 3314679.
C. S. Green and D. Bavelier, The cognitive neuroscience of video games In: Digital media: transformations in human communication, L. Humphreys and P. Messaris, Eds., Peter Lang Publishing, New York, 2006.
C. S. Green and D. Bavelier, “Action video game modifies visual selective attention,” Nature, vol. 423, no. 6939, pp. 534–537, 2003.
View at: Publisher Site | Google Scholar
L. Krishnan, A. Kang, G. Sperling, and R. Srinivasan, “Neural strategies for selective attention distinguish fast-action video game players,” Brain Topography, vol. 26, no. 1, pp. 83–97, 2013.
View at: Publisher Site | Google Scholar
C. S. Green and D. Bavelier, “Effect of action video games on the spatial distribution of visuospatial attention,” Journal of Experimental Psychology: Human Perception and Performance, vol. 32, no. 6, pp. 1465–1478, 2006.
View at: Publisher Site | Google Scholar
M.-H. Tsai, R.-J. Cherng, and J.-Y. Chen, “Visuospatial attention abilities in the action and real time strategy video game players as compared with nonplayers,” in in 2013 1st International Conference on Orange Technologies (ICOT), IEEE, 2013.
View at: Google Scholar
M. W. G. Dye, C. S. Green, and D. Bavelier, “The development of attention skills in action video game players,” Neuropsychologia, vol. 47, no. 8-9, pp. 1780–1789, 2009.
View at: Publisher Site | Google Scholar
Y. Yao, R. Cui, Y. Li et al., “Action real-time strategy gaming experience related to enhanced capacity of visual working memory,” Frontiers in Human Neurosciences, vol. 14, p. 333, 2020.
View at: Publisher Site | Google Scholar
D. Gong, H. He, D. Liu et al., “Enhanced functional connectivity and increased gray matter volume of insula related to action video game playing,” Scientific Reports, vol. 5, no. 1, p. 9763, 2015.
View at: Publisher Site | Google Scholar
D. Gong, W. Ma, J. Gong et al., “Action video game experience related to altered large-scale white matter networks,” Neural Plasticity, vol. 2017, Article ID 7543686, 7 pages, 2017.
View at: Publisher Site | Google Scholar
C. K. Sigelman and E. A. Rider, Life-span human development, Cengage Learning, 2014.
C. E. Izard, The psychology of emotions, Springer Science & Business Media, 1991.
J. Mercer, “Feeling like a state: social emotion and identity,” International Theory, vol. 6, no. 3, pp. 515–535, 2014.
View at: Publisher Site | Google Scholar
P. Ekman, The Face of Man, Garland Publishing, Inc., New York, NY, 1980.
J. E. McHugh, R. McDonnell, C. O'Sullivan, and F. N. Newell, “Perceiving emotion in crowds: the role of dynamic body postures on the perception of emotion in crowded scenes,” Experimental Brain Research, vol. 204, no. 3, pp. 361–372, 2010.
View at: Publisher Site | Google Scholar
J. T. Hancock, C. Landrigan, and C. Silver, “Expressing emotion in text-based communication,” in in Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, pp. 929–932, Association for Computing Machinery: San Jose, California, USA, 2007.
View at: Google Scholar
P. N. Juslin and P. Laukka, “Communication of emotions in vocal expression and music performance: different channels, same code?” Psychological Bulletin, vol. 129, no. 5, pp. 770–814, 2003.
View at: Publisher Site | Google Scholar
W. Ma and W. F. Thompson, “Human emotions track changes in the acoustic environment,” in Proceedings of the National Academy of Sciences, vol. 112, pp. 14563–14568, U.S.A, 2015.
View at: Google Scholar
W. Ma, A. Fiveash, and W. F. Thompson, “Spontaneous emergence of language-like and music-like vocalizations from an artificial protolanguage,” Semiotica, vol. 2019, no. 229, pp. 1–23, 2019.
View at: Publisher Site | Google Scholar
J. M. von der Heiden, B. Braun, K. W. Müller, and B. Egloff, “The association between video gaming and psychological functioning,” Frontiers in Psychology, vol. 10, 2019.
View at: Publisher Site | Google Scholar
K. Niemz, M. Griffiths, and P. Banyard, “Prevalence of pathological Internet use among university students and correlations with self-esteem, the General Health Questionnaire (GHQ), and disinhibition,” Cyberpsychology & Behavior., vol. 8, no. 6, pp. 562–570, 2005.
View at: Publisher Site | Google Scholar
E. J. Jeong and D. H. J. C. Kim, “Social activities, self-efficacy, game attitudes, and game addiction,” Cyberpsychology, Behavior and Social Networking, vol. 14, no. 4, pp. 213–221, 2011.
View at: Publisher Site | Google Scholar
M. Mehroof and M. D. J. C. Griffiths, “Online gaming addiction: the role of sensation seeking, self-control, neuroticism, aggression, state anxiety, and trait anxiety,” Cyberpsychology, Behavior and Social Networking, vol. 13, no. 3, pp. 313–316, 2010.
View at: Publisher Site | Google Scholar
H. R. Wang, H. Cho, and D.-J. Kim, “Prevalence and correlates of comorbid depression in a nonclinical online sample with DSM-5 internet gaming disorder,” Journal of Affective Disorders, vol. 226, pp. 1–5, 2018.
View at: Publisher Site | Google Scholar
R. Kowert, J. Vogelgesang, R. Festl, and T. Quandt, “Psychosocial causes and consequences of online video game play,” Computers in Human Behavior, vol. 45, pp. 51–58, 2015.
View at: Publisher Site | Google Scholar
L. Milani, G. La Torre, M. Fiore et al., “Internet gaming addiction in adolescence: risk factors and maladjustment correlates,” International Journal of Mental Health and Addiction, vol. 16, no. 4, pp. 888–904, 2018.
View at: Publisher Site | Google Scholar
J. S. Lemmens, P. M. Valkenburg, and J. Peter, “Psychosocial causes and consequences of pathological gaming,” Computers in Human Behavior, vol. 27, no. 1, pp. 144–152, 2011.
View at: Publisher Site | Google Scholar
A. Müller, S. Loeber, J. Söchtig, B. Te Wildt, and M. De Zwaan, “Risk for exercise dependence, eating disorder pathology, alcohol use disorder and addictive behaviors among clients of fitness centers,” Journal of Behavioral Addictions, vol. 4, no. 4, pp. 273–280, 2015.
View at: Publisher Site | Google Scholar
P. Taquet, L. Romo, O. Cottencin, D. Ortiz, and M. Hautekeete, “Video game addiction: cognitive, emotional, and behavioral determinants for CBT treatment,” Journal de Thérapie Comportementale et Cognitive, vol. 27, no. 3, pp. 118–128, 2017.
View at: Publisher Site | Google Scholar
D. Gentile, “Pathological video-game use among youth ages 8 to 18,” Psychological Science, vol. 20, no. 5, pp. 594–602, 2009.
View at: Publisher Site | Google Scholar
C. A. Anderson and B. J. Bushman, “Effects of violent video games on aggressive behavior, aggressive cognition, aggressive affect, physiological arousal, and prosocial behavior: a meta-analytic review of the scientific literature,” Psychological Science, vol. 12, no. 5, pp. 353–359, 2001.
View at: Publisher Site | Google Scholar
C. A. Anderson, A. Shibuya, N. Ihori et al., “Violent video game effects on aggression, empathy, and prosocial behavior in Eastern and Western countries: a meta-analytic review,” Psychological Bulletin, vol. 136, no. 2, pp. 151–173, 2010.
View at: Publisher Site | Google Scholar
S. L. Calvert, M. Appelbaum, K. A. Dodge et al., “The American Psychological Association Task Force assessment of violent video games: science in the service of public interest,” American Psychologist, vol. 72, no. 2, pp. 126–143, 2017.
View at: Publisher Site | Google Scholar
I. Granic, A. Lobel, and R. C. M. E. Engels, “The benefits of playing video games,” American Psychologist, vol. 69, no. 1, pp. 66–78, 2014.
View at: Publisher Site | Google Scholar
C. V. Russoniello, K. O’Brien, and J. M. Parks, “The effectiveness of casual video games in improving mood and decreasing stress,” Journal of Cybertherapy and Rehabilitation, vol. 2, no. 1, pp. 53–66, 2009.
View at: Google Scholar
R. M. Ryan, C. S. Rigby, and A. Przybylski, “The motivational pull of video games: a self-determination theory approach,” Motivation and Emotion, vol. 30, no. 4, pp. 347–363, 2006.
View at: Publisher Site | Google Scholar
C. Carissoli and D. Villani, “Can videogames be used to promote emotional intelligence in teenagers? Results from EmotivaMente, a school program,” Games for Health Journal, vol. 8, no. 6, pp. 407–413, 2019.
View at: Publisher Site | Google Scholar
J. Colwell, “Needs met through computer game play among adolescents,” Personality and Individual Differences, vol. 43, no. 8, pp. 2072–2082, 2007.
View at: Publisher Site | Google Scholar
A. Aldao, S. Nolen-Hoeksema, and S. Schweizer, “Emotionregulation strategies across psychopathology: A meta-analytic review,” Clinical Psychology Review, vol. 30, no. 2, pp. 217–237, 2010.
View at: Publisher Site | Google Scholar
T. Greitemeyer and C. Cox, “There's no “I” in team: effects of cooperative video games on cooperative behavior,” European Journal of Social Psychology, vol. 43, no. 3, pp. 224–228, 2013.
View at: Publisher Site | Google Scholar
T. Greitemeyer, S. Osswald, and M. Brauer, “Playing prosocial video games increases empathy and decreases schadenfreude,” Emotion, vol. 10, no. 6, pp. 796–802, 2010.
View at: Publisher Site | Google Scholar
S. Trepte and L. Reinecke, “The pleasures of success: game-related efficacy experiences as a mediator between player performance and game enjoyment,” Cyberpsychology, Behavior and Social Networking, vol. 14, no. 9, pp. 555–557, 2011.
View at: Publisher Site | Google Scholar
D. Gong, Y. Li, Y. Yan et al., “The high-working load states induced by action real-time strategy gaming: an EEG power spectrum and network study,” Neuropsychologia, vol. 131, pp. 42–52, 2019.
View at: Publisher Site | Google Scholar
D. Gong, H. He, W. Ma et al., “Functional integration between salience and central executive networks: a role for action video game experience,” Neural Plasticity, vol. 2016, Article ID 675046, 9 pages, 2016.
View at: Publisher Site | Google Scholar
D. Gong, W. Ma, T. Liu, Y. Yan, and D. Yao, “Electronic-sports experience related to functional enhancement in central executive and default mode areas,” Neural Plasticity, vol. 2019, Article ID 1940123, 7 pages, 2019.
View at: Publisher Site | Google Scholar
X. R. Zhu, H. J. Zhang, T. T. Wu, W. B. Luo, and Y. J. Luo, “Emotional conflict occurs at an early stage: evidence from the emotional face–word Stroop task,” Neuroscience Letters, vol. 478, no. 1, pp. 1–4, 2010.
View at: Publisher Site | Google Scholar
P. Ekman, “Facial expression and emotion,” American Psychologist, vol. 48, no. 4, pp. 384–392, 1993.
View at: Publisher Site | Google Scholar
L. A. Parr, “Cognitive and physiological markers of emotional awareness in chimpanzees (Pan troglodytes),” Animal Cognition, vol. 4, no. 3-4, pp. 223–229, 2001.
View at: Publisher Site | Google Scholar
I. Merola, E. Prato-Previde, and S. Marshall-Pescini, “Dogs’ social referencing towards owners and strangers,” PloS one, vol. 7, no. 10, p. e47653, 2012.
View at: Publisher Site | Google Scholar
V. Ferretti and F. J. G. Papaleo, “Understanding others: emotion recognition in humans and other animals,” Gene, Brain, and Behavior, vol. 18, no. 1, 2019.
View at: Google Scholar
M. D. Hauser, N. Chomsky, and W. Fitch, “The faculty of language: what is it, who has it, and how did it evolve?” Science, vol. 298, no. 5598, pp. 1569–1579, 2002.
View at: Publisher Site | Google Scholar
E. Carlino, M. Sigaudo, and A. Pollo, “Nonlinear analysis of electroencephalogram at rest and during cognitive tasks in patients with schizophrenia,” Journal of Psychiatry & Neuroscience, vol. 37, no. 4, pp. 259–266, 2012.
View at: Publisher Site | Google Scholar
M. Rebai, C. Bernard, and J. Lannou, “The Stroop's test evokes a negative brain potential, the N400,” International Journal of Neuroscience, vol. 91, no. 1-2, pp. 85–94, 1997.
View at: Publisher Site | Google Scholar
M. Liotti, M. G. Woldorff, R. Perez, and H. S. Mayberg, “An ERP study of the temporal course of the Stroop color-word interference effect,” Neuropsychologia, vol. 38, no. 5, pp. 701–711, 2000.
View at: Publisher Site | Google Scholar
C. Van Petten and M. Kutas, Electrophysiological evidence for the flexibility of lexical processing, G. Simpson, Ed., Word and sentence, Amsterdam: North Holland Press, 1991.
M. Eimer, “The face-specific N170 component reflects late stages in the structural encoding of faces,” Neuroreport, vol. 11, no. 10, pp. 2319–2324, 2000.
View at: Publisher Site | Google Scholar
N. Qiu, W. Ma, X. Fan et al., “Rapid improvement in visual selective attention related to action video gaming experience,” Frontiers in Human Neurosciences, vol. 12, 2018.
View at: Google Scholar
D. Gong, Y. Yao, X. Gan, Y. Peng, W. Ma, and D. Yao, “A reduction in video gaming time produced a decrease in brain activity,” Frontiers in Human Neurosciences, vol. 13, p. 134, 2019.
View at: Publisher Site | Google Scholar
X. Gan, Y. Yao, H. Liu et al., “Action real-time strategy gaming experience related to increased attentional resources: an attentional blink study,” Frontiers in Human Neurosciences, vol. 14, p. 101, 2020.
View at: Publisher Site | Google Scholar
R. Li, U. Polat, W. Makous, and D. Bavelier, “Enhancing the contrast sensitivity function through action video game training,” Nature Neuroscience, vol. 12, no. 5, pp. 549–551, 2009.
View at: Publisher Site | Google Scholar
G. L. West, B. L. Drisdelle, K. Konishi, J. Jackson, P. Jolicoeur, and V. D. Bohbot, “Habitual action video game playing is associated with caudate nucleus-dependent navigational strategies,” Proceedings of the Royal Society B: Biological Sciences, vol. 282, no. 1808, p. 20142952, 2015.
View at: Publisher Site | Google Scholar
R. C. Oldfield, “The assessment and analysis of handedness: the Edinburgh inventory,” Neuropsychologia, vol. 9, no. 1, pp. 97–113, 1971.
View at: Publisher Site | Google Scholar
World Medical Association, “Declaration of Helsinki: ethical principles for medical research involving human subjects,” Journal of the American College of Dentists, vol. 81, pp. 14–18, 2014.
View at: Google Scholar
J. Posner, J. A. Russell, and B. S. Peterson, “The circumplex model of affect: an integrative approach to affective neuroscience, cognitive development, and psychopathology,” Development and Psychopathology, vol. 17, no. 3, pp. 715–734, 2005.
View at: Publisher Site | Google Scholar
A. Nigam, J. E. Hoffman, and R. F. Simons, “N400 to semantically anomalous pictures and words,” Journal of Cognitive Neuroscience, vol. 4, no. 1, pp. 15–22, 1992.
View at: Publisher Site | Google Scholar
M. Niedeggen and F. Rösler, “N400 effects reflect activation spread during retrieval of arithmetic facts,” Psychological Science, vol. 10, no. 3, pp. 271–276, 1999.
View at: Publisher Site | Google Scholar
H. H. Jasper, “Report of the committee on methods of clinical examination in electroencephalography: 1957,” Electroencephalography and Clinical Neurophysiology, vol. 10, no. 2, pp. 370–375, 1958.
View at: Publisher Site | Google Scholar
R. Osinsky, H. Gebhardt, N. Alexander, and J. Hennig, “Trait anxiety and the dynamics of attentional control,” Biological Psychology, vol. 89, no. 1, pp. 252–259, 2012.
View at: Publisher Site | Google Scholar
J. Qiu, Y. Luo, Q. Wang, F. Zhang, and Q. Zhang, “Brain mechanism of Stroop interference effect in Chinese characters,” Brain Research, vol. 1072, no. 1, pp. 186–193, 2006.
View at: Publisher Site | Google Scholar
K. S. Shin, D. H. Kang, J. S. Choi, Y. Y. Kim, and J. S. Kwon, “Neuropsychological correlates of N400 anomalies in patients with schizophrenia: a preliminary report,” Neuroscience Letters, vol. 448, no. 2, pp. 226–230, 2008.
View at: Publisher Site | Google Scholar
M. Kutas and K. D. Federmeier, “Thirty years and counting: finding meaning in the N400 component of the event-related brain potential (ERP),” Annual Review of Psychology, vol. 62, no. 1, pp. 621–647, 2011.
View at: Publisher Site | Google Scholar
P. M. Greenfield, P. DeWinstanley, H. Kilpatrick, and D. Kaye, “Action video games and informal education: effects on strategies for dividing visual attention,” Journal of Applied Developmental Psychology, vol. 15, no. 1, pp. 105–123, 1994.
View at: Publisher Site | Google Scholar
W. R. Boot, A. F. Kramer, D. J. Simons, M. Fabiani, and G. Gratton, “The effects of video game playing on attention, memory, and executive control,” Acta Psychologica, vol. 129, no. 3, pp. 387–398, 2008.
View at: Publisher Site | Google Scholar

Copyright

Copyright © 2021 Yuening Yan et al. This is an open access article distributed under the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.

PDF Download Citation

Download other formats

Order printed copies

Views

1007

Downloads

894

Citations