Electrophysiological correlates of the interplay between low-level visual features and emotional content during word reading
Processing affectively charged visual stimuli typically results in increased amplitude of specific event-related potential (ERP) components. Low-level features similarly modulate electrophysiological responses, with amplitude changes proportional to variations in stimulus size and contrast. However, it remains unclear whether emotion-related amplifications during visual word processing are necessarily intertwined with changes in specific low-level features or, instead, may act independently. In this pre-registered electrophysiological study, we varied font size and contrast of neutral and negative words while participants were monitoring their semantic content. We examined ERP responses associated with early sensory and attentional processes as well as later stages of stimulus processing. Results showed amplitude modulations by low-level visual features early on following stimulus onset – i.e., P1 and N1 components –, while the LPP was independently modulated by these visual features. Independent effects of size and emotion were observed only at the level of the EPN. Here, larger EPN amplitudes for negative were observed only for small high contrast and large low contrast words. These results suggest that early increase in sensory processing at the EPN level for negative words is not automatic, but bound to specific combinations of low-level features, occurring presumably via attentional control processes.
Attention mechanisms enable the parsimonious and efficient allocation of cognitive resources by selecting stimuli and features that are goal-relevant or salient1,2. Among the possible ways in which the brain may tag something as relevant, there are bottom-up factors (e.g., abrupt changes in luminance), top-down factors (e.g., a task must be accomplished), and biological significance (e.g., social, motivational, and emotional meaning).
Within the visual domain, bottom-up perceptual relevance has typically been examined by manipulating low-level properties of the stimuli. For example, electrophysiological studies have shown that changes in visual contrast or stimulus size modulate the amplitude of P1 and N1 event-related potential (ERP) components, which are thought to reflect early cognitive processes associated with stimulus detection and discrimination, respectively3,4,5. Manipulating visual contrast – e.g., by showing dark compared to bright stimuli on a uniform background – typically elicits larger amplitude and delayed peak latency of the P1 and N1 components6,7,8. Similarly, size manipulation was found to affect both P1 and N1, with larger size leading to increased amplitude9.
Attention can also voluntarily be allocated to features that are relevant for the task at hand, via spatial cues10,11 or task instructions12,13. Findings typically show that top-down attention manipulations to visual stimuli increase the amplitude of P1 and N1 components3,4,10,14. These early ERP components are less affected by secondary or preceding tasks (e.g., attentional blink)15,16 or evaluative processes (e.g., classifying or focusing on emotion)17,18,19,20.
A third source of perceptual relevance is emotional content21,22. Processing affectively charged visual stimuli – e.g., words23, faces24, naturalistic scenes20, or videos25 –, compared to their neutral controls, typically results in increased amplitude of specific ERP components, namely the Early Posterior Negativity (EPN) and the Late Positive Potential (LPP). The EPN arises at about 200 ms following stimulus onset and is related to early attentional selection26,27. The LPP occurs from about 400 ms after stimulus onset and reflects more elaborative and controlled processes, which are related to sustained attention, stimulus evaluation, affective labeling, and episodic memory formation28,29.
Importantly, bottom-up, top-down, and biological relevance do not act in isolation, but are interconnected22,30. Previous work has investigated how bottom-up stimulus features – e.g., spatial frequency31, color32, size33, picture complexity34, and brightness35 – may modulate behavioral and electrophysiological responses to emotional scenes. A parametric increase in stimulus size of emotional pictures may lead to growing subjective emotional arousal as well as selective amplification of the EPN33,36. Moreover, interactive effects of attention allocation towards emotional (i.e., erotic) material and processing of picture brightness have been reported at the level of the N1 component, whereas the EPN and LPP were reliably modulated by emotional content only35 – in contrast to the reported interactions of size and emotion at the EPN level. Higher visibility of emotional scenes by concurrent frequency filtering and size manipulation seems to have similarly increasing attentional effects when measuring reaction times and skin conductance response37,38.
Besides pictorial stimuli, many studies have used emotional and neutral words to investigate how the human brain processes emotional semantic information39,40. An advantage of using words over complex scenes is that luminance, spatial frequency content, and other perceptual statistical regularities can more easily be controlled (however, other non-emotional stimulus features – e.g., frequency41,42,43,44, length43, age of acquisition42 – influence recognition speed and accuracy, and must therefore be carefully matched across emotion classes). In general, emotional (compared to neutral) words are categorized more quickly and efficiently26,45, and concurrently elicit larger EPN and LPP amplitudes46,47,48,49. Emotion-dependent amplitude increases of early ERP components – i.e., P1 and N1 – are still under debate, due to mixed findings reported in the existing literature39.
Recent studies have explored whether changes in low-level visual properties can also modulate word processing. Bayer and colleagues50 presented positive, negative, and neutral words in either small or large font size, while requiring participants to perform an orthogonal 1-back task to ensure semantic processing of all stimuli. Large words elicited increased P1 and decreased N1 amplitudes, but no emotion-dependent modulations. Statistically significant interactions between font size and emotional content were observed in the late portion of the EPN, with more negative amplitude for emotional than neutral words further amplified when font size was large. The authors interpreted these results as reflecting early interactions of stimulus-driven, bottom-up properties with emotional content, in addition to the aforementioned top-down interactions with emotion at late stages. These authors further argued that sensory facilitation for motivationally relevant stimuli, initially thought to occur only for pictorial stimuli, might be generalized and extended to written words due to the high social relevance of language.
Despite these recent advancements, it is still unclear whether: (i) amplitude modulations of the aforementioned ERP components are limited to font size or may also be generalized to other visual features; (ii) emotion-related ERP amplitude amplification during visual word processing is related to low-level-feature changes or, instead, occurs independently from them. In the current study, forty participants were presented with unpleasant and neutral Dutch words shown in a large or small font size and in high or low contrast relative to a homogenous background. The task was to press the spacebar as soon as a word referring to a color would appear on screen. Hence, semantic processing of the words was required throughout the experiment. Using model comparison via Bayes factors, we examined ERP responses associated with early sensory and attentional processes as well as early lexical and later stages of processing. Bayes factors allow to quantify the evidence in favor of one model relative to another, e.g., a model that assumes medium-sized differences between conditions as opposed to a model that assumes no differences (for details, see Section 4.6).
Based on published findings, we expected to replicate the interaction between size and emotional content found at the level of the EPN50, showing increased emotion effects for larger words. Furthermore, if sensory facilitation can truly be generalized to symbolic material39,40,51, we should be able to observe not only size- but also contrast-dependent effects, specifically N1 amplitude modulations similar to what has been reported when using naturalistic scenes35. We additionally speculated that emotion might enhance visual processing especially for stimuli that are harder to discriminate (e.g., small, low-contrast words). We also addressed whether additive or interactive models best explained the ERP data, in contrast to published findings testing only main effects or interactions.
These theoretical predictions, together with a detailed description of the sampling criteria and analysis pipeline, were pre-registered on the Open Science Framework (https://osf.io/uf9gh/). Pre-registration effectively minimizes hindsight or confirmatory biases, since the research questions and analysis plans are defined before observing the outcome52.
The P1, N1, EPN, and LPP components were identified in the grand-averaged ERP signal using the mass univariate analysis approach described in Section 4.5. Average amplitude values for each component and condition can be found in Table 1. The left panel of Fig. 1 displays the waveforms and topographies for each component separately.
Table 1 Means and standard deviations (in parenthesis) of amplitude values (in µV) of the P1, N1, EPN, and LPP components.
Full size table
ERP waveforms, topographies, and amplitude values of each ERP component. The panels are divided according to component: (A) P1; (B) N1; (C) EPN; (D) LPP. Left panels show the grand average ERP waveforms, separately for each condition (see legends for the respective colors) and averaged across all conditions (black line, shaded area representing 95% confidence intervals). The signal was extracted from electrodes with signal robustly different from noise (highlighted in white in the topography; see Section 4.5 for details). Of note, the EPN was not extracted by averaging all conditions, but by computing the difference between negative and neutral conditions (irrespective of font size and contrast; see Section 4.5 for the rationale behind this choice). Right panels show the amplitude values of the respective component for each participant (gray dots) and experimental condition. Mean amplitude values are marked by horizontal black lines and 95% Bayesian highest density interval (HDI) are displayed as white boxes. Numbers represent, for each visual feature combination, the Bayes factors (BF10) in favor of the alternative model – hypothesizing differences between emotion conditions (prior on effect sizes with location δ = 0 and scaling factor r = 0.707) – versus the null model (difference between emotion conditions δ = 0). For details, see Section 4.6 and Table 3. Abbreviations: large low: large size, low contrast; large high: large size, high contrast; small low: small size, low contrast; small high: small size, high contrast; neg: negative; neut: neutral; localizer: average of all conditions; neg minus neut: difference between negative and neutral conditions (averaged across font size and contrast).
Full size image
Bayes factors are reported on the log scale. For ease of readability, only results obtained with JZS priors with location δ = 0 and scaling factor r = 0.707 are reported in the main text. Results obtained with other scaling factors can be found in the respective tables.
Mean amplitude values of the P1 component were best explained by the size × contrast × emotion interaction model, with a BF10 of e514.57 = 2.98 × 10223 relative to the null model. In other words, a model including all three factors and their interactions explained the observed data 2.98 × 10223 times better than a null model, i.e., not including any independent variables. The full model was also e514.57-490.49 = e24.08 = 2.87 × 1010 times better than the second-best model assuming additive effects of size, contrast, and emotion (Table 2). However, follow-up contrasts showed no reliable amplitude differences as a function of emotional content. Specifically, evidence leaned in favor of the null model when assessing emotion differences of words presented in small size and low contrast (BF10 = e−1.72 = 0.18), large size and high contrast (BF10 = 0.21), large size and low contrast (BF10 = 0.35), or small size and high contrast (BF10 = 0.73; inconclusive) (Table 3).
Table 2 Model comparisons, separately for each ERP component.
Full size table
Table 3 Post-hoc comparisons, separately for each ERP component.
Full size table
In a following step, we sought to assess the separate contribution of size, contrast, and emotion by including all possible models, i.e., not only the theoretically relevant ones that always included emotion. We started with the full model and progressively tested all models that could be created by removing one interaction or main effect one at a time (“top-down analysis”; see http://bayesfactorpcl.r-forge.r-project.org/#fixed). This procedure revealed that omitting the factor emotion from the full model improved fitting by 82.27 times. Removing the interactions size × contrast × emotion, contrast × emotion, and size × emotion also improved fitting by 35.52, 24.29, and 21.54 times, respectively. Thus, emotion did not seem to have any explanatory power; instead, it penalized the models in which it was included. Conversely, omitting the factor contrast or the contrast × size interaction lowered the explanatory value of the resulting model by 1/e−3.75 = 42.51 and 3.57 × 1014 times, respectively. Finally, removing the factor size was maximally detrimental, as it would lower the explanatory value of the resulting model by 9.79 × 1015 times (see Table 4).
Table 4 Updated fitting when independent variables or their interactions are removed from the full model, separately for each ERP component.
Full size table
To summarize, the amplitude of the P1 seemed to be mostly influenced by font size, contrast, and their interaction – with the lowest values in response to words presented in small font and low contrast –, whereas emotion did not seem to play a role.
Mean amplitude values of the N1 component were best explained by the size × contrast × emotion interaction model (including all three factors and their interactions) relative to the null (BF10 > 1.80 × 10308). The full model was also 9.96 × 1016 times better than the second-best model (additive effects of size + contrast + emotion). Nonetheless, similarly to the P1, follow-up contrasts showed that emotion did not influence N1 amplitude, with evidence favoring the null model in all tested comparisons (see Table 3 for details).
Additional top-down model comparisons showed that omitting contrast × emotion from the full model improved fitting by 67.36 times. Similarly, removing emotion × size, size × contrast × emotion, and emotion also improved fitting by 62.80, 54.05, and 45.15 times, respectively. On the other hand, omitting size or contrast × size lowered the explanatory value of the resulting model by 4.69 × 10−17 and 1.21 × 1022 times. Finally, omitting the factor contrast was maximally detrimental, as it lowered the explanatory value of the resulting model by 1.24 × 1055 times.
To summarize, the mean amplitude of the N1 component was reliably modulated by contrast as well as its interaction with size, with lower (i.e., less negative) values following words presented in small font and low contrast. In analogy with the preceding P1 component, emotional valence did not seem to modulate the amplitude of the N1.
Mean amplitude of the EPN was best explained by the size + emotion model, not only relative to the null model (BF10 > 1.80 × 10308) but also compared to the second-best model size × emotion (32.14). Follow-up paired comparisons investigating emotion-dependent amplitude modulations of this component showed evidence in favor of the null model when words were presented in small size and low contrast (BF10 = 0.19). However, the alternative model had to be preferred over the null when words were presented in small size and high contrast (BF10 = 10.07) as well as large size and low contrast (BF10 = 5.42). When words were presented in large size and high contrast, evidence remained inconclusive (BF10 = 0.53).
Model fitting improved if contrast, contrast × size, size × emotion, and contrast × emotion were removed from the full model, whereas removing the size × contrast × emotion interaction only marginally improved fitting. Interestingly, omitting the factor emotion decreased the explanatory value of the resulting model by 9.87 times, while removing size was much more deleterious (1.48 × 1039).
Thus, EPN amplitude was not reliably modulated by contrast but mostly by font size, with larger (i.e., more negative) values in response to words presented in large compared to small font. In addition, emotion had a small but non-negligible additive role, as evidenced by a slight increase in EPN amplitude for unpleasant compared to neutral words when presented in small font and high contrast as well as large font and low contrast.
Mean amplitude values of the LPP component were best explained by the size + contrast + emotion model (BF10 = 4.56 × 10225). This model was 450.34 times better than the full model. However, paired comparisons showed evidence in favor of the null as opposed to the emotion model when words were presented in large size and high contrast (BF10 = 0.17), small size and high contrast (BF10 = 0.18), and large size and low contrast (BF10 = 0.31). Evidence was inconclusive when words were presented in small size and low contrast (BF10 = 0.79).
Additional analyses showed that removing the factor emotion improved fitting by 47.94 times. Similarly, omitting contrast × emotion (29.08), size × emotion (23.81), and size × contrast × emotion (5.70) resulted in better fit of the resulting model. Conversely, removing contrast × size (56.26), contrast (3.30 × 1010), or size (2.89 × 1011) was deleterious.
Therefore, in this study, the mean amplitude of the LPP was reliably modulated by additive effects of size and contrast, with overall larger amplitude following words presented in small font and low contrast. Emotional valence did not seem to play a role.
Visual inspection of the ERP waveforms (left panels of Fig. 1) revealed that the highest peak of the P1 and N1 components changed as a function of experimental condition. This latency shift was not predicted in the pre-registered protocol and, in principle, could be a potential source of bias when analyzing mean amplitude values: for instance, the pre-selected time windows might encompass the whole ERP component in one condition, but only half of it in another one. To overcome this problem, we performed additional exploratory analyses using peak amplitude as dependent variable, with the important caveat that this measure is highly susceptible to noise53,54 and the results should therefore be interpreted with caution. We also analyzed peak latency, because this measure could still lead to valuable insights regarding the speed at which size and contrast influence event-related electrophysiological signals during emotional word reading. The results of these exploratory analyses – which can be found in the Supplementary Materials – did not challenge the main interpretation drawn based on the confirmatory results.
Source estimations were based on significant effects at the scalp level. Source reconstructions of the generators of significant ERP differences were computed and statistically assessed with SPM1255. Group inversion56 were computed, and the multiple sparse priors algorithm implemented in SPM12 was applied. Inversion results showed strong early visual responses both to size and contrast manipulations. Broad inferior and middle occipital, as well as fusiform responses were found for large words in the P1 and N1 time window. Later, within the EPN time window, additionally significant changes in cortical generators were localized in parietal areas. For high contrast, similarly broad enhanced visual responses were found in the N1 and EPN time window, as well as enhanced motor-related and posterior cingulate cortex activations. Later, in the LPP time window, this effect reversed, and low contrast led to stronger visual activations. Details can be found in the Supplementary Materials.
In this study, we orthogonally varied font size, contrast, and emotion content while examining ERP responses associated with sensory and attentional mechanisms. This study was conducted to better understand whether: (i) ERP modulations due to changes in low-level visual features are limited only to font size or can be generalized to other features (here, contrast); (ii) emotional information and low-level features would modulate amplitude additively or interactively. More generally, we sought to clarify whether sensory gating mechanisms, typically proposed to explain attentional modulations of electrophysiological signals in response to biologically salient pictures, could similarly underlie the enhanced processing of abstract word stimuli carrying a negative emotional meaning. By pre-registering the study and analysis protocol, we minimized biases possibly emerging after observing the study outcome52,57.
Low-level visual features dominate early perceptual processing stages
Font size and contrast were found to explain the observed amplitude changes of the P1 and N1 ERP components, which reflect early stages of stimulus detection and discrimination taking place in the extrastriate visual cortex3,4,5 These results are in line with previous work reporting larger P1 and N1 amplitudes for stimuli with higher contrast and larger size7,8,9. Our experimental design additionally revealed interactive effects of contrast and font size on P1 and N1 amplitudes, with lowest amplitudes in response to words presented in small font and low contrast. Moreover, our model comparison approach allowed us to precisely pinpoint the relative contribution of low-level features on ERP amplitude modulations. Specifically, for P1 amplitudes, size had the largest explanatory value, followed by its interaction with contrast. Conversely, changes in N1 amplitudes were mostly due to contrast, followed by its interaction with size. These results point to a possible “hierarchy” among several low-level features during word reading, with size being more salient during initial stimulus detection (P1) while contrast may be more relevant during discrimination processes (N1).
The current results did not reveal early effects of emotional content, in contrast with some studies49,58,59, but in accordance with others29,60,61. Future work is needed to directly evaluate whether early emotion effects reported in the literature might be contingent upon specific experimental conditions (e.g., lexical vs. semantic vs evaluative tasks). Also, emotion did not interact with either font size or contrast, at variance with similar studies using pictorial stimuli33,35,36, indirectly suggesting that biologically relevant pictures may be more salient than words during early stages of stimulus identification and discrimination.
Independent effects of size and emotion during early attentional selection
Emotional words typically elicit larger EPN compared to neutral words, indicating preferential lexical access due to early attentional selection26,47,49. In addition, recent work showed that font size may affect electrophysiological responses to emotional material, as evidenced by more negative EPN amplitude for large pictures and words36,50. Our results contribute to this debate in several ways. First, contrast alone does not seem to reliably explain amplitude variations of the EPN during word reading, similar to recent work using emotional and neutral pictures35. Second, we partially replicated the findings of Bayer and colleagues50 by showing slightly more negative EPN amplitude in response to emotional words when presented in large font, albeit only when contrast was low (right panel of Fig. 1C). These results were obtained using Dutch (instead of German) words, which speaks in favor of the generalizability of these modulatory effects.
We found larger EPN for emotional vs. neutral words also when font size was small and contrast was high. However, in contrast to previous studies using pictures or words36,50, no increased EPN amplitude for negative words was observed in response to large, high contrast stimuli. Thus, processing emotional valence while manipulating more than one low-level visual feature gives rise to more complex modulatory effects than previously reported (when only one single low-level feature was changed across conditions). We speculate that, for degraded visual stimuli (e.g., small, low contrast words), there might have been little room for EPN attentional enhancement by negative emotion. Conversely, since large high contrast words were easy to detect, no sensory gain by attentional processes was necessary in this condition. Interestingly, emotional valence seemed to boost brain activity in response to small high contrast as well as large low contrast words, i.e., two conditions in which basic visual information is concurrently facilitating and hindering recognition. This complex pattern challenges to some degree the idea of an automatic emotion processing at the EPN level, and suggests that enhanced attention to negative emotional words – as captured by the EPN – might depend on the processing efficiency of these low-level features.
Sustained processing of emotional content may be contingent upon task requests
Previous work has consistently shown larger LPP amplitudes for emotional compared to neutral words39,40 likely subtending sustained cognitive processes28,29. In our study, font size and contrast modulated LPP amplitude in an additive way, whereas emotion did not seem to play a role.
Several post-hoc explanations can be put forward to account for this result. First, the experimental task may contribute to the systematic modulation of this ERP component. For instance, explicitly requesting participants to pay attention to the semantic content of the words may be more effective in showing emotion-dependent amplitude differences compared to a simple detection task. However, this explanation seems unlikely, since a larger late positivity for emotional as opposed to neutral words has been observed in passive viewing designs62, color-naming63, lexical decision48,49,64, or word identification tasks65.
Another source of variation could stem from the task-relevance of the emotional content itself. Some authors argued that emotion captures attention only if (explicitly or implicitly) advantageous for participants to track this feature66,67,68,69,70. Indeed, a task that requires evaluating stimulus valence typically elicits stronger emotional modulation of the LPP (e.g., top-down attention to emotion or self-relevance evaluation19,71). In addition, Bayer et al.50 used an 1-back task to increase compliance. The authors interspersed special trials (identified by a green frame) requiring a button press if the current stimulus was identical to the immediately preceding one. This task requires online maintenance in working memory of the preceding word as well as updating, discrimination, recognition, and comparison with the newly presented word. Thus, constant rehearsal of the previous stimulus is a reasonable and efficient strategy to comply with task demands. In contrast, participants in our study were only required to identify whether the displayed word referred to a color, thereby limiting the processing time needed to complete the task. No updating in working memory was necessary. Therefore, the ERP signal we recorded reflects cognitive processes more consistently related to word reading and not contaminated by working memory components. These arguments notwithstanding, this project was based on Bayer et al.50 but not meant as its direct replication. Instead, we wished to assess the generalizability of the reported effect using an even simpler experimental paradigm, especially considering that results reported in the literature are not consistent (see Section 3.1).
From a different angle, it is also possible that participants’ attention was captured by the high variability in font size and contrast, whose saliency is arguably more powerful than emotional content per se. Affective differences might play a negligible role in visual word processing when there is a concurrent, massive variation of these sensory features. When competition occurs between different features, the ones that are the most salient (in this case, size and contrast) would bias attention the most and overshadow any potential effects of weaker ones, here emotion72.
It is also possible that we were unable to detect emotion-dependent modulations of electrophysiological activity because being too small, short-lived, or occurring in only partly overlapping time-windows or electrode clusters (or even within non-selected clusters). Recent MEG studies reported emotion-related activity originating from prefrontal generators, not linked to specific components58,73,74. However, similar caveats would also apply to earlier studies investigating modulations of early sensory processing at the scalp level.
The present findings suggest a hierarchical, serial interplay between the processing of low-level visual features and emotional content during word reading. Early perceptual processing was mostly influenced by the interaction between font size and contrast – i.e., smaller P1 and N1 for stimuli harder to discriminate –, whereas emotional content did not seem to be relevant. On the other hand, selective attention allocation was independently affected by font size and emotion: in particular, negative word meaning elicited a larger EPN when stimuli were presented in small font and high contrast. Thus, enhanced attention for negative emotion during word reading at the EPN level is not unconditional, but likely depending on the processing efficiency defined by the combination of low-level features, here with a focus on size and contrast. Later, sustained cognitive processes were sensitive to font size and contrast, presumably more salient than semantic information not only perceptually but also in terms of task-relevance.
A total of 42 participants were recruited from the student population of Ghent University. They were right-handed, native Dutch-speaking, healthy students, with normal or corrected-to-normal vision. The study protocol was approved by the ethics committee at Ghent University (Faculteit Psychologie en Pedagogische Wetenschappen, Kenmerk 2017/07/Gilles Pourtois), including any relevant details and confirming that the experiment was performed in accordance with relevant guidelines and regulations. Participants were required to sign an informed consent prior to the beginning of the experiment, debriefed at the end of it, and paid € 10 per hour for their participation.
Each dataset was considered eligible for further analyses if the EEG signal – after pre-processing – was judged “clean” based on criteria selected a priori (see Section 4.4), as well as demonstrating adequate task engagement based on behavioral performance (see Section 4.3). Two datasets were discarded: one due to performance below this threshold, the other because the participant aborted testing. Thus, the final sample consisted of 40 volunteers (all right-handed, median age 23.5, range 19–34, 26 females).
From the 20th participant onward, we monitored Bayes factors (BFs)75,76 every 3 participants (because 3 volunteers per day were tested). The a priori stopping rules were the following: (i) statistical rule: one of the models of interest (see Section 4.6) explained amplitude modulations of the components of interest 10 times better than the null model (or vice versa) and 10 times better than the second-best model; (ii) pragmatic rule: due to budgetary constraints, we had to stop after a maximum number of 40 participants with acceptable behavioral performance and clean EEG data. A third rule, not explicitly mentioned in the pre-registration protocol but logically following from the pre-registered analysis plan, was that the ERP components of interest had to be reliably different from noise (as confirmed by the procedure highlighted in Section 4.6). P1 and N1 were clear even after a few participants, whereas the signal-to-noise ratio of the EPN was generally lower. To ensure a robust identification of this component (as a difference between neutral and negative words, irrespective of size and contrast), we decided to complete data collection using the maximum possible number of participants.
Emotional and neutral words were selected from a database derived from a large multi-center study77. Two-hundred and forty negative and 240 neutral nouns were selected and matched with respect to word length, frequency, power/dominance (i.e., participants judged if words referred to something weak/submissive or strong/dominant), and age of acquisition (see Supplementary Table S1). The whole stimulus set was also rated during pilot testing, to further validate the stimulus selection (see Supplementary Table S2).
Participants were seated in a dimly lit, electrically shielded experimental room, with their head on a chin rest placed approximately 60 cm away from a 19″ CRT screen with resolution of 1,280 × 1,024 pixels. After filling out the informed consent and a short demographic questionnaire, the experiment began. In each trial, a single Dutch word (conveying either unpleasant or neutral content, based on the normative ratings in ref.77) was presented on a gray background (RGB values [201, 201, 201]), either in a small or large font (35 vs. 140 pixels; visual angle 3° × 1.1° and 11.8° × 3.6°, respectively) and in high or low contrast (RGB values [0, 0, 0] vs. [191, 191, 191]). This 2 (emotion) × 2 (size) × 2 (contrast) factorial design resulted in the presentation of 480 target words (60 stimuli per condition). For each participant, negative and neutral words were randomly assigned to each of these size and contrast variations. Additionally, 20 words describing colors (e.g., groen, i.e., green in Dutch) were presented in all size and contrast conditions, resulting in 80 additional probes. To ensure that participants would pay attention to the semantic content of each word, they were required to press the spacebar as soon as they could detect a word referring to a color. Accuracy and response times were recorded to verify task compliance (see Supplementary Materials). We decided a priori to exclude all participants with accuracy below 80% in any of the four size and contrast conditions, indicating insufficient attention to the words. The total number of 560 words were split in 8 runs of 70 words each. Participants could take a short break in between runs. Each word was presented for 1,000 ms, followed by a variable inter-trial interval between 1,000 and 1,500 ms displaying a fixation cross (70 pixels, RGB values [0, 0, 0]). The whole experiment (including EEG preparation) took approximately 50 minutes. Afterwards, two unrelated exploratory tasks (not part of this manuscript) were administered for approximately 40 minutes. Presentation software v17.2 (www.neurobehavioralsystems.com) was used for stimulus creation and presentation. The commented code is available at https://osf.io/c7g9y/.
EEG was recorded from 64 Ag/AgCl BioSemi active electrodes (BioSemi, Inc., The Netherlands) at a sampling rate of 256 Hz, online low-pass filtered at 100 Hz. The electrodes were fitted into an elastic cap following the BioSemi position system (i.e., electrode positions are radially equidistant from Cz; www.biosemi.com/headcap.htm). Two separate electrodes were used as ground electrodes, a Common Mode Sense active electrode (CMS) and a Driven Right Leg passive electrode (DLR), which form a feedback loop that enables measuring the average potential close to the reference in the A/D-box (www.biosemi.com/faq/cms&drl.htm). Four additional electrodes, placed near the outer canthi of the eyes and above and below the right eye, measured horizontal and vertical eye movements (electro-oculogram, EOG).
Data pre-processing was performed offline with custom scripts in MATLAB (R2015a; The MathWorks, Inc., Natick, MA), using functions included in EEGLAB v14.1.178, ERPLAB v6.1.479, the Signal Processing toolbox (v7.0), and the Statistics and Machine Learning Toolbox (v10.0). The continuous EEG data was assigned electrode coordinates, re-referenced to Cz and, after removing linear trends, filtered with separate Hamming windowed sinc FIR filters: (i) high-pass: passband edge 0.5 Hz, filter order 1,690, transition bandwidth 0.5 Hz, cutoff frequency (−6 dB) 0.25 Hz; (ii) low-pass: passband edge 30 Hz, filter order 114, transition bandwidth 7.4 Hz, cutoff frequency (−6 dB) 33.71 Hz. Flatline or noisy channels, short-time bursts, and ocular movements were detected and corrected via Artifact Subspace Reconstruction80,81. Details can be found in the official documentation of the clean_artifacts function. For the values assigned to each parameter, see our commented script at https://osf.io/c7g9y. We decided a priori to discard any dataset in which the artifact detection procedure identified more than 10 noisy scalp channels. No dataset fulfilled this criterion (the median number of interpolated channels was 4, range 1–10). Noisy channels were interpolated via a spherical spline procedure82. Please note that the interpolated channels were mostly identified outside of the clusters selected for the ERP components definition (max interpolated channels in clusters: (2); therefore, any potential distortions of the EEG signal due to interpolation was negligible. Ocular channels were discarded, and the scalp data re-referenced to the average signal. Epochs extending from −200 ms to +1,000 ms time-locked to word onset were created, and baseline correction was applied using the pre-stimulus interval. Finally, 8 grand-averages were computed following each combination of our 2 × 2 × 2 factorial design: (1) negative words, large font, high contrast; (2) negative words, small font, high contrast; (3) negative words, large font, low contrast; (4) negative words, small font, low contrast; (5) neutral words, large font, high contrast; (6) neutral words, small font, high contrast; (7) neutral words, large font, low contrast; (8) neutral words, small font, low contrast.
Identification of ERP components
The standard approach of selecting electrodes and time windows of the ERP components of interest by visually inspecting the grand-average waveforms can lead to a severe inflation of false positives53,83. Furthermore, this approach typically assumes that the ERP components observed in the grand-averaged data are reliably different from noise, but this assumption is seldom verified. To avoid these issues, we computed the grand-average ERP signal across all participants and conditions and conducted repeated measures, two-tailed permutation tests based on the tmax statistic84 implemented in the Mass Univariate ERP toolbox v1.2585,86:
compute the grand average across all trials, conditions, and participants (separately for each electrode and time point). With respect to the EPN, we averaged across all negative and neutral conditions (irrespective of size and contrast) and computed their mean difference (for the rationale, see below);
for each time point, compute a t-test between this average and a test value of zero (i.e., corresponding to no difference with baseline). The resulting t-value is stored and named tobserved;
randomly permute condition labels (i.e., each observation is either assigned its actual value or zero), calculate the t-test, and store its corresponding t-value;
repeat step 3 5,000 times to create a distribution of the possible t-values for these data under the null hypothesis;
the relative location of tobserved in this empirically generated null distribution provides the p-value for the observed data, i.e., how probable the actual difference wave at this specific time point would be if the null hypothesis were true;
at each time point, repeat this procedure for each electrode and retain only the highest t-value (i.e., tmax). The p-values for the original observations are derived from the tmax scores.
All timepoints between 0 and 1,000 ms (i.e., 256 timepoints at 256 Hz sampling rate) at all 64 scalp channels were included in the analysis, resulting in 16,384 total comparisons. The resulting differences were considered statistically significant (i.e., desired family-wise error rate kept at ~5%) if they exceeded the tmax of each set of tests.
As already mentioned in the pre-registration protocol, visual inspection of the results of the mass univariate procedure was carried out to minimize Type-II errors (this approach tends to be overly conservative) and ensure that the results would be consistent with well-known characteristics of the ERP components of interest (i.e., polarity, latency, and topography) that have been observed and replicated in the literature. Visual inspection of the localizer data revealed a topography and time window of the EPN that were slightly inconsistent with those reported earlier in the existing literature, i.e., a centroparietal electrode cluster (with positive amplitude values) instead of the typical occipital cluster (with negative amplitude values). Based on this observation, we refined the choice of electrodes and time windows by computing the tmax procedure on negative minus neutral difference waves (see https://osf.io/aev6j/ for the complete procedure in MATLAB). Please note that this approach also minimizes experimenter’s biases, because being performed on data averaged across font size and contrast.
This procedure allowed us to successfully identify the components of interest in the following electrode clusters and time windows post-word onset: (i) P1: 66–148 ms, 8 occipito-temporal sensors (P7, P9, PO7, O1, O2, PO8, P8, P10); (ii) N1: 150–260 ms, 6 temporal sensors (TP7, P7, P9, TP8, P8, P10); (iii) EPN: 300–500 ms, 12 occipito-temporal sensors (P7, P9, PO7, PO3, O1, Oz, Iz, O2, PO4, PO8, P8, P10); (iv) LPP: 402–684 ms, 10 parietal sensors (P1, Pz, P2, P4, P6, P8, P10, POz, PO4, PO8). Single-trial amplitude values within the aforementioned time windows and electrode clusters, calculated separately for each participant and condition, were submitted to the statistical analyses described below.
Statistical analyses of ERP amplitude values
We analyzed the amplitude values of each ERP component (P1, N1, EPN, and LPP) in the framework of model selection using Bayes Factors (BFs)75,76,87,88,89. We used the package BayesFactor v0.9.12-290 in R v3.4.3 (R Core Team, 2017) to estimate BFs (using Markov-Chain Monte Carlo sampling, 100,000 iterations) for each model of interest versus the null model. The additive models were: (1) size + emotion; (2) contrast + emotion; (3) size + contrast + emotion. The interactive models were: (4) size × emotion; (5) contrast × emotion; (6) size × contrast × emotion. Participants were included as varying factor, and their variance considered nuisance. Please note that, due to poor model convergence, we could not include stimuli (i.e., words) as random effect, contrary to our pre-registered plan.
To further characterize the direction of the effects, two-tailed Bayesian t-tests were calculated to estimate the degree of evidence in favor of a model assuming differences between two specified conditions relative to a model assuming no differences91,92. The null hypothesis was specified as a point-null prior (i.e., standardized effect size δ = 0), whereas the alternative hypothesis was defined as a Jeffrey-Zellner-Siow (JZS) prior, i.e., a folded Cauchy distribution centered around δ = 0 with scaling factors of r = 1, r = 0.707, and r = 0.5, to verify the robustness of the results93. The most conservative BF was used as reference to decide whether to continue with data collection (see Section 4.1).
Software used for visualization and statistical analyses
Visualization and statistical analyses were performed using R94 v3.4.4 via RStudio95 v1.1.453. We used the following packages (and their respective dependencies):
data manipulation: tidyverse96 v1.2.1;
statistical analyses: Rmisc97 v1.5, BayesFactor90 v 0.9.12-4.2;
visualization: yarrr98 v0.1.5, viridis99 v0.5.1, eegUtils100 v 0.2.0;
report generation: pacman101 v0.4.6, knitr102 v1.20, here103 v0.1.
Raw and pre-processed data, materials, and analysis scripts are available on https://osf.io/c7g9y/.
Publisher's note: Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Petersen, S. E. & Posner, M. I. The Attention System of the Human Brain: 20 Years After. Annu. Rev. Neurosci. 35, 73–89 (2012).
ArticlePubMedPubMed Central Google Scholar2.
Posner, M. I., Snyder, C. R. & Davidson, B. J. Attention and the detection of signals. J. Exp. Psychol. Gen. 109, 160 (1980).
Article Google Scholar3.
Hopfinger, J. B. & Mangun, G. R. Reflexive Attention Modulates Processing of Visual Stimuli in Human Extrastriate Cortex. Psychol. Sci. 9, 441–447 (1998).
ArticlePubMedPubMed Central Google Scholar4.
Luck, S. J. & Hillyard, S. A. Electrophysiological correlates of feature analysis during visual search. Psychophysiology 31, 291–308 (1994).
ArticlePubMed Google Scholar5.
Vogel, E. K. & Luck, S. J. The visual N1 component as an index of a discrimination process. Psychophysiology 37, 190–203 (2000).
ArticlePubMed Google Scholar6.
Hughes, H. C. Effects of flash luminance and positional expectancies on visual response latency. Percept. Psychophys. 36, 177–184 (1984).
ArticlePubMed Google Scholar7.
Johannes, S., Münte, T. F., Heinze, H. J. & Mangun, G. R. Luminance and spatial attention effects on early visual processing. Cogn. Brain Res. 2, 189–205 (1995).
Article Google Scholar8.
Wijers, A. A., Lange, J. J., Mulder, G. & Mulder, L. J. M. An ERP study of visual spatial attention and letter target detection for isoluminant and nonisoluminant stimuli. Psychophysiology 34, 553–565 (1997).
ArticlePubMed Google Scholar9.
Busch, N. A., Debener, S., Kranczioch, C., Engel, A. K. & Herrmann, C. S. Size matters: effects of stimulus size, duration and eccentricity on the visual gamma-band response. Clin. Neurophysiol. 115, 1810–1820 (2004).
ArticlePubMed Google Scholar10.
Mangun, G. R. & Hillyard, S. A. Modulations of sensory-evoked brain potentials indicate changes in perceptual processing during visual-spatial priming. J. Exp. Psychol. Hum. Percept. Perform. 17, 1057–1074 (1991).
ArticlePubMed Google Scholar11.
Slagter, H. A., Kok, A., Mol, N., Talsma, D. & Kenemans, J. L. Generating spatial and nonspatial attentional control: An ERP study. Psychophysiology 42, 428–439 (2005).
ArticlePubMed Google Scholar12.
Picton, T. W. The P300 wave of the human event-related potential. J. Clin. Neurophysiol. 9, 456–479 (1992).
ArticlePubMed Google Scholar13.
Polich, J. Updating P300: An Integrative Theory of P3a and P3b. Clin. Neurophysiol. Off. J. Int. Fed. Clin. Neurophysiol. 118, 2128–2148 (2007).
Article Google Scholar14.
Luck, S. J., Woodman, G. F. & Vogel, E. K. Event-related potential studies of attention. Trends Cogn. Sci. 4, 432–440 (2000).
ArticlePubMed Google Scholar15.
Kranczioch, C., Debener, S. & Engel, A. K. Event-related potential correlates of the attentional blink phenomenon. Cogn. Brain Res. 17, 177–187 (2003).
Article Google Scholar16.
McArthur, G., Budd, T. & Michie, P. The attentional blink and P300. NeuroReport 10, 3691 (1999).
ArticlePubMed Google Scholar17.
Hajcak, G., Dunning, J. P. & Foti, D. Motivated and controlled attention to emotion: Time-course of the late positive potential. Clin. Neurophysiol. 120, 505–510 (2009).
ArticlePubMed Google Scholar18.
Hajcak, G. & Nieuwenhuis, S. Reappraisal modulates the electrocortical response to unpleasant pictures. Cogn. Affect. Behav. Neurosci. 6, 291–297 (2006).
ArticlePubMed Google Scholar19.
Schindler, S. & Kissler, J. Selective visual attention to emotional words: Early parallel frontal and visual activations followed by interactive effects in visual cortex. Hum. Brain Mapp. 37, 3575–3587 (2016).
ArticlePubMed Google Scholar20.
Schupp, H. T. et al. Selective visual attention to emotion. J. Neurosci. 27, 1082–1089 (2007).
ArticlePubMed Google Scholar21.
Lang, P. J. & Bradley, M. M. Emotion and the motivational brain. Biol. Psychol. 84, 437–450 (2010).
ArticlePubMed Google Scholar22.
Pourtois, G., Schettino, A. & Vuilleumier, P. Brain mechanisms for emotional influences on perception and attention: what is magic and what is not. Biol. Psychol. 92, 492–512 (2013).
ArticlePubMed Google Scholar23.
Schindler, S., Wegrzyn, M., Steppacher, I. & Kissler, J. Perceived Communicative Context and Emotional Content Amplify Visual Word Processing in the Fusiform Gyrus. J. Neurosci. 35, 6010–6019 (2015).
ArticlePubMed Google Scholar24.
Wieser, M. J., Pauli, P., Reicherts, P. & Mühlberger, A. Don’t look at me in anger! Enhanced processing of angry faces in anticipation of public speaking. Psychophysiology 47, 271–280 (2010).
ArticlePubMed Google Scholar25.
Wiggert, N., Wilhelm, F. H., Reichenberger, J. & Blechert, J. Exposure to social-evaluative video clips: Neural, facial-muscular, and experiential responses and the role of social anxiety. Biol. Psychol. 110, 59–67 (2015).
ArticlePubMed Google Scholar26.
Kissler, J. & Herbert, C. Emotion, etmnooi, or emitoon? - Faster lexical access to emotional than to neutral words during reading. Biol. Psychol. 92, 464–479 (2013).
ArticlePubMed Google Scholar27.
Schupp, H. T., Junghöfer, M., Weike, A. I. & Hamm, A. O. The selective processing of briefly presented affective pictures: An ERP analysis. Psychophysiology 41, 441–449 (2004).
ArticlePubMed Google Scholar28.
Dolcos, F. & Cabeza, R. Event-related potentials of emotional memory: encoding pleasant, unpleasant, and neutral pictures. Cogn. Affect. Behav. Neurosci. 2, 252–63 (2002).
ArticlePubMed Google Scholar29.
Kissler, J., Herbert, C., Winkler, I. & Junghöfer, M. Emotion and attention in visual word processing - An ERP study. Biol. Psychol. 80, 75–83 (2009).
ArticlePubMed Google Scholar30.
Pessoa, L. On the relationship between emotion and cognition. Nat. Rev. Neurosci. 9, 148–158 (2008).
ArticlePubMed Google Scholar31.
Alorda, C., Serrano-Pedraza, I., Campos-Bueno, J. J., Sierra-Vázquez, V. & Montoya, P. Low spatial frequency filtering modulates early brain processing of affective complex pictures. Neuropsychologia 45, 3223–3233 (2007).
ArticlePubMed Google Scholar32.
Miskovic, V. et al. Electrocortical amplification for emotionally arousing natural scenes: The contribution of luminance and chromatic visual channels. Biol. Psychol. 106, 11–17 (2015).
ArticlePubMedPubMed Central Google Scholar33.
Codispoti, M. & De Cesarei, A. Arousal and attention: Picture size and emotional reactions. Psychophysiology 44, 680–686 (2007).
ArticlePubMed Google Scholar34.
Bradley, M. M., Hamby, S., Löw, A. & Lang, P. J. Brain potentials in perception: Picture complexity and emotional arousal. Psychophysiology 44, 364–373 (2007).
ArticlePubMed Google Scholar35.
Schettino, A., Keil, A., Porcu, E. & Müller, M. M. Shedding light on emotional perception: Interaction of brightness and semantic content in extrastriate visual cortex. NeuroImage 133, 341–353 (2016).
ArticlePubMed Google Scholar36.
De Cesarei, A. & Codispoti, M. When does size not matter? Effects of stimulus size on affective modulation. Psychophysiology 43, 207–215 (2006).
ArticlePubMed Google Scholar37.
De Cesarei, A. & Codispoti, M. Effects of Picture Size Reduction and Blurring on Emotional Engagement. PLOS ONE 5, e13399 (2010).
ADSArticlePubMedPubMed Central Google Scholar38.
De Cesarei, A. & Codispoti, M. Fuzzy picture processing: effects of size reduction and blurring on emotional processing. Emot. Wash. DC 8, 352–363 (2008).
Citron, F. M. M. Neural correlates of written emotion word processing: A review of recent electrophysiological and hemodynamic neuroimaging studies. Brain Lang. 122, 211–226 (2012).
ArticlePubMed Google Scholar40.
Kissler, J., Assadollahi, R. & Herbert, C. Emotional and semantic networks in visual word processing: insights from ERP studies. Prog. Brain Res. 156, 147–83 (2006).
ArticlePubMed Google Scholar41.
Balota, D. A. & Chumbley, J. I. The locus of word-frequency effects in the pronunciation task: Lexical access and/or production? J. Mem. Lang. 24, 89–106 (1985).
Article Google Scholar42.
Carroll, J. B. & White, M. N. Word frequency and age of acquisition as determiners of picture-naming latency. Q. J. Exp. Psychol. 25, 85–95 (1973).
Article Google Scholar43.
Hauk, O. & Pulvermüller, F. Effects of word length and frequency on the human event-related potential. Clin. Neurophysiol. 115, 1090–1103 (2004).
ArticlePubMed Google Scholar44.
Sereno, S. C., Brewer, C. C. & O’Donnell, P. J. Context Effects in Word Recognition: Evidence for Early Interactive Processing. Psychol. Sci. 14, 328–333 (2003).
ArticlePubMed Google Scholar45.
Kanske, P., Plitschka, J. & Kotz, S. A. Attentional orienting towards emotion: P2 and N400 ERP effects. Neuropsychologia 49, 3121–9 (2011).
ArticlePubMed Google Scholar46.
Kanske, P. & Kotz, S. A. Concreteness in emotional words: ERP evidence from a hemifield study. Brain Res. 1148, 138–48. Epub 2007 Feb 27. (2007).
Kissler, J., Herbert, C., Peyk, P. & Junghofer, M. Buzzwords: Early cortical responses to emotional words during reading. Psychol. Sci. 18, 475–480 (2007).
ArticlePubMed Google Scholar48.
Schacht, A. & Sommer, W. Time course and task dependence of emotion effects in word processing. Cogn. Affect. Behav. Neurosci. 9, 28–43, https://doi.org/10.3758/CABN.9.1.28. (2009).
ArticlePubMed Google Scholar49.
Scott, G. G., O’Donnell, P. J., Leuthold, H. & Sereno, S. C. Early emotion word processing: evidence from event-related potentials. Biol. Psychol. 80, 95–104, https://doi.org/10.1016/j.biopsycho.2008.03.010. Epub 2008 Mar 22. (2009).
Bayer, M., Sommer, W. & Schacht, A. Font Size Matters—Emotion and Attention in Cortical Responses to Written Words. PLoS One 7, e36042 (2012).
ADSArticlePubMedPubMed Central Google Scholar51.
Carretié, L. Exogenous (automatic) attention to emotional stimuli: a review. Cogn. Affect. Behav. Neurosci. 14, 1228–1258 (2014).
ArticlePubMedPubMed Central Google Scholar52.
Nosek, B. A., Ebersole, C. R., DeHaven, A. C. & Mellor, D. T. The preregistration revolution. Proc. Natl. Acad. Sci. 201708274 https://doi.org/10.1073/pnas.1708274114 (2018).
Keil, A. et al. Committee report: publication guidelines and recommendations for studies using electroencephalography and magnetoencephalography. Psychophysiology 51, 1–21 (2014).
ArticlePubMed Google Scholar54.
Luck, S. J. An introduction to the event-related potential technique. (MIT press, 2014).
Litvak, V. et al. EEG and MEG data analysis in SPM8. Comput. Intell. Neurosci. 2011, 1–32 (2011).
Article Google Scholar56.
Litvak, V. & Friston, K. Electromagnetic source reconstruction for group studies. Neuroimage 42, 1490–8, https://doi.org/10.1016/j.neuroimage.2008.06.022. (2008).
ArticlePubMedPubMed Central Google Scholar57.
Simmons, J. P., Nelson, L. D. & Simonsohn, U. False-positive psychology: Undisclosed flexibility in data collection and analysis allows presenting anything as significant. Psychol. Sci. 22, 1359–1366 (2011).
ArticlePubMed Google Scholar58.
Keuper, K. et al. Early prefrontal brain responses to the Hedonic quality of emotional words–a simultaneous EEG and MEG study. PloS One 8, e70788 (2013).
ADSArticlePubMedPubMed Central Google Scholar59.
Keuper, K. et al. How ‘love’ and ‘hate’ differ from ‘sleep’: Using combined electro/magnetoencephalographic data to reveal the sources of early cortical responses to emotional words. Hum. Brain Mapp. 35, 875–88 (2014).
ArticlePubMed Google Scholar60.
Bayer, M. & Schacht, A. Event-related brain responses to emotional words, pictures, and faces–a cross-domain comparison. Front. Psychol. 5, 1106 (2014).
ArticlePubMedPubMed Central Google Scholar61.
Schacht, A. & Sommer, W. Emotions in word and face processing: Early and late cortical responses. Brain Cogn. 69, 538–550 (2009).
ArticlePubMed Google Scholar62.
Herbert, C., Junghöfer, M. & Kissler, J. Event related potentials to emotional adjectives during reading. Psychophysiology 45, 487–498 (2008).
ArticlePubMed Google Scholar63.
Frühholz, S., Jellinghaus, A. & Herrmann, M. Time course of implicit processing and explicit processing of emotional faces and emotional words. Biol. Psychol. 87, 265–274 (2011).
ArticlePubMed Google Scholar64.
Hofmann, M. J., Kuchinke, L., Tamm, S., Võ, M. L.-H. & Jacobs, A. M. Affective processing within 1/10th of a second: High arousal is necessary for early facilitative processing of negative but not positive words. Cogn. Affect. Behav. Neurosci. 9, 389–397 (2009).
ArticlePubMed Google Scholar65.
Hinojosa, J. A., Méndez-Bértolo, C. & Pozo, M. A. Looking at emotional words is not the same as reading emotional words: Behavioral and neural correlates. Psychophysiology 47, 748–757 (2010).
PubMed Google Scholar66.
Everaert, T., Spruyt, A. & De Houwer, J. On the (un) conditionality of automatic attitude activation: The valence proportion effect. Can. J. Exp. Psychol. Can. Psychol. Expérimentale 65, 125 (2011).
Article Google Scholar67.
Everaert, T., Spruyt, A., Rossi, V., Pourtois, G. & De Houwer, J. Feature-specific attention allocation overrules the orienting response to emotional stimuli. Soc. Cogn. Affect. Neurosci. 9, 1351–1359 (2014).
ArticlePubMed Google Scholar68.
Itti, L., Rees, G. & Tsotsos, J. K. Neurobiology of attention. (Elsevier, 2005).
Pessoa, L. & Ungerleider, L. G. Visual attention and emotional perception. in Neurobiology of attention 160–166 (Elsevier, 2005).
Spruyt, A., De Houwer, J., Everaert, T. & Hermans, D. Unconscious semantic activation depends on feature-specific attention allocation. Cognition 122, 91–95 (2012).
ArticlePubMed Google Scholar71.
Bayer, M., Ruthmann, K. & Schacht, A. The impact of personal relevance on emotion processing: evidence from event-related potentials and pupillary responses. Soc. Cogn. Affect. Neurosci. 12, 1470–1479 (2017).
ArticlePubMedPubMed Central Google Scholar72.
Desimone, R. & Duncan, J. Neural Mechanisms of Selective Visual Attention. Annu. Rev. Neurosci. 18, 193–222 (1995).
ArticlePubMed Google Scholar73.
Hintze, P., Junghöfer, M. & Bruchmann, M. Evidence for rapid prefrontal emotional evaluation from visual evoked responses to conditioned gratings. Biol. Psychol. 99, 125–36 (2014).
ArticlePubMed Google Scholar74.
Rehbein, M. A. et al. Rapid prefrontal cortex activation towards aversively paired faces and enhanced contingency detection are observed in highly trait-anxious women under challenging conditions. Front. Behav. Neurosci. 9, 155 (2015).
ArticlePubMedPubMed Central Google Scholar75.
Jeffries, H. Theory of probability. (Clarendon Press, Oxford, 1961).
Kass, R. E. & Raftery, A. E. Bayes factors. J. Am. Stat. Assoc. 90, 773–795 (1995).
MathSciNetArticleMATH Google Scholar77.
Moors, A. et al. Norms of valence, arousal, dominance, and age of acquisition for 4,300 Dutch words. Behav. Res. Methods 45, 169–177 (2013).
ArticlePubMed Google Scholar78.
Delorme, A. & Makeig, S. EEGLAB: an open source toolbox for analysis of single-trial EEG dynamics including independent component analysis. J. Neurosci. Methods 134, 9–21 (2004).
ArticlePubMed Google Scholar79.
Lopez-Calderon, J. & Luck, S. J. ERPLAB: an open-source toolbox for the analysis of event-related potentials. Front. Hum. Neurosci. 8, 213 (2014).
ArticlePubMedPubMed Central Google Scholar80.
Mullen, T. R. et al. Real-time modeling and 3D visualization of source dynamics and connectivity using wearable EEG. In Engineering in Medicine and Biology Society (EMBC), 2013 35th Annual International Conference of the IEEE 2184–2187 (IEEE, 2013).
Mullen, T. R. et al. Real-time neuroimaging and cognitive monitoring using wearable dry EEG. IEEE Trans. Biomed. Eng. 62, 2553–2567 (2015).
ArticlePubMedPubMed Central Google Scholar82.
Perrin, F., Pernier, J., Bertrand, O. & Echallier, J. F. Spherical splines for scalp potential and current density mapping. Electroencephalogr. Clin. Neurophysiol. 72, 184–187 (1989).
ArticlePubMed Google Scholar83.
Luck, S. J. & Gaspelin, N. How to get statistically significant effects in any ERP experiment (and why you shouldn’t). Psychophysiology 54, 146–157 (2017).
ArticlePubMedPubMed Central Google Scholar84.
Blair, R. C. & Karniski, W. An alternative method for significance testing of waveform difference potentials. Psychophysiology 30, 518–524 (1993).
ArticlePubMed Google Scholar85.
Groppe, D. M., Urbach, T. P. & Kutas, M. Mass univariate analysis of event-related brain potentials/fields I: A critical tutorial review. Psychophysiology 48, 1711–1725 (2011).
ArticlePubMedPubMed Central Google Scholar86.
Groppe, D. M., Urbach, T. P. & Kutas, M. Mass univariate analysis of event-related brain potentials/fields II: Simulation studies. Psychophysiology 48, 1726–1737 (2011).
ArticlePubMedPubMed Central Google Scholar87.
Rouder, J. N., Engelhardt, C. R., McCabe, S. & Morey, R. D. Model comparison in ANOVA. Psychon. Bull. Rev. 23, 1779–1786 (2016).
ArticlePubMed Google Scholar88.
Rouder, J. N., Morey, R. D., Speckman, P. L. & Province, J. M. Default Bayes factors for ANOVA designs. J. Math. Psychol. 56, 356–374 (2012).
MathSciNetArticleMATH Google Scholar89.
Rouder, J. N., Morey, R. D., Verhagen, J., Swagman, A. R. & Wagenmakers, E.-J. Bayesian analysis of factorial designs. Psychological Methods 22(2), 304–321, https://doi.org/10.1037/met0000057 (2017).
Morey, R. D. & Rouder, J. N. Package ‘BayesFactor’. BayesFactor Comput. Bayes Factors Common Des. R Package Version 0912-2 HttpsCRANR-Proj. (2015).
Ly, A., Verhagen, J. & Wagenmakers, E.-J. Harold Jeffreys’s default Bayes factor hypothesis tests: Explanation, extension, and application in psychology. J. Math. Psychol. 72, 19–32 (2016).
MathSciNetArticleMATH Google Scholar92.
Rouder, J. N., Speckman, P. L., Sun, D., Morey, R. D. & Iverson, G. Bayesian t tests for accepting and rejecting the null hypothesis. Psychon. Bull. Rev. 16, 225–237 (2009).
ArticlePubMed Google Scholar93.
Schönbrodt, F. D., Wagenmakers, E.-J., Zehetleitner, M. & Perugini, M. Sequential hypothesis testing with Bayes factors: Efficiently testing mean differences. Psychol. Methods (2015).
R Core Team. R: A Langu age and Environment for Statistical Computing. (R Foundation for Statistical Computing, 2017).
RStudio Team. RStudio: Integrated Development for R. (RStudio, Inc., 2015).
Wickham, H. tidyverse: Easily Install and Load the ‘Tidyverse’. (2017).
Hope, R. M. Rmisc: Ryan Miscellaneous. (2013).
Phillips, N. yarrr: A Companion to the e-Book ‘YaRrr!: The Pirate’s Guide to R’. (2017).
Garnier, S. viridis: Default Color Maps from ‘matplotlib’. (2018).
Craddock, M. craddm/eegUtils: eegUtils (Versionv0.2. 0). Zenodo. (2018).
Rinker, T. W. & Kurkiewicz, D. pacman: Package Management for R. University at Buffalo. Buffalo, New York. http://github.com/trinker/pacman (2017).
Xie, Y. knitr: A General-Purpose Package for Dynamic Report Generation in R. (2018).
Müller, K. here: A Simpler Way to Find Your Files. (2017).
This work was supported by a postdoctoral mandate from Ghent University awarded to AS (BOF14/PDO/123) and a research grant from the Research Foundation Flanders (FWO) awarded to GP (3G024716). SS was supported by the German Academic Exchange Service (DAAD) with funds from the German Federal Ministry of Education and Research (BMBF) and the People Programme (Marie Curie Actions) of the European Union’s Seventh Framework Programme (FP7/2007–2013) under REA grant agreement n° 605728 (P.R.I.M.E. – Postdoctoral Researchers International Mobility Experience). We acknowledge support for the Article Processing Charge by the Deutsche Forschungsgemeinschaft and the Open Access Publication Fund of Bielefeld University.
Sebastian Schindler and Antonio Schettino contributed equally to this work.
AffiliationsDepartment of Experimental-Clinical and Health Psychology, Ghent University, Ghent, BelgiumSebastian Schindler, Antonio Schettino & Gilles PourtoisDepartment of Psychology, University of Bielefeld, Bielefeld, GermanySebastian SchindlerInstitute of Medical Psychology and Systems Neuroscience, University of Muenster, Muenster, GermanySebastian SchindlerInstitute for Globally Distributed Open Research and Education (IGDORE), Ubud, IndonesiaAntonio Schettino
AuthorsSearch for Sebastian Schindler in:Nature Research journals • PubMed • Google Scholar Search for Antonio Schettino in:Nature Research journals • PubMed • Google Scholar Search for Gilles Pourtois in:Nature Research journals • PubMed • Google Scholar
Conceived the experiment: S.S., A.S., G.P. Programmed the experimental paradigm and collected behavioral and electrophysiological data: S.S. Analyzed the data: A.S., S.S. Wrote the paper: S.S., A.S., G.P.
The authors declare no competing interests.
Correspondence to Sebastian Schindler.
Electronic supplementary material
Supplementary Word File
Rights and permissions
Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made. The images or other third party material in this article are included in the article’s Creative Commons license, unless indicated otherwise in a credit line to the material. If material is not included in the article’s Creative Commons license and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this license, visit http://creativecommons.org/licenses/by/4.0/.
About this article
10 May 2018
01 August 2018
15 August 2018