Abstract Visual surface perception is a fundamental aspect of vision, yet its neural implementation remains poorly understood. Troxler’s perceptual filling-in paradigm provides a tractable illusion for studying surface perception, in which a peripheral figure becomes perceptually assimilated into the surrounding background after a period of sustained fixation. Although neural correlates of this phenomenon have been reported in early visual cortex, the underlying mechanisms, particularly the contribution of feedback signaling, remain unresolved. Here we use ultra-high-field (7T) layer-fMRI to investigate perceptual filling-in in the human visual cortex. While experimentally controlling perceptual filling-in, we measured GE-BOLD responses in ten participants. Analyses across cortical depth in the independently localized figure representation in primary visual cortex (V1) revealed neural correlates of filling-in in deep cortical layers, which are associated with feedback input. These findings provide evidence that perceptual filling-in and visual surface perception in general are supported by feedback signals to early visual cortex.
Gamma synchrony is ubiquitous in visual cortex, but whether it contributes to perceptual grouping remains contentious based on observations that gamma frequency is not consistent across stimulus features and that gamma synchrony depends on distances between image elements. These stimulus dependencies have been argued to challenge the idea that the visual system groups image elements by synchronizing the neural assemblies that encode them. Here, we argue instead that these dependencies may shape synchrony in perceptually meaningful ways. Indeed, according to the theory of weakly coupled oscillators (TWCO), synchrony-based grouping mechanisms require stimulus dependence. Synchronization among coupled oscillators depends on frequency dissimilarity and coupling strength, which in early visual cortex relate to local feature dissimilarity and physical distance, respectively. We manipulated these factors in a texture segregation experiment wherein human observers identified the orientation of a figure defined by reduced contrast heterogeneity compared to the background. Human performance followed TWCO predictions both qualitatively and quantitatively, as formalized in a computational model. Moreover, we found that when enriched with a Hebbian learning rule, our model also predicted human learning effects: Increases in model gamma synchrony due to perceptual learning predicted improvements in texture segregation across sessions. Taken together, our data suggest that the stimulus-dependence of gamma synchrony captures local image statistics and is linked to the stimulus-dependence of texture segregation, and that the effect of visual experience on gamma synchrony provides a viable perceptual learning mechanism for training-induced improvements in texture segregation. Our results suggest that gamma synchrony with its inherent stimulus dependencies can provide a plausible mechanistic basis for perceptual grouping and visual scene segmentation.
The human brain exhibits remarkable sensitivity to auditory patterns. Previous research has shown that beyond the detection of such patterns, humans form memories for them that are implicit, robust to interference, and persistent over time. Here, we examine the mechanisms underlying implicit memory formation for reoccurring regular tone patterns using UHF fMRI. Prior to scanning, implicit memory was induced through a standard behavioral task where participants detected regular patterns embedded in random tone sequences. Unbeknownst to participants, five regular patterns reoccurred sporadically (every 1.5 min) across trials. Consistent with previous reports, behavioral performance indicated a reaction time advantage to reoccurring patterns, confirming the formation of implicit memory traces. During passive listening in the scanner, regularity engaged the superior temporal gyrus, inferior frontal gyrus, insula, putamen, and hippocampus, a result we interpret as reflecting the higher perceptual precision of regular patterns. Reoccurrence interacted with regularity in the superior temporal gyrus and a frontal cluster, showing higher activity for reoccurring compared to novel regular patterns. The hippocampus showed sensitivity to reoccurrence in both regular and random patterns. Together, these results indicate that the neocortex may selectively amplify reoccurring inputs in line with their enhanced (memory driven) perceptual precision. ### Competing Interest Statement The authors have declared no competing interest.
Surface perception relies on interactions between boundary encoding and surface filling-in. In a perceptual filling-in paradigm, a blank figure becomes perceptually replaced by a textured background after prolonged fixation of a point away from the figure. Filling-in begins when neurons representing the figure’s boundary adapt, allowing background-related activity to spread into the figure’s retinotopic representation. Adaptation proceeds faster the better the boundary is stabilized in a neuron’s receptive field (RF). We hypothesized that moving the figure boundary beyond a neuron’s RF would reduce adaptation and hinder filling-in, with larger movements permitting progressively less filling-in. As RF size increases with eccentricity, we further hypothesized that greater eccentricities would require larger movements to interfere with filling-in. Our results confirmed both predictions. The reduction in filling-in duration with increasing motion range permitted estimating RF size at each eccentricity. The slope of a linear function relating RF size to eccentricity matched values reported in human fMRI studies of V1/V2, suggesting that boundary adaptation involves early visual areas. We also explored whether microsaccade amplitude affects filling-in, but found no supporting evidence. Thus, external figure motion and microsaccades may disrupt adaptation through different mechanisms. These findings provide new insights into neural adaptation processes preceding perceptual filling-in. ### Competing Interest Statement The authors have declared no competing interest. NWO Open Competition, 406.21.GO.044
Previous studies using a visual texture discrimination task (TDT) have demonstrated that performance enhancements resulting from extensive daily training ( full training condition) remained intact after replacing all training, except for the first and last session, with a few daily reminder trials ( reminder condition). Omitting reminders ( control condition) yielded only limited learning, supporting their crucial contribution. We first confirmed these findings and excluded gaze position differences among conditions as a contributing factor. Next, we tested whether the reminders’ effectiveness is specific to a context of limited attention to the peripheral target caused by simultaneously performing a demanding fixation task. Removing the fixation task yielded performance levels in the first session matching those normally reached after lengthy daily training, suggesting that learning in the standard TDT involves the redeployment of attention. After changing texture parameters to increase the difficulty of the task, performing the TDT without a fixation task yielded learning in all three conditions. This indicates that in a dual-task, reminders can produce learning outcomes comparable to full training . In contrast, when the TDT is performed with full attention to the target, consolidation of the initial session alone can yield improvements equivalent to those observed in reminder and full training conditions. ### Competing Interest Statement The authors have declared no competing interest. NWO open competition, 406.21.GO.044
During ongoing narratives, event boundaries trigger processes relevant for subsequent memory. Previous work has shown that novel, unrelated input presented at an event boundary can retroactively interfere with short-term retention of the preceding event. This interference was attributed to a perturbation of offset-related processes taking place within seconds after encoding and supporting the binding of elements into a coherent event memory. However, the temporal specificity of this memory interference and whether its impact extends to longer retention delays has not been addressed. Here, participants viewed either individual or pairs of short narrative movie clips. Susceptibility to interference at event boundaries was probed by presenting the second clip either immediately after the first, or with a 2s encoding delay. In free and cued recall, after 20 min and 24 h, only memory for movie clips that were immediately followed by a second clip was reduced compared to clips shown in isolation. Intact offset-related processes (as indexed by successful recall of the first movie) did not negatively affect encoding of the subsequent clip. Together, these results indicate that the 2s time-window immediately after an event is relevant for successful consolidation and long-term retention of memory.
Temporal memory plays a crucial role in organizing real-life events into meaningful segments. Previous research suggests that the clustering of temporally related information builds on the neural correlates of associative memory, including theta oscillations. Transcranial alternating current stimulation (tACS) provides a means of modulating theta oscillations within associative memory networks, possibly including hippocampal modulation when targeting the parietal cortex. Theta oscillations are not limited to a single frequency range, but instead, exhibit functional specialization, with slow theta (3 Hz) implicated in short-term episodic memory formation and fast theta (8 Hz) involved in spatial navigation. Our study aimed to investigate the distinct effects of slow and fast theta stimulation on temporal memory. Participants encoded visual objects paired with frame color while receiving tACS stimulation at 3 Hz, 8 Hz, or sham targeting the left parietal cortex. The frame color would change after every eight objects, establishing a context boundary with each color change. Subsequently, participants performed a timeline task to assess temporal memory performance. Results showed that slow, but not fast, theta stimulation led to an enhancement in temporal accuracy (absolute temporal error) compared to sham tACS, in support of our main hypothesis. Under sham stimulation, participants consistently underestimated the temporal position of items presented further away from boundary, compared to those presented at boundary. This finding resembled temporal compression observed during event segmentation. Interestingly, fast, but not slow, theta stimulation reduced this temporal bias (rated position-actual position). This study represents the first tACS evidence for differential contributions of slow versus fast theta to temporal memory formation in humans. We speculate that parietal theta tACS may modulate the hippocampus and facilitate temporal memory formation.
Abstract Brain plasticity operates across various spatial and temporal scales, necessitating integrative multiscale approaches to fully capture its intricate underlying mechanisms. By combining methods with complementary strengths, multimodal imaging can help to bridge findings across multiple scales. This chapter discusses the potentials and challenges of multimodal imaging while proposing strategies to overcome the latter. The text focuses on recent advancements in three key types of multimodal applications, each serving distinct objectives: bridging spatial scale disparities, enhancing spatiotemporal resolution, and elucidating causal relations within functional brain networks. Finally, the chapter explores recent technological advances and novel combinations of neuromodulation and imaging techniques that may open new avenues for multimodal imaging of neuroplasticity with potential for clinical translations. By synergizing methodological strengths from various techniques, multimodal neuroimaging studies hold immense value for brain plasticity research, provided that accompanying challenges are effectively addressed.
Perceptual learning is the process by which experience alters how incoming sensory information is processed by the brain to give rise to behavior—it is critical for how humans educate children, train experts, treat diseases, and promote health and well-being throughout the lifespan. Knowledge of perceptual learning requires basic and applied research in humans and nonhuman animal models, which informs strategic targets for advancing applications. Commercial products to induce perceptual learning are proliferating rapidly with limited regulation (e.g., for rehabilitation), while at the same time basic science is increasingly restricted by changing regulations (such as new granting-agency definitions of clinical trials). Realizing the full potential of perceptual learning requires balancing basic and translational science to advance new knowledge, while serving and protecting consumers. Reforms can promote open, accessible, and representative research, and the translation of this research to applications across different sectors of society.
Sounds following a cue or embedded in a periodic rhythm are processed more effectively than sounds that are part of an aperiodic rhythm. One might also expect that a sound embedded in a periodic rhythm is processed more effectively than a sound following a single temporal cue. Such a finding would follow the theory that the entrainment of neural rhythmic activity by periodic stimuli renders the prediction of upcoming stimuli more efficient. We conducted a psychophysical experiment in which we tested the behavioral elements of this idea. Targets in periodic and aperiodic rhythms, if they occurred, always appeared at the same moment in time, and thus were fully predictable. In a first condition, participants remained unaware of this. In a second condition, an explicit instruction on the temporal location of the targets embedded in rhythms was provided. We assessed sensitivity and reaction times to the target stimuli in a difficult temporal detection task, and contrasted performance in this task to that obtained for targets temporally cued by a single preceding cue. Irrespective of explicit information about target predictability, target detection performance was always better in the periodic and temporal cue conditions, compared to the aperiodic condition. However, we found that the mere predictability of an acoustic target within a periodic rhythm did not allow participants to detect the target any better than in a condition where the target's timing was predicted by a single temporal cue. Only when participants were made aware of the specific moment in the periodic rhythm where the target could occur, did sensitivity increase. This finding suggests that a periodic rhythm is not automatically sufficient to provide perceptual benefits compared to a condition predictable yet not rhythmic condition (a cue). In some conditions, as shown here, these benefits may only occur in interaction with other factors such as explicit instruction and directed attention.
In everyday life, the processing of acoustic information allows us to react to subtle changes in the auditory scene. Yet even when closely attending to sounds in the context of a task, we occasionally miss task-relevant features. The neural computations that underlie our ability to detect behavioral relevant sound changes are thought to be grounded in both feedforward and feedback processes within the auditory hierarchy. Here, we assessed the role of feedforward and feedback contributions in primary and non-primary auditory areas during behavioral detection of target sounds using submillimeter spatial resolution functional magnetic resonance imaging (fMRI) at high-fields (7 T) in humans. We demonstrate that the successful detection of subtle temporal shifts in target sounds leads to a selective increase of activation in superficial layers of primary auditory cortex (PAC). These results indicate that feedback signals reaching as far back as PAC may be relevant to the detection of targets in the auditory scene.
Segmentation of a narrative stimulus, such as a movie, into discrete events affects and shapes temporal memory of that narrative. One consequence is that segmentation causes temporal memory compression, such that participants believe a recollected event to have lasted shorter than it did during encoding of the event. The mechanism underlying this effect is not clear, but there is growing evidence that boundaries play an important role. In this study, we investigated how boundary differences affected temporal memory and temporal compression of two sitcom episodes. In a pilot study, participants segmented each episode while watching. Results showed more boundaries and a stronger inter-subject agreement about those boundaries for episode 1 compared to episode 2, suggesting a systematic difference in segmentation between the two episodes. In the first main experiment, new participants watched the two episodes and, after each episode, judged when movie frames occurred in the episode’s timeline. Results showed more temporal compression for the episode with larger boundary agreement, irrespective of the visual or semantic knowledge of participants about the episodes. In the second experiment, participants watched one of the episodes twice, on different days. Results showed that repeated watching increased boundary agreement and temporal expectations about when those boundaries would occur, but also increased temporal compression. Further, temporal compression correlated moderately with increased boundary expectation, suggesting a relation between boundary perception and updating of temporal memory. We discuss our findings in light of current theories about event segmentation and temporal memory updating.
Various studies claim that early-learned, culture-typical (canonical) finger configurations used to communicate or represent numerosity, have stronger connections to numerical concepts stored in long-term memory than cultural-unfamiliar finger configurations, thereby allowing for faster access to their numerical meaning. The current study investigated whether presentation of canonical finger configurations gesturing numerosities 1-4 or 6-9 would facilitate young adults' behavioral and neural processing of Arabic numerals. Thirty-one adults performed a number comparison task in which they had to decide whether simultaneously presented Arabic numerals and canonical or non-canonical finger configurations showed the same or a different numerosity, while measuring their performance and Event-Related Potentials (ERPs). The results showed faster responses when comparisons involved canonical (versus non-canonical) finger configurations, but only on numerosity-congruent trials where finger configuration and Arabic numeral matched in number identity. Canonical, and small-number finger configurations 1-4 in general (irrespective of their canonicity), also elicited enhanced amplitude of the early right-parietal P2p, and the later centro-parietal P3 on numerosity-congruent trials. We suggest these P2p and P3 findings respectively reflect facilitated numerical access and easier categorization of canonical finger-numeral configurations. The current results provide behavioral and neurophysiological evidence for the embodiment of culture-specific, canonical, finger-numeral configurations, and their link with other number representations in the adult brain, likely emerging from their more frequent use in daily life communication and/or in early childhood during number symbol acquisition.
Brain oscillations emerge during sensory and cognitive processes and have been classified into different frequency bands. Yet, even within the same frequency band and between nearby brain locations, the exact frequencies of brain oscillations can differ. These frequency differences (detuning) have been largely ignored and play little role in current functional theories of brain oscillations. This contrasts with the crucial role that detuning plays in synchronization theory, as originally derived in physical systems. Here, we propose that detuning is equally important to understand synchronization in biological systems. Detuning is a critical control parameter in synchronization, which is not only important in shaping phase-locking, but also in establishing preferred phase relations between oscillators. We review recent evidence that frequency differences between brain locations are ubiquitous and essential in shaping temporal neural coordination. With the rise of powerful experimental techniques to probe brain oscillations, the contributions of exact frequency and detuning across neural circuits will become increasingly clear and will play a key part in developing a new understanding of the role of oscillations in brain function.
Sleep spindles (8 - 16 Hz) are transient electrophysiological events during non-rapid eye movement sleep. While sleep spindles are routinely observed in the cortex using scalp electroencephalography (EEG), recordings of their thalamic counterparts have not been widely studied in humans. Based on a few existing studies, it has been hypothesized that spindles occur as largely local phenomena. We investigated intra-thalamic and thalamocortical spindle co-occurrence, which may underlie thalamocortical communication. We obtained scalp EEG and thalamic recordings from 7 patients that received bilateral deep brain stimulation (DBS) electrodes to the anterior thalamus for the treatment of drug resistant focal epilepsy. Spindles were categorized into subtypes based on their main frequency (i.e., slow (10±2 Hz) or fast (14±2 Hz)) and their level of thalamic involvement (spanning one channel, or spreading uni- or bilaterally within the thalamus). For the first time, we contrasted observed spindle patterns with permuted data to estimate random spindle co-occurrence. We found that multichannel spindle patterns were systematically coordinated at the thalamic and thalamocortical level. Importantly, distinct topographical patterns of thalamocortical spindle overlap were associated with slow and fast subtypes of spindles. These observations provide further evidence for coordinated spindle activity in thalamocortical networks.
Visuospatial attention can either be voluntarily directed (endogenous/top-down attention) or automatically triggered (exogenous/bottom-up attention). Recent research showed that dorsal parietal transcranial alternating current stimulation (tACS) at alpha frequency modulates the spatial attentional bias in an endogenous but not in an exogenous visuospatial attention task. Yet, the reason for this task-specificity remains unexplored. Here, we tested whether this dissociation relates to the proposed differential role of the dorsal attention network (DAN) and ventral attention network (VAN) in endogenous and exogenous attention processes respectively. To that aim, we targeted the left and right dorsal parietal node of the DAN, as well as the left and right ventral temporoparietal node of the VAN using tACS at the individual alpha frequency. Every participant completed all four stimulation conditions and a sham condition in five separate sessions. During tACS, we assessed the behavioral visuospatial attention bias via an endogenous and exogenous visuospatial attention task. Additionally, we measured offline alpha power immediately before and after tACS using electroencephalography (EEG). The behavioral data revealed an effect of tACS on the endogenous but not exogenous attention bias, with a greater leftward bias during (sham-corrected) left than right hemispheric stimulation. In line with our hypothesis, this effect was brain area-specific, i.e., present for dorsal parietal but not ventral temporoparietal tACS. However, contrary to our expectations, there was no effect of ventral temporoparietal tACS on the exogenous visuospatial attention bias. Hence, no double dissociation between the two targeted attention networks. There was no effect of either tACS condition on offline alpha power. Our behavioral data reveal that dorsal parietal but not ventral temporoparietal alpha oscillations steer endogenous visuospatial attention. This brain-area specific tACS effect matches the previously proposed dissociation between the DAN and VAN and, by showing that the spatial attention bias effect does not generalize to any lateral posterior tACS montage, renders lateral cutaneous and retinal effects for the spatial attention bias in the dorsal parietal condition unlikely. Yet the absence of tACS effects on the exogenous attention task suggests that ventral temporoparietal alpha oscillations are not functionally relevant for exogenous visuospatial attention. We discuss the potential implications of this finding in the context of an emerging theory on the role of the ventral temporoparietal node.
Transcranial alternating current stimulation (tACS) at 10 Hz has been shown to modulate spatial attention. However, the frequency-specificity and the oscillatory changes underlying this tACS effect are still largely unclear. Here, we applied high-definition tACS at individual alpha frequency (IAF), two control frequencies (IAF+/-2Hz) and sham to the left posterior parietal cortex and measured its effects on visuospatial attention performance and offline alpha power (using electroencephalography, EEG). We revealed a behavioural and electrophysiological stimulation effect relative to sham for IAF but not control frequency stimulation conditions: there was a leftward lateralization of alpha power for IAF tACS, which differed from sham for the first out of three minutes following tACS. At a high value of this EEG effect (moderation effect), we observed a leftward attention bias relative to sham. This effect was task-specific, i.e., it could be found in an endogenous attention but not in a detection task. Only in the IAF tACS condition, we also found a correlation between the magnitude of the alpha lateralization and the attentional bias effect. Our results support a functional role of alpha oscillations in visuospatial attention and the potential of tACS to modulate it. The frequency-specificity of the effects suggests that an individualization of the stimulation frequency is necessary in heterogeneous target groups with a large variation in IAF.
The nucleus basalis of Meynert (nbM) is the major source of cortical acetylcholine (ACh) and has been related to cognitive processes and to neurological disorders. However, spatially delineating the human nbM in MRI studies remains challenging. Due to the absence of a functional localiser for the human nbM, studies to date have localised it using nearby neuroanatomical landmarks or using probabilistic atlases. To understand the feasibility of MRI of the nbM we set our four goals; our first goal was to review current human nbM region-of-interest (ROI) selection protocols used in MRI studies, which we found have reported highly variable nbM volume estimates. Our next goal was to quantify and discuss the limitations of existing atlas-based volumetry of nbM. We found that the identified ROI volume depends heavily on the atlas used and on the probabilistic threshold set. In addition, we found large disparities even for data/studies using the same atlas and threshold. To test whether spatial resolution contributes to volume variability, as our third goal, we developed a novel nbM mask based on the normalized BigBrain dataset. We found that as long as the spatial resolution of the target data was 1.3 mm isotropic or above, our novel nbM mask offered realistic and stable volume estimates. Finally, as our last goal we tried to discern nbM using publicly available and novel high resolution structural MRI ex vivo MRI datasets. We find that, using an optimised 9.4T quantitative T2⁎ ex vivo dataset, the nbM can be visualised using MRI. We conclude caution is needed when applying the current methods of mapping nbM, especially for high resolution MRI data. Direct imaging of the nbM appears feasible and would eliminate the problems we identify, although further development is required to allow such imaging using standard (f)MRI scanning.