Tracking signal flow across areas is essential for understanding brain function. Recent studies using cross-covariances show that activity directionality can shift rapidly with behavioral or task demands; yet, the circuit mechanisms underlying these changes remain unclear. Here, we use recurrent network models to investigate how directional interactions emerge and are flexibly reconfigured in multi-area cortical circuits. We show that, for fixed connectivity, directionality is shaped by how common inputs align with recurrent connectivity and the associated internal timescales of activity. In multi-area circuits with locally balanced excitation and inhibition, this reveals a predominant role for inputs to excitatory over inhibitory populations in controlling directionality. These inputs govern the directionality of the latent signals that account for most of the shared activity across areas, predominantly reflecting widespread and coherent activity fluctuations. Our models capture key features of cross-covariances from primate areas V1 and V2 and suggest parsimonious mechanisms for the shift in directionality reported in these areas. This work establishes a mechanistic framework for understanding dynamic changes in signal flow between brain areas.

Brain functions involve processing in local networks as well as modulation from brainwide signals, such as arousal. Dissecting the contributions of populations of neurons to these functions requires knowledge of interactions between brain areas. We investigated these interactions using dual hemisphere recordings of prefrontal cortex in monkeys performing a spatial memory task. To tease apart global processing from local interactions, we applied a novel statistical approach called pCCA-FA (a combination of probabilistic canonical correlation analysis and factor analysis) to analyze trial-to-trial variability in neuronal activity. We found substantial shared variability among neurons within each population, much of which was actually shared across populations and linked to an arousal process. Our work presents a path by which we can leverage multi-area recordings to reveal aspects of brain functions that are hidden in single-area recordings.

Establishing causal relationships between neural activity and brain function requires experimental perturbations of neural activity. Many existing perturbation methods modify activity by directly applying external signals to the brain. We review an alternative approach where brain-computer interfaces (BCIs) leverage volitional control of neural activity to manipulate and causally perturb it. We highlight the potential of BCIs to manipulate neural activity in ways that are flexible, accurate, and adhere to intrinsic biophysical and network-level constraints to investigate the consequences of configuring neural population activity in specified ways. We discuss the advantages and disadvantages of using BCIs as a perturbation tool compared with other perturbation methods and how BCIs can expand the scope of questions that can be addressed about brain function.

The manner in which neural activity unfolds over time is thought to be central to sensory, motor and cognitive functions in the brain. Network models have long posited that the brain's computations involve time courses of activity that are shaped by the underlying network. A prediction from this view is that the activity time courses should be difficult to violate. We leveraged a brain-computer interface to challenge monkeys to violate the naturally occurring time courses of neural population activity that we observed in the motor cortex. This included challenging animals to traverse the natural time course of neural activity in a time-reversed manner. Animals were unable to violate the natural time courses of neural activity when directly challenged to do so. These results provide empirical support for the view that activity time courses observed in the brain indeed reflect the underlying network-level computational mechanisms that they are believed to implement.

Gaussian processes are now commonly used in dimensionality reduction approaches tailored to neuroscience, especially to describe changes in high-dimensional neural activity over time. As recording capabilities expand to include neuronal populations across multiple brain areas, cortical layers, and cell types, interest in extending gaussian process factor models to characterize multipopulation interactions has grown. However, the cubic runtime scaling of current methods with the length of experimental trials and the number of recorded populations (groups) precludes their application to large-scale multipopulation recordings. Here, we improve this scaling from cubic to linear in both trial length and group number. We present two approximate approaches to fitting multigroup gaussian process factor models based on inducing variables and the frequency domain. Empirically, both methods achieved orders of magnitude speed-up with minimal impact on statistical performance, in simulation and on neural recordings of hundreds of neurons across three brain areas. The frequency domain approach, in particular, consistently provided the greatest runtime benefits with the fewest trade-offs in statistical performance. We further characterize the estimation biases introduced by the frequency domain approach and demonstrate effective strategies to mitigate them. This work enables a powerful class of analysis techniques to keep pace with the growing scale of multipopulation recordings, opening new avenues for exploring brain function.

To generate movements, the brain must combine information about movement goal and body posture. The motor cortex (primary motor cortex [M1]) is a key node for the convergence of these information streams. How are posture and goal signals organized within M1's activity to permit the flexible generation of movement commands? To answer this question, we recorded M1 activity while monkeys performed a variety of tasks with the forearm in a range of postures. We found that posture- and goal-related components of neural population activity were separable and resided in nearly orthogonal subspaces. The posture subspace was stable across tasks. Within each task, neural trajectories for each goal had similar shapes across postures. Our results reveal a simpler organization of posture signals in M1 than previously recognized. The compartmentalization of posture and goal signals might allow the two to be flexibly combined in the service of our broad repertoire of actions.

Delay period activity in the dorsolateral prefrontal cortex (dlPFC) has been linked to the maintenance and control of sensory information in working memory. The stability of working memory-related signals found in such delay period activity is believed to support robust memory-guided behavior during sensory perturbations, such as distractors. Here, we directly probed dlPFC's delay period activity with a diverse set of activity perturbations and measured their consequences on neural activity and behavior. We applied patterned microstimulation to the dlPFC of two male rhesus macaques implanted with multielectrode arrays by electrically stimulating different electrodes in the array while they performed a memory-guided saccade task. We found that the microstimulation perturbations affected spatial working memory-related signals in individual dlPFC neurons. However, task performance remained largely unaffected. These apparently contradictory observations could be understood by examining different dimensions of the dlPFC population activity. In dimensions where working memory-related signals naturally evolved over time, microstimulation impacted neural activity. In contrast, in dimensions containing working memory-related signals that were stable over time, microstimulation minimally impacted neural activity. This dissociation could explain how working memory-related information may be stably maintained in dlPFC despite the activity changes induced by microstimulation. Thus, working memory processes are robust to a variety of activity perturbations in the dlPFC.

The coordinated activity of neural populations underlies myriad brain functions. Manipulating this activity using brain stimulation techniques has great potential for scientific and clinical applications, as it provides a tool to causally influence brain function. The state of the brain affects how neural populations respond to incoming sensory stimuli. Thus, taking into account pre-stimulation neural population activity may be crucial to achieve a desired causal manipulation using stimulation. In this work, we propose Online MicroStimulation Optimization (OMiSO), a brain stimulation framework that leverages brain state information to find stimulation parameters that can drive neural population activity toward specified states. OMiSO includes two key advances: i) it leverages the pre-stimulation brain state to choose optimal stimulation parameters, and ii) it adaptively refines the choice of those parameters by considering newly-observed stimulation responses. We tested OMiSO by applying intracortical electrical microstimulation in a monkey and found that it outperformed competing methods that do not incorporate these advances. Taken together, OMiSO provides greater accuracy in achieving specified activity states, thereby advancing neuromodulation technologies for understanding the brain and for treating brain disorders.

A remarkable demonstration of the flexibility of mammalian motor systems is primates’ ability to learn to control brain-computer interfaces (BCIs). This constitutes a completely novel motor behavior, yet primates are capable of learning to control BCIs under a wide range of conditions. BCIs with carefully calibrated decoders, for example, can be learned with only minutes to hours of practice. With a few weeks of practice, even BCIs with randomly constructed decoders can be learned. What are the biological substrates of this learning process? Here, we develop a theory based on a re-aiming strategy, whereby learning operates within a low-dimensional subspace of task-relevant inputs driving the local population of recorded neurons. Through comprehensive numerical and formal analysis, we demonstrate that this theory can provide a unifying explanation for disparate phenomena previously reported in three different BCI learning tasks, and we derive a novel experimental prediction that we verify with previously published data. By explicitly modeling the underlying neural circuitry, the theory reveals an interpretation of these phenomena in terms of biological constraints on neural activity.

Understanding brain function is facilitated by constructing computational models that accurately reproduce aspects of brain activity. Networks of spiking neurons capture the underlying biophysics of neuronal circuits, yet the dependence of their activity on model parameters is notoriously complex. As a result, heuristic methods have been used to configure spiking network models, which can lead to an inability to discover activity regimes complex enough to match large-scale neuronal recordings. Here we propose an automatic procedure, Spiking Network Optimization using Population Statistics (SNOPS), to customize spiking network models that reproduce the population-wide covariability of large-scale neuronal recordings. We first confirmed that SNOPS accurately recovers simulated neural activity statistics. Then, we applied SNOPS to recordings in macaque visual and prefrontal cortices and discovered previously unknown limitations of spiking network models. Taken together, SNOPS can guide the development of network models and thereby enable deeper insight into how networks of neurons give rise to brain function.

Incentives tend to drive improvements in performance. But when incentives get too high, we can “choke under pressure” and underperform right when it matters most. What neural processes might lead to choking under pressure? We studied rhesus monkeys performing a challenging reaching task in which they underperformed when an unusually large “jackpot” reward was at stake, and we sought a neural mechanism that might result in that underperformance. We found that increases in reward drive neural activity during movement preparation into, and then past, a zone of optimal performance. We conclude that neural signals of reward and motor preparation interact in the motor cortex (MC) in a manner that can explain why we choke under pressure.

The most prominent characteristic of motor cortex is its activation during movement execution, but it is also active when we simply imagine movements in the absence of actual motor output. Despite decades of behavioural and imaging studies, it is unknown how the specific activity patterns and temporal dynamics in motor cortex during covert motor imagery relate to those during motor execution. Here we recorded intracortical activity from the motor cortex of two people who retain some residual wrist function following incomplete spinal cord injury as they performed both actual and imagined isometric wrist extensions. We found that we could decompose the population activity into three orthogonal subspaces, where one was similarly active during both action and imagery, and the others were active only during a single task type—action or imagery. Although they inhabited orthogonal neural dimensions, the action-unique and imagery-unique subspaces contained a strikingly similar set of dynamic features. Our results suggest that during motor imagery, motor cortex maintains the same overall population dynamics as during execution by reorienting the components related to motor output and/or feedback into a unique, output-null imagery subspace.

Brain stimulation has the potential to create desired neural population activity states. However, it is challenging to search the large space of stimulation parameters, for example, selecting which subset of electrodes to be used for stimulation. In this scenario, creating a model that maps the configuration of stimulation parameters to the brain’s response can be beneficial. Training such an expansive model usually requires more stimulation-response samples than can be collected in a given experimental session. Furthermore, changes in the properties of the recorded activity over time can make it challenging to merge stimulation-response samples across sessions. To address these challenges, we propose MiSO (MicroStimulation Optimization), a closed-loop stimulation framework to drive neural population activity toward specified states by optimizing over a large stimulation parameter space. MiSO consists of three key components: 1) a neural activity alignment method to merge stimulation-response samples across sessions, 2) a statistical model trained on the merged samples to predict the brain's response to untested stimulation parameter configurations, and 3) an online optimization algorithm to adaptively update the stimulation parameter configuration based on the model's predictions. In this study, we implemented MiSO with a factor analysis (FA) based alignment method, a convolutional neural network (CNN), and an epsilon greedy optimization algorithm. We tested MiSO in closed-loop experiments using electrical microstimulation in the prefrontal cortex of a non-human primate. Guided by the CNN predictions, MiSO successfully searched amongst thousands of stimulation parameter configurations to drive the neural population activity toward specified states. More broadly, MiSO increases the clinical viability of neuromodulation technologies by enabling the use of many-fold larger stimulation parameter spaces.

How are we able to learn new behaviors without disrupting previously learned ones? To understand how the brain achieves this, we used a brain-computer interface (BCI) learning paradigm, which enables us to detect the presence of a memory of one behavior while performing another. We found that learning to use a new BCI map altered the neural activity that monkeys produced when they returned to using a familiar BCI map in a way that was specific to the learning experience. That is, learning left a “memory trace” in the primary motor cortex. This memory trace coexisted with proficient performance under the familiar map, primarily by altering neural activity in dimensions that did not impact behavior. Forming memory traces might be how the brain is able to provide for the joint learning of multiple behaviors without interference.

Modern recording techniques now allow us to record from distinct neuronal populations in different brain networks. However, especially as we consider multiple (more than two) populations, new conceptual and statistical frameworks are needed to characterize the multi-dimensional, concurrent flow of signals among these populations. Here, we develop a dimensionality reduction framework that determines (1) the subset of populations described by each latent dimension, (2) the direction of signal flow among those populations, and (3) how those signals evolve over time within and across experimental trials. We illustrate these features in simulation, and further validate the method by applying it to previously studied recordings from neuronal populations in macaque visual areas V1 and V2. Then we study interactions across select laminar compartments of areas V1, V2, and V3d, recorded simultaneously with multiple Neuropixels probes. Our approach uncovered signatures of selective communication across these three areas that related to their retinotopic alignment. This work advances the study of concurrent signaling across multiple neuronal populations.

The most prominent role of motor cortex is generating patterns of neural activity that lead to movement, but it is also active when we simply imagine movements in the absence of actual motor output. Despite decades of behavioral and imaging studies, it is unknown how the specific activity patterns and temporal dynamics within motor cortex during covert motor imagery relate to those during motor execution. Here we recorded intracortical activity from the motor cortex of two people with residual wrist function following incomplete spinal cord injury as they performed both actual and imagined isometric wrist extensions. We found that we could decompose the population-level activity into orthogonal subspaces such that one set of components was similarly active during both action and imagery, and others were only active during a single task type—action or imagery. Although they inhabited orthogonal neural dimensions, the action-unique and imagery-unique subspaces contained a strikingly similar set of dynamical features. Our results suggest that during motor imagery, motor cortex maintains the same overall population dynamics as during execution by recreating the missing components related to motor output and/or feedback within a unique imagery-only subspace.

Brain function relies on the coordination of activity across multiple, recurrently connected brain areas. For instance, sensory information encoded in early sensory areas is relayed to, and further processed by, higher cortical areas and then fed back. However, the way in which feedforward and feedback signaling interact with one another is incompletely understood. Here we investigate this question by leveraging simultaneous neuronal population recordings in early and midlevel visual areas (V1–V2 and V1–V4). Using a dimensionality reduction approach, we find that population interactions are feedforward-dominated shortly after stimulus onset and feedback-dominated during spontaneous activity. The population activity patterns most correlated across areas were distinct during feedforward- and feedback-dominated periods. These results suggest that feedforward and feedback signaling rely on separate “channels”, which allows feedback signals to not directly affect activity that is fed forward. How cortical areas interact via feedforward and feedback signaling remains unclear. Here, the authors recorded from V1 and V2/V4 in macaque visual cortex and found that feedforward and feedback interactions vary with stimulus drive and involve different neuronal population activity patterns.

Calcium imaging has been widely adopted for its ability to record from large neuronal populations. To summarize the time course of neural activity, dimensionality-reduction methods, which have been applied extensively to population spiking activity, may be particularly useful. However, it is unclear whether the dimensionality-reduction methods applied to spiking activity are appropriate for calcium imaging. We thus carried out a systematic study of design choices based on standard dimensionality-reduction methods. We have also developed a method to perform deconvolution and dimensionality reduction simultaneously (calcium imaging linear dynamical system, CILDS). CILDS most accurately recovered the single-trial, low-dimensional time courses from simulated calcium imaging data. CILDS also outperformed the other methods on calcium imaging recordings from larval zebrafish and mice. More broadly, this study represents a foundation for summarizing calcium-imaging recordings of large neuronal populations using dimensionality reduction in diverse experimental settings.

Technological advances now allow us to record from large populations of neurons across multiple brain areas. These recordings may illuminate how communication between areas contributes to brain function, yet a substantial barrier remains: how do we disentangle the concurrent, bidirectional flow of signals between populations of neurons? We propose here a dimensionality reduction framework, delayed latents across groups (DLAG), that disentangles signals relayed in each direction, identifies how these signals are represented by each population and characterizes how they evolve within and across trials. We demonstrate that DLAG performs well on synthetic datasets similar in scale to current neurophysiological recordings. Then we study simultaneously recorded populations in primate visual areas V1 and V2, where DLAG reveals signatures of bidirectional yet selective communication. Our framework lays a foundation for dissecting the intricate flow of signals across populations of neurons, and how this signalling contributes to cortical computation.