The advancement of motor augmentation and the broader domain of human-machine interaction rely on a seamless integration with users’ physical and cognitive capabilities. These considerations may markedly fluctuate among individuals on the basis of their age, form, and abilities. There is a need to develop a standard for considering these diversity needs and preferences to guide technological development, and large-scale testing can provide us with evidence for such considerations. Public engagement events provide an important opportunity to build a bidirectional discourse with potential users for the codevelopment of inclusive and accessible technologies. We exhibited the Third Thumb, a hand augmentation device, at a public engagement event and tested participants from the general public, who are often not involved in such early technological development of wearable robotic technology. We focused on wearability (fit and control), ability to successfully operate the device, and ability levels across diversity factors relevant for physical technologies (gender, handedness, and age). Our inclusive design was successful in 99.3% of our diverse sample of 596 individuals tested (age range from 3 to 96 years). Ninety-eight percent of participants were further able to successfully manipulate objects using the extra thumb during the first minute of use, with no significant influences of gender, handedness, or affinity for hobbies involving the hands. Performance was generally poorer among younger children (aged ≤11 years). Although older and younger adults performed the task comparably, we identified age costs with the older adults. Our findings offer tangible demonstration of the initial usability of the Third Thumb for a broad demographic.
Some of the most dramatic examples of neuroplasticity in the human brain follow congenital sensory deprivation, though we have limited understanding of the plasticity mechanisms driving such large-scale remapping. Hand loss due to congenital limb differences (CLD) offers a unique temporal dissociation of developmental neuroplasticity mechanisms: While sensory deprivation is congenital, compensatory motor behaviours develop progressively across childhood. Using paediatric neuroimaging and semi-ecological behavioural analysis in children (5-7 years old) and adults (>25 years old) with unilateral upper-limb CLD, we studied deprivation- and use-dependent plasticity in the deprived primary somatosensory cortex and beyond. We reveal that global remapping, encompassing the entire sensory homunculus, is established early and maintained in adulthood. We demonstrate that deprivation-driven homeostatic plasticity can drive this global remapping, with Hebbian-based compensatory learning further contributing to inter-individual differences both in childhood and adulthood. Our findings emphasise the early establishment and stability of cortical maps, despite extensive daily-life behavioural adaptation. ### Competing Interest Statement The authors have declared no competing interest.
The homunculus in primary somatosensory cortex (S1) is famous for its body part selectivity, but this dominant feature may eclipse other representational features, e.g., information content, also relevant for S1 organization. Using multivariate fMRI analysis, we ask whether body part information content can be identified in S1 beyond its primary region. Throughout S1, we identify significant representational dissimilarities between body parts but also subparts in distant non-primary regions (e.g., between the hand and the lips in the foot region and between different face parts in the foot region). Two movements performed by one body part (e.g., the hand) could also be dissociated well beyond its primary region (e.g., in the foot and face regions), even within Brodmann area 3b. Our results demonstrate that information content is more distributed across S1 than selectivity maps suggest. This finding reveals underlying information contents in S1 that could be harnessed for rehabilitation and brain-machine interfaces.
Objective. Considerable resources are being invested to enhance the control and usability of artificial limbs through the delivery of unnatural forms of somatosensory feedback. Here, we investigated whether intrinsic somatosensory information from the body part(s) remotely controlling an artificial limb can be leveraged by the motor system to support control and skill learning. Approach. We used local anaesthetic to attenuate somatosensory inputs to the big toes while participants learned to operate through pressure sensors a toe-controlled and hand-worn robotic extra finger. Motor learning outcomes were compared against a control group who received sham anaesthetic and quantified in three different task scenarios: while operating in isolation from, in synchronous coordination, and collaboration with, the biological fingers. Main results. Both groups were able to learn to operate the robotic extra finger, presumably due to abundance of visual feedback and other relevant sensory cues. Importantly, the availability of displaced somatosensory cues from the distal bodily controllers facilitated the acquisition of isolated robotic finger movements, the retention and transfer of synchronous hand-robot coordination skills, and performance under cognitive load. Motor performance was not impaired by toes anaesthesia when tasks involved close collaboration with the biological fingers, indicating that the motor system can close the sensory feedback gap by dynamically integrating task-intrinsic somatosensory signals from multiple, and even distal, body-parts. Significance. Together, our findings demonstrate that there are multiple natural avenues to provide intrinsic surrogate somatosensory information to support motor control of an artificial body part, beyond artificial stimulation.
Considerable resources are being invested to provide bidirectional control of substitutive and augmentative motor interfaces through artificial somatosensory feedback. Here, we investigated whether intrinsic somatosensory information, from body part(s) proportionally controlling an augmentation device, can be utilised to infer the device state and position, to better support motor control and learning. In a placebo-controlled design, we used local anaesthetic to attenuate somatosensory inputs to the big toes while participants learned to operate a toe-controlled robotic extra finger (Third Thumb) using pressure sensors. Motor learning outcomes were compared against a control group who received sham anaesthetic. The availability of somatosensory cues about the amount of exerted pressure generally facilitated acquisition, retention and transfer of motor skills, and performance under cognitive load. Motor performance was not impaired by anaesthesia when tasks involved close collaboration with the biological fingers, indicating that the brain could close the gap of the missing pressure signals by alternative means, including feedback from other body parts involved in the motor task. Together, our findings demonstrate that there are intrinsic natural avenues to provide surrogate position information to support motor control of an artificial body part, beyond artificial extrinsic signalling.
Humans have long been fascinated by the opportunities afforded through augmentation. This vision not only depends on technological innovations but also critically relies on our brain’s ability to learn, adapt, and interface with augmentation devices. Here, we investigated whether successful motor augmentation with an extra robotic thumb can be achieved and what its implications are on the neural representation and function of the biological hand. Able-bodied participants were trained to use an extra robotic thumb (called the Third Thumb) over 5 days, including both lab-based and unstructured daily use. We challenged participants to complete normally bimanual tasks using only the augmented hand and examined their ability to develop hand-robot interactions. Participants were tested on a variety of behavioral and brain imaging tests, designed to interrogate the augmented hand’s representation before and after the training. Training improved Third Thumb motor control, dexterity, and hand-robot coordination, even when cognitive load was increased or when vision was occluded. It also resulted in increased sense of embodiment over the Third Thumb. Consequently, augmentation influenced key aspects of hand representation and motor control. Third Thumb usage weakened natural kinematic synergies of the biological hand. Furthermore, brain decoding revealed a mild collapse of the augmented hand’s motor representation after training, even while the Third Thumb was not worn. Together, our findings demonstrate that motor augmentation can be readily achieved, with potential for flexible use, reduced cognitive reliance, and increased sense of embodiment. Yet, augmentation may incur changes to the biological hand representation. Such neurocognitive consequences are crucial for successful implementation of future augmentation technologies.
From hand tools to cyborgs, humans have long been fascinated by the opportunities afforded by augmenting ourselves. Here, we studied how motor augmentation with an extra robotic thumb (the Third Thumb) impacts the biological hand representation in the brains of able-bodied people. Participants were tested on a variety of behavioural and neuroimaging tests designed to interrogate the augmented hand’s representation before and after 5-days of semi-intensive training. Training improved the Thumb’s motor control, dexterity and hand-robot coordination, even when cognitive load was increased or when vision was occluded, and resulted in increased sense of embodiment over the robotic Thumb. Thumb usage also weakened natural kinematic hand synergies. Importantly, brain decoding of the augmented hand’s motor representation demonstrated mild collapsing of the canonical hand structure following training, suggesting that motor augmentation may disrupt the biological hand representation. Together, our findings unveil critical neurocognitive considerations for designing human body augmentation.