Objective: Real-time determination of human kinematics and kinetics could advance biomechanics research and enable valuable applications of biofeedback and generalizable exoskeleton control. This work aims to investigate a taskindependent, user-independent method for obtaining precise realtime joint state estimation across lower-body joints during a wide variety of tasks. Methods: We developed a generalizable sensing approach using a suit comprised of inertial measurement units (IMUs) and pressure insoles. With the suit, we collected a dataset of 33 tasks commonly performed during construction and hazardous waste cleanup (N = 10). We then trained deep learning user-independent, task-agnostic models to estimate joint lowerbody kinematics and dynamics using only worn sensor data. We likewise computed joint kinematics and dynamics analytically from sensor data to serve as a comparison tool for model results. Results: Our models achieved overall angle estimation root-meansquared-errors (RMSE) of 6.56±.92°, 8.60±1.01°, 7.58±.89°, and 6.00±.73° compared to 13.9±.1.3°, 15.31±1.0°, 10.76±.70°, and 7.56±.48° via analytical methods at the lower back, hip, knee, and ankle, respectively. Likewise, our models achieved overall normalized moment estimation RMSEs of .207±.069 Nm/kg, .242±.044 Nm/kg, .202±.038 Nm/kg, and .193±.034 Nm/kg compared to .306±.036 Nm/kg, .407±.021 Nm/kg, 1.18 ±.022 Nm/kg, and 1.73±.071 Nm/kg via analytical methods at the lower back, hip, knee, and ankle, respectively. Conclusion: These results are comparable to other state-of-the-art wearable sensing systems, establishing deep learning as a viable sensing approach that generalizes to new users and tasks. Significance: This work shows promise for enabling accurate real-world biomechanical data collection and enhancement of biofeedback systems and wearable robot control.
X-ray nanotomography is a powerful tool for the characterization of nanoscale materials and structures, but it is difficult to implement due to the competing requirements of X-ray flux and spot size. Due to this constraint, state-of-the-art nanotomography is predominantly performed at large synchrotron facilities. We present a laboratory-scale nanotomography instrument that achieves nanoscale spatial resolution while addressing the limitations of conventional tomography tools. The instrument combines the electron beam of a scanning electron microscope (SEM) with the precise, broadband X-ray detection of a superconducting transition-edge sensor (TES) microcalorimeter. The electron beam generates a highly focused X-ray spot on a metal target held micrometers away from the sample of interest, while the TES spectrometer isolates target photons with a high signal-to-noise ratio. This combination of a focused X-ray spot, energy-resolved X-ray detection, and unique system geometry enables nanoscale, element-specific X-ray imaging in a compact footprint. The proof of concept for this approach to X-ray nanotomography is demonstrated by imaging 160 nm features in three dimensions in six layers of a Cu-SiO2 integrated circuit, and a path toward finer resolution and enhanced imaging capabilities is discussed.
Tank farm workers involved in nuclear cleanup activities perform physically demanding tasks, typically while wearing heavy personal protective equipment (PPE). Exoskeleton devices have the potential to bring considerable benefit to this industry but have not been thoroughly studied in the context of nuclear cleanup. In this paper, we examine the performance of exoskeletons during a series of tasks emulating jobs performed on tank farms while participants wore PPE commonly deployed by tank farm workers. The goal of this study was to evaluate the effects of commercially available lower-body exoskeletons on a user's gait kinematics and user perceptions. Three participants each tested three lower-body exoskeletons in a 70-min protocol consisting of level treadmill walking, incline treadmill walking, weighted treadmill walking, a weight lifting session, and a hand tool dexterity task. Results were compared to a no exoskeleton baseline condition and evaluated as individual case studies. The three participants showed a wide spectrum of user preferences and adaptations toward the devices. Individual case studies revealed that some users quickly adapted to select devices for certain tasks while others remained hesitant to use the devices. Temporal effects on gait change and perception were also observed for select participants in device usage over the course of the device session. Device benefit varied between tasks, but no conclusive aggregate trends were observed across devices for all tasks. Evidence suggests that device benefits observed for specific tasks may have been overshadowed by the wide array of tasks used in the protocol.
We report on the 1,000-element transition-edge sensor (TES) x-ray spectrometer implementation of the TOMographic Circuit Analysis Tool (TOMCAT). TOMCAT combines a high spatial resolution scanning electron microscope (SEM) with a highly efficient and pixelated TES spectrometer to reconstruct three-dimensional maps of nanoscale integrated circuits (ICs). A 240-pixel prototype spectrometer was recently used to reconstruct ICs at the 130 nm technology node, but to increase imaging speed to more practical levels, the detector efficiency needs to be improved. For this reason, we are building a spectrometer that will eventually contain 3,000 TES microcalorimeters read out with microwave superconducting quantum interference device (SQUID) multiplexing, and we currently have commissioned a 1,000 TES subarray. This still represents a significant improvement from the 240-pixel system and allows us to begin characterizing the full spectrometer performance. Of the 992 maximimum available readout channels, we have yielded 818 devices, representing the largest number of TES x-ray microcalorimeters simultaneously read out to date. These microcalorimeters have been optimized for pulse speed rather than purely energy resolution, and we measure a FWHM energy resolution of 14 eV at the 8.0 keV Cu K$\bm {\alpha}$ line.
X-ray nanotomography is a powerful tool for the characterization of nanoscale materials and structures, but is difficult to implement due to competing requirements on X-ray flux and spot size. Due to this constraint, state-of-the-art nanotomography is predominantly performed at large synchrotron facilities. We present a laboratory-scale nanotomography instrument that achieves nanoscale spatial resolution while changing the limitations of conventional tomography tools. The instrument combines the electron beam of a scanning electron microscope (SEM) with the precise, broadband X-ray detection of a superconducting transition-edge sensor (TES) microcalorimeter. The electron beam generates a highly focused X-ray spot in a metal target held micrometers away from the sample of interest, while the TES spectrometer isolates target photons with high signal-to-noise. This combination of a focused X-ray spot, energy-resolved X-ray detection, and unique system geometry enable nanoscale, element-specific X-ray imaging in a compact footprint. The proof-of-concept for this approach to X-ray nanotomography is demonstrated by imaging 160 nm features in three dimensions in 6 layers of a Cu-SiO2 integrated circuit, and a path towards finer resolution and enhanced imaging capabilities is discussed.
Feature sizes in integrated circuits have decreased substantially over time, and it has become increasingly difficult to three-dimensionally image these complex circuits after fabrication. This can be important for process development, defect analysis, and detection of unexpected structures in externally sourced chips, among other applications. Here, we report on a non-destructive, tabletop approach that addresses this imaging problem through x-ray tomography, which we uniquely realize with an instrument that combines a scanning electron microscope (SEM) with a transition-edge sensor (TES) x-ray spectrometer. Our approach uses the highly focused SEM electron beam to generate a small x-ray generation region in a carefully designed target layer that is placed over the sample being tested. With the high collection efficiency and resolving power of a TES spectrometer, we can isolate x-rays generated in the target from background and trace their paths through regions of interest in the sample layers, providing information about the various materials along the x-ray paths through their attenuation functions. We have recently demonstrated our approach using a 240 Mo/Cu bilayer TES prototype instrument on a simplified test sample containing features with sizes of ∼ 1 μm. Currently, we are designing and building a 3000 Mo/Au bilayer TES spectrometer upgrade, which is expected to improve the imaging speed by factor of up to 60 through a combination of increased detector number and detector speed.
This chapter considers the collection of sparse samples in electron microscopy, either by modification of the sampling methods utilized on existing microscopes, or with new microscope concepts that are specifically designed and optimized for collection of sparse samples. It explores potential embodiments of a multi-beam compressive sensing electron microscope. Sparse measurement matrices offer an advantage of efficient image recovery, since each iteration of the process becomes a simple multiplication by a sparse matrix. Electron microscopy is well suited to compressed or sparse sampling due to the difficulty of building electron microscopes that can accurately record more than one electron signal at a time. Sparse sampling in electron microscopy has been considered for dose reduction, improving three-dimensional reconstructions and accelerating data acquisition. For sparse sampling, variations of scanning transmission electron microscopy (STEM) are typically used. In STEM, the electron probe is scanned across the specimen, and the detector measurement is recorded as a function of probe location.
File fragment classification is an important step in the task of file carving in digital forensics. In file carving, files must be reconstructed based on their content as a result of their fragmented storage on disk or in memory. Existing methods for classification of file fragments typically use hand-engineered features, such as byte histograms or entropy measures. In this paper, we propose an approach using sparse coding that enables automated feature extraction. Sparse coding, or sparse dictionary learning, is an unsupervised learning algorithm, and is capable of extracting features based simply on how well those features can be used to reconstruct the original data. With respect to file fragments, we learn sparse dictionaries for n-grams, continuous sequences of bytes, of different sizes. These dictionaries may then be used to estimate n-gram frequencies for a given file fragment, but for significantly larger n-gram sizes than are typically found in existing methods which suffer from combinatorial explosion. To demonstrate the capability of our sparse coding approach, we used the resulting features to train standard classifiers, such as support vector machines over multiple file types. Experimentally, we achieved significantly better classification results with respect to existing methods, especially when the features were used in supplement to existing hand-engineered features.
Interface pressures are closely related to the comfort and fit of a lower-limb prosthetic socket and clinicians and researchers are interested in monitoring these loads. In particular, shear stresses at the socket/liner interface are indicative of important fit characteristics but are difficult to measure in situ. We have developed an elastomeric liner with sixteen integrated pressure and shear sensors, along with necessary wiring and data acquisition electronics. The sensors measure three-axis pressures using optical emitter/detector pairs coupled with transparent and opaque elastomeric layers. The liner has similar properties to those typically used in clinical practice. The system was tested on a single amputee subject during several sit/stand/walk cycles.
This chapter contains sections titled: Introduction Background Analysis of Multi-Beam Measurement Patterns Conclusions Acknowledgements
Scanning electron microscopes (SEMs) are used in neuroscience and materials science to image square centimeters of sample area at nanometer scales. Since imaging rates are in large part SNR-limited, imaging time is proportional to the number of measurements taken of each sample; in a traditional SEM, large collections can lead to weeks of around-the-clock imaging time. We previously reported a single-beam sparse sampling approach that we have demonstrated on an operational SEM for collecting “smooth” images. In this paper, we analyze how measurements from a hypothetical multi-beam system would compare to the single-beam approach in a compressed sensing framework. To that end, multi-beam measurements are synthesized on a single-beam SEM, and fidelity of reconstructed images are compared to the previously demonstrated approach. Since taking fewer measurements comes at the cost of reduced SNR, image fidelity as a function of undersampling ratio is reported.
Scanning electron microscopes (SEMs) are used in neuroscience and materials science to image centimeters of sample area at nanometer scales. Since imaging rates are in large part SNR-limited, large collections can lead to weeks of around-the-clock imaging time. To increase data collection speed, we propose and demonstrate on an operational SEM a fast method to sparsely sample and reconstruct smooth images. To accurately localize the electron probe position at fast scan rates, we model the dynamics of the scan coils, and use the model to rapidly and accurately visit a randomly selected subset of pixel locations. Images are reconstructed from the undersampled data by compressed sensing inversion using image smoothness as a prior. We report image fidelity as a function of acquisition speed by comparing traditional raster to sparse imaging modes. Our approach is equally applicable to other domains of nanometer microscopy in which the time to position a probe is a limiting factor (e.g., atomic force microscopy), or in which excessive electron doses might otherwise alter the sample being observed (e.g., scanning transmission electron microscopy).
During upper-limb prosthesis use, proprioception is not available so visual cues are used to identify the location of the artificial limb. We investigate the efficacy of a skin stretch device for artificially relaying proprioception during a spring discrimination task, with the goal of enabling the task to be achieved in the absence of vision. In this study, intact users perceive the location of a virtual prosthetic limb using each of four sensory conditions: Vision, Proprioception, Skin Stretch, and Skin Stretch with Vision. For the conditions with skin stretch, a haptic device stretches the forearm skin by an amount proportional to the angular rotation of a virtual prosthetic limb. Sensory condition was not found to significantly influence task performance, exploration methods, or perceived usefulness. We conclude that, in the absence of vision, artificial skin stretch could be used by prosthesis wearers to obtain position/motion information and identify the behavior of a spring.