In robotics and biomechanics, accurately determining joint parameters and computing the corresponding forward and inverse kinematics are critical yet often challenging tasks, especially when dealing with highly individualized and partly unknown systems. This paper unveils a cutting-edge kinematic optimizer, underpinned by an autoencoder-based architecture, to address these challenges. Utilizing a neural network, our approach simulates inverse kinematics, converting measurement data into joint-specific parameters during encoding, enabling a stable optimization process. These parameters are subsequently processed through a predefined, differentiable forward kinematics model, resulting in a decoded representation of the original data. Beyond offering a comprehensive solution to kinematics challenges, our method also unveils previously unidentified joint parameters. Real experimental data from knee and hand joints validate the optimizer’s efficacy. Additionally, our optimizer is multifunctional: it streamlines the modeling and automation of kinematics and enables a nuanced evaluation of diverse modeling techniques. By assessing the differences in reconstruction losses, we illuminate the merits of each approach. Collectively, this preliminary study signifies advancements in kinematic optimization, with potential applications spanning both biomechanics and robotics.
This study presents an innovative test rig engineered to explore the kinematic and viscoelastic characteristics of human specimen hands. The rig features eight force-controlled motors linked to muscle tendons, enabling precise stimulation of hand specimens. Hand movements are monitored through an optical tracking system, while a force-torque sensor quantifies the resultant fingertip loads. Employing this setup, we successfully demonstrated a pincer grip using a cadaver hand and measured both muscle forces and grip strength. Our results reveal a nonlinear relationship between tendon forces and grip strength, which can be modeled by an exponential fit. This investigation serves as a nexus between biomechanical and robotics-focused research, providing critical insights for the advancement of robotic hand actuation and therapeutic interventions.
SummaryFemoral fractures are often considered lethal for adult horses because femur osteosynthesis is still a surgical challenge. For equine femur osteosynthesis, primary stability is essential, but the detailed physiological forces occurring in the hindlimb are largely unknown. The objective of this study was to create a numerical testing environment to evaluate equine femur osteosynthesis based on physiological conditions. The study was designed as a finite element analysis (FEA) of the femur using a musculoskeletal model of the loading situation in stance. Relevant forces were determined in the musculoskeletal model via optimization. The treatment of four different fracture types with an intramedullary nail was investigated in FEA with loading conditions derived from the model. The analyzed diaphyseal fracture types were a transverse (TR) fracture, two oblique fractures in different orientations (OB-ML: medial-lateral and OB-AP: anterior-posterior) and a ”gap” fracture (GAP) without contact between the fragments. For the native femur, the most relevant areas of increased stress were located distally to the femoral head and proximally to the caudal side of the condyles. For all fracture types, the highest stresses in the implant material were present in the fracture-adjacent screws. Maximum compressive (-348 MPa) and tensile stress (197 MPa) were found for the GAP fracture, but material strength was not exceeded. The mathematical model was able to predict a load distribution in the femur of the standing horse and was used to assess the performance of internal fixation devices via FEA. The analyzed intramedullary nail and screws showed sufficient stability for all fracture types.
This study presents the development and validation of an innovative hand exoskeleton designed for the rehabilitation of patients with Complex Regional Pain Syndrome (CRPS), a condition frequently arising post-injury or surgeries. The prototype is tailored for the hand, a region commonly affected by CRPS, and is notable for its adaptability and a comprehensive sensor system for monitoring individual joint movements. Reliable sensor performance was defined through precise force measurements and stability over time, showing minimal drift. These features enable personalized rehabilitation and objective progress tracking, addressing limitations in traditional physiotherapy such as availability, cost, and time constraints. The contributions of this work lie in its innovative design and the potential for robotic systems to improve therapeutic outcomes in CRPS rehabilitation.
Osteoarthritis of the knee, a widespread cause of knee disability, is commonly treated in orthopedics due to its rising prevalence. Lower extremity misalignment, pivotal in knee injury etiology and management, necessitates comprehensive mechanical alignment evaluation via frequently-requested weight-bearing long leg radiographs (LLR). Despite LLR’s routine use, current analysis techniques are error-prone and time-consuming. To address this, we conducted a multicentric study to develop and validate a deep learning (DL) model for fully automated leg alignment assessment on anterior-posterior LLR, targeting enhanced reliability and efficiency. The DL model, developed using 594 patients’ LLR and a 60%/10%/30% data split for training, validation, and testing, executed alignment analyses via a multi-step process, employing a detection network and nine specialized networks. It was designed to assess all vital anatomical and mechanical parameters for standard clinical leg deformity analysis and preoperative planning. Accuracy, reliability, and assessment duration were compared with three specialized orthopedic surgeons across two distinct institutional datasets (136 and 143 radiographs). The algorithm exhibited equivalent performance to the surgeons in terms of alignment accuracy (DL: 0.21±0.18°to 1.06 ±1.3°vs. OS: 0.21±0.16°to 1.72±1.96°), interrater reliability (ICC DL: 0.90±0.05 to 1.0±0.0 vs. ICC OS: 0.90±0.03 to 1.0±0.0), and clinically acceptable accuracy (DL: 53.9%–100% vs OS 30.8%–100%). Further, automated analysis significantly reduced analysis time compared to manual annotation (DL: 22±0.6s vs. OS; 101.7±7s, p ≤ 0.01). By demonstrating that our algorithm not only matches the precision of expert surgeons but also significantly outpaces them in both speed and consistency of measurements, our research underscores a pivotal advancement in harnessing AI to enhance clinical efficiency and decision-making in orthopaedics.
Objectives To develop an algorithm to link undiagnosed patients to previous patient histories based on radiographs, and simultaneous classification of multiple bone tumours to enable early and specific diagnosis. Materials and methods For this retrospective study, data from 2000 to 2021 were curated from our database by two orthopaedic surgeons, a radiologist and a data scientist. Patients with complete clinical and pre-therapy radiographic data were eligible. To ensure feasibility, the ten most frequent primary tumour entities, confirmed histologically or by tumour board decision, were included. We implemented a ResNet and transformer model to establish baseline results. Our method extracts image features using deep learning and then clusters the k most similar images to the target image using a hash-based nearest-neighbour recommender approach that performs simultaneous classification by majority voting. The results were evaluated with precision-at- k , accuracy, precision and recall. Discrete parameters were described by incidence and percentage ratios. For continuous parameters, based on a normality test, respective statistical measures were calculated. Results Included were data from 809 patients (1792 radiographs; mean age 33.73 ± 18.65, range 3–89 years; 443 men), with Osteochondroma (28.31%) and Ewing sarcoma (1.11%) as the most and least common entities, respectively. The dataset was split into training (80%) and test subsets (20%). For k = 3, our model achieved the highest mean accuracy, precision and recall (92.86%, 92.86% and 34.08%), significantly outperforming state-of-the-art models (54.10%, 55.57%, 19.85% and 62.80%, 61.33%, 23.05%). Conclusion Our novel approach surpasses current models in tumour classification and links to past patient data, leveraging expert insights. Clinical relevance statement The proposed algorithm could serve as a vital support tool for clinicians and general practitioners with limited experience in bone tumour classification by identifying similar cases and classifying bone tumour entities. Key Points • Addressed accurate bone tumour classification using radiographic features. • Model achieved 92.86%, 92.86% and 34.08% mean accuracy, precision and recall, respectively, significantly surpassing state-of-the-art models. • Enhanced diagnosis by integrating prior expert patient assessments. Graphical abstract
This study aimed to develop and evaluate a costeffective Inertial Measurement Unit (IMU) system for gait analysis, comparing its performance with the Vicon system and the VideoPose3D algorithm. The system comprises five calibrated sensors and a mobile app to measure lower body orientation during gait and stair climbing. Eight healthy participants were involved in the experiment, each performing ten repetitions to analyze hip and knee flexion angles. The IMU system demonstrated significantly lower mean square error than deep learning-based approaches and comparable results to the Vicon system, indicating its potential for clinical and research applications.
In this study, we developed and validated a robotic testbench to investigate the biomechanical compatibility of three total knee arthroplasty (TKA) configurations under different loading conditions, including varus–valgus and internal–external loading across defined flexion angles. The testbench captured force–torque data, position, and quaternion information of the knee joint. A cadaver study was conducted, encompassing a native knee joint assessment and successive TKA testing, featuring femoral component rotations at −5°, 0°, and +5° relative to the transepicondylar axis of the femur. The native knee showed enhanced stability in varus–valgus loading, with the +5° external rotation TKA displaying the smallest deviation, indicating biomechanical compatibility. The robotic testbench consistently demonstrated high precision across all loading conditions. The findings demonstrated that the TKA configuration with a +5° external rotation displayed the minimal mean deviation under internal–external loading, indicating superior joint stability. These results contribute meaningful understanding regarding the influence of different TKA configurations on knee joint biomechanics, potentially influencing surgical planning and implant positioning. We are making the collected dataset available for further biomechanical model development and plan to explore the 6 Degrees of Freedom (DOF) robotic platform for additional biomechanical analysis. This study highlights the versatility and usefulness of the robotic testbench as an instrumental tool for expanding our understanding of knee joint biomechanics.
Wound healing can be delayed if the biomechanical stability of the wound closure is inadequate. Therefore, it is necessary to investigate different suturing techniques for their biomechanical stability. In this study, suturing techniques suitable for the forehead area were investigated. For this application, a special test setup was developed to simulate the curvature of the forehead and the corresponding physiological configuration. The average forehead curvature is 62.24 ± 4.11 mm in radius. To simulate this curvature, the skin specimens are subjected to tensile stress over the spherical surface using a standard uniaxial testing machine. For the evaluation, an automated evaluation tool for MATLAB was also developed. Three different suturing techniques (Straight, Lazy-S, Zigzag) were investigated and tested for their biomechanical stability. Of the three suturing techniques, the Zigzag suture proved to be the most stable with the highest stiffness of 44.23 ± 8.18 % and the highest final failure of 32.60 ± 4.95 % (relative to the control sample without incision). The study has shown that the test setup can be used to investigate different forehead suture techniques.
OBJECTIVE:To develop a two-phased deep learning sorting algorithm for post-X-ray image acquisition in order to facilitate large musculoskeletal image datasets according to their anatomical entity. METHODS:In total, 42,608 unstructured and pseudonymized radiographs were retrieved from the PACS of a musculoskeletal tumor center. In phase 1, imaging data were sorted into 1000 clusters by a self-supervised model. A human-in-the-loop radiologist assigned weak, semantic labels to all clusters and clusters with the same label were merged. Three hundred thirty-two non-musculoskeletal clusters were discarded. In phase 2, the initial model was modified by "injecting" the identified labels into the self-supervised model to train a classifier. To provide statistical significance, data split and cross-validation were applied. The hold-out test set consisted of 50% external data. To gain insight into the model's predictions, Grad-CAMs were calculated. RESULTS:The self-supervised clustering resulted in a high normalized mutual information of 0.930. The expert radiologist identified 28 musculoskeletal clusters. The modified model achieved a classification accuracy of 96.2% and 96.6% for validation and hold-out test data for predicting the top class, respectively. When considering the top two predicted class labels, an accuracy of 99.7% and 99.6% was accomplished. Grad-CAMs as well as final cluster results underlined the robustness of the proposed method by showing that it focused on similar image regions a human would have considered for categorizing images. CONCLUSION:For efficient dataset building, we propose an accurate deep learning sorting algorithm for classifying radiographs according to their anatomical entity in the assessment of musculoskeletal diseases. KEY POINTS:• Classification of large radiograph datasets according to their anatomical entity. • Paramount importance of structuring vast amounts of retrospective data for modern deep learning applications. • Optimization of the radiological workflow and increase in efficiency as well as decrease of time-consuming tasks for radiologists through deep learning.
Ewing sarcomas are malignant neoplasm entities typically found in children and adolescents. Early detection is crucial for therapy and prognosis. Due to the low incidence the general experience as well as according data is limited. Novel support tools for diagnosis, such as deep learning models for image interpretation, are required. While acquiring sufficient data is a common obstacle in medicine, several techniques to tackle small data sets have emerged. The general necessity of large data sets in addition to a rare disease lead to the question whether transfer learning can solve the issue of limited data and subsequently support tasks such as distinguishing Ewing sarcoma from its main differential diagnosis (acute osteomyelitis) in paediatric radiographs. 42,608 unstructured radiographs from our musculoskeletal tumour centre were retrieved from the PACS. The images were clustered with a DeepCluster, a self-supervised algorithm. 1000 clusters were used for the upstream task (pretraining). Following, the pretrained classification network was applied for the downstream task of differentiating Ewing sarcoma and acute osteomyelitis. An untrained network achieved an accuracy of 81.5%/54.2%, while an ImageNet-pretrained network resulted in 89.6%/70.8% for validation and testing, respectively. Our transfer learning approach surpassed the best result by 4.4%/17.3% percentage points. Transfer learning demonstrated to be a powerful technique to support image interpretation tasks. Even for small data sets, the impact can be significant. However, transfer learning is not a final solution to small data sets. To achieve clinically relevant results, a structured and systematic data acquisition is of paramount importance.
To develop and validate machine learning models to distinguish between benign and malignant bone lesions and compare the performance to radiologists. In 880 patients (age 33.1 ± 19.4 years, 395 women) diagnosed with malignant (n = 213, 24.2%) or benign (n = 667, 75.8%) primary bone tumors, preoperative radiographs were obtained, and the diagnosis was established using histopathology. Data was split 70%/15%/15% for training, validation, and internal testing. Additionally, 96 patients from another institution were obtained for external testing. Machine learning models were developed and validated using radiomic features and demographic information. The performance of each model was evaluated on the test sets for accuracy, area under the curve (AUC) from receiver operating characteristics, sensitivity, and specificity. For comparison, the external test set was evaluated by two radiology residents and two radiologists who specialized in musculoskeletal tumor imaging. The best machine learning model was based on an artificial neural network (ANN) combining both radiomic and demographic information achieving 80% and 75% accuracy at 75% and 90% sensitivity with 0.79 and 0.90 AUC on the internal and external test set, respectively. In comparison, the radiology residents achieved 71% and 65% accuracy at 61% and 35% sensitivity while the radiologists specialized in musculoskeletal tumor imaging achieved an 84% and 83% accuracy at 90% and 81% sensitivity, respectively. An ANN combining radiomic features and demographic information showed the best performance in distinguishing between benign and malignant bone lesions. The model showed lower accuracy compared to specialized radiologists, while accuracy was higher or similar compared to residents. • The developed machine learning model could differentiate benign from malignant bone tumors using radiography with an AUC of 0.90 on the external test set. • Machine learning models that used radiomic features or demographic information alone performed worse than those that used both radiomic features and demographic information as input, highlighting the importance of building comprehensive machine learning models. • An artificial neural network that combined both radiomic and demographic information achieved the best performance and its performance was compared to radiology readers on an external test set.
For the development of new types of hip implants for acetabulum revision, it is beneficial to analyse the acetabular defects of the indication group in advance. In order to be able to specially compare the bone defects with each other, a normalisation and accompanying scaling of the pelvis is necessary. Uniform scaling is required so that the bone structures are not distorted. In the following study, three scaling methods based on the minimal bounding box and sphere principle are compared with a method using 14 landmarks on the pelvis.The landmark method is applied to determine the true scaling factor. For the comparison of the different methods, 40 female pelvic models with an acetabular defect are analysed. In the comparison of the scaling methods, the method using minimal bounding spheres shows the least deviation from the landmark method (mean difference 3.30 ± 2.17 %). Due to the fact that no preprocessing (definition of the landmarks) is required and the fast implementation of the algorithm, the minimal bounding sphere is to be preferred to the landmark method for a fast size estimation.
Introduction: Osteosynthesis of the equine femur is still a challenge for veterinary medicine. Even though intramedullary fracture fixation is possible nowadays, the varying geometry of the medullary cavity along the bone axis is a critical factor. Limited contact area between implant and bone can cause insufficient primary stability. In this study, it was investigated whether the osteosynthesis stability can be improved with a form-adaptive reinforcement for the diaphyseal part of the proximal fragment. Material and Methods: Eight equine femora were fitted with intramedullary nail osteosynthesis and analyzed by 4-point bending. Virtual position planning of the ex-vivo implantation using CT-data increased comparability. For five femora the proximal fragment was reinforced with a flexible polymer mixture. Longterm stability was tested via cyclic loading. Bending stiffness and its development due to cyclic loading was evaluated before and after reinforcement procedure. Finally, load-to-failure was tested in the same setup. Results and Discussion: The application of the polymer reinforcement increased the maximum torque in the load-tofailure measurement by 26%. Bending stiffness was not affected in the measured loading range by the reinforcement. Cyclic loading increased bending stiffness for a conditioned state but showed to be reversible for the most part. Conclusion: The fracture adjacent reinforcement showed to be beneficial to the osteosynthesis stability, but further investigation is necessary for surgical application.
This paper presents the application of an adaptive exoskeleton for finger rehabilitation. The system consists of a force-controlled exoskeleton of the finger and wireless coupling to a mobile application for the rehabilitation of complex regional pain syndrome (CRPS) patients. The exoskeleton has sensors for motion detection and force control as well as a wireless communication module. The proposed mobile application allows to interactively control the exoskeleton, store collected patient-specific data, and motivate the patient for therapy by means of gamification. The exoskeleton was applied to three CRPS patients over a period of six weeks. We present the design of the exoskeleton, the mobile application with its game content, and the results of the performed preliminary patient study. The exoskeleton system showed good applicability; recorded data can be used for objective therapy evaluation.
Bone tumours are a rare and often highly malignant entity. Early clinical diagnosis is the most important step, but the difficulty of detecting and assessing bone malignancies is in its radiological peculiarity and limited experience of non-experts. Since X-ray imaging is the first imaging method of bone tumour diagnostics, the purpose of this study is to develop an artificial intelligence (AI) model to detect and segment the tumorous tissue in a radiograph. We investigated which methods are necessary to cope with limited and heterogeneous data. We collected 531 anonymised radiographs from our musculoskeletal tumour centre. In order to adapt to the complexity of recognizing the malignant tissue and cope with limited data, transfer learning, data augmentation as well as several architectures, some of which were initially designed for medical images, were implemented. Furthermore, dataset size was varied by adding another bone tumour entity. We applied a data split of 72%, 18%, 10% for training, validation and testing, respectively. To provide statistical significance and robustness, we applied a cross-validation and image stratification with respect to tumour pixels present. We achieved an accuracy of 99.72% and an intersection over union of 87.43% for hold-out test data by applying several methods to tackle limited data. Transfer learning and additional data brought the greatest performance increase. In conclusion, our model was able to detect and segment tumorous tissue in radiographs with good performance, although it was trained on a very limited amount of data. Transfer Learning and data augmentation proved to significantly mitigate the issue of limited data samples. However, to accomplish clinical significance, more data has to be acquired in the future. Through minor adjustments, the model could be adapted to other musculoskeletal tumour entities and become a general support tool for orthopaedic surgeons and radiologists.
In this study, top ology optimized, patient specific os teosynthesis plates (TOPOS-implants) are evaluated for the mandibular reconstruction using fibula segments. These shape optimized implants are compared to a standard treatment with miniplates (thickness: 1.0 mm, titanium grade 4) in biomechanical testing using human cadaveric specimen. Mandible and fibula of 21 body donors were used. Geometrical models were created based on automated segmentation of CT-scans of all specimens. All reconstructions, including cutting guides for osteotomy as well as TOPOS-implants, were planned using a custom-made software tool. The TOPOS-implants were produced by electron beam melting (thickness: 1.0 mm, titanium grade 5). The fibula-reconstructed mandibles were tested in static and dynamic testing in a multi-axial test system, which can adapt to the donor anatomy and apply side-specific loads. Static testing was used to confirm mechanical similarity between the reconstruction groups. Force-controlled dynamic testing was performed with a sinusoidal loading between 60 and 240 N (reconstructed side: 30% reduction to consider resected muscles) at 5 Hz for up to 5 · 10 5 cycles. There was a significant difference between the groups for dynamic testing: All TOPOS-implants stayed intact during all cycles, while miniplate failure occurred after 26.4% of the planned loading (1.32 · 10 5 ± 1.46 · 10 5 cycles). Bone fracture occurred in both groups (miniplates: n = 3, TOPOS-implants: n = 2). A correlation between bone failure and cortical bone thickness in mandible angle as well as the number of bicortical screws used was demonstrated. For both groups no screw failure was detected. In conclusion, the topology optimized, patient specific implants showed superior fatigue properties compared to miniplates in mandibular reconstruction. Additionally, the patient specific shape comes with intrinsic guiding properties to support the reconstruction process during surgery. This demonstrates that the combination of additive manufacturing and topology optimization can be beneficial for future maxillofacial surgery.
Abstract Bioreactors with a controlled physiological environment are being developed to study various cell processes. The influences of mechanostimulation on bone cell cultures can be investigated using a compression bioreactor. The developed bioreactor system applies a cyclic compression force to the specimen via an eccentrically mounted push rod. The compression force is monitored by a force sensor to detect changes in the material properties of the specimen. Depending on the piston setting, a stroke of 0.28 - 2.50 mm can be applied to the specimen. The bioreactor system was tested with a trial run of 18 days. A sample was continuously stimulated with a loading frequency of 2 Hz and a stroke of 1.50 mm. The sterility in the cell chamber as well as the functionality of the realised bioreactor stimulation system could be successfully confirmed
This paper presents a novel mechatronic exoskeleton architecture for finger rehabilitation. The system consists of an underactuated kinematic structure that enables the exoskeleton to act as an adaptive finger stimulator. The exoskeleton has sensors for motion detection and control. The proposed architecture offers three main advantages. First, the exoskeleton enables accurate quantification of subject-specific finger dynamics. The configuration of the exoskeleton can be fully reconstructed using measurements from three angular position sensors placed on the kinematic structure. In addition, the actuation force acting on the exoskeleton is recorded. Thus, the range of motion (ROM) and the force and torque trajectories of each finger joint can be determined. Second, the adaptive kinematic structure allows the patient to perform various functional tasks. The force control of the exoskeleton acts like a safeguard and limits the maximum possible joint torques during finger movement. Last, the system is compact, lightweight and does not require extensive peripherals. Due to its safety features, it is easy to use in the home. Applicability was tested in three healthy subjects.
Background An artificial intelligence model that assesses primary bone tumors on radiographs may assist in the diagnostic workflow. Purpose To develop a multitask deep learning (DL) model for simultaneous bounding box placement, segmentation, and classification of primary bone tumors on radiographs. Materials and Methods This retrospective study analyzed bone tumors on radiographs acquired prior to treatment and obtained from patient data from January 2000 to June 2020. Benign or malignant bone tumors were diagnosed in all patients by using the histopathologic findings as the reference standard. By using split-sample validation, 70% of the patients were assigned to the training set, 15% were assigned to the validation set, and 15% were assigned to the test set. The final performance was evaluated on an external test set by using geographic validation, with accuracy, sensitivity, specificity, and 95% CIs being used for classification, the intersection over union (IoU) being used for bounding box placements, and the Dice score being used for segmentations. Results Radiographs from 934 patients (mean age, 33 years ± 19 [standard deviation]; 419 women) were evaluated in the internal data set, which included 667 benign bone tumors and 267 malignant bone tumors. Six hundred fifty-four patients were in the training set, 140 were in the validation set, and 140 were in the test set. One hundred eleven patients were in the external test set. The multitask DL model achieved 80.2% (89 of 111; 95% CI: 72.8, 87.6) accuracy, 62.9% (22 of 35; 95% CI: 47, 79) sensitivity, and 88.2% (67 of 76; CI: 81, 96) specificity in the classification of bone tumors as malignant or benign. The model achieved an IoU of 0.52 ± 0.34 for bounding box placements and a mean Dice score of 0.60 ± 0.37 for segmentations. The model accuracy was higher than that of two radiologic residents (71.2% and 64.9%; P = .002 and P < .001, respectively) and was comparable with that of two musculoskeletal fellowship-trained radiologists (83.8% and 82.9%; P = .13 and P = .25, respectively) in classifying a tumor as malignant or benign. Conclusion The developed multitask deep learning model allowed for accurate and simultaneous bounding box placement, segmentation, and classification of primary bone tumors on radiographs. © RSNA, 2021 Online supplemental material is available for this article. See also the editorial by Carrino in this issue.