Tissue stiffness is related to soft tissue pathologies and can be assessed through palpation or via clinical imaging systems, e.g., ultrasound or magnetic resonance imaging. Typically, the image based approaches are not suitable during interventions, particularly for minimally invasive surgery. To this end, we present a miniaturized fiber scanning endoscope for fast and localized elastography. Moreover, we propose a deep learning based signal processing pipeline to account for the intricate data and the need for real-time estimates. Our elasticity estimation approach is based on imaging complex and diffuse wave fields that encompass multiple wave frequencies and propagate in various directions. We optimize the probe design to enable different scan patterns. To maximize temporal sampling while maintaining three-dimensional information we define a scan pattern in a conical shape with a temporal frequency of 5.05kHz. To efficiently process the image sequences of complex wave fields we consider a spatio-temporal deep learning network. We train the network in an end-to-end fashion on measurements from phantoms representing multiple elasticities. The network is used to obtain localized and robust elasticity estimates, allowing to create elasticity maps in real-time. For 2D scanning, our approach results in a mean absolute error of 6.31(576)kPa compared to 11.33(1278)kPa for conventional phase tracking. For scanning without estimating the wave direction, the novel 3D method reduces the error to 4.48(363)kPa compared to 19.75(2182)kPa for the conventional 2D method. Finally, we demonstrate feasibility of elasticity estimates in ex-vivo porcine tissue.
Endoscopic optical coherence tomography (OCT) offers in vivo live visualization of transmural structures with histological resolution, making it a valuable tool in medical imaging. In gastroenterology, OCT endoscopy is particularly advantageous for assessing rectal wall layers, providing superior axial and lateral resolution compared to conventional rectal endoscopic ultrasound. However, the large diameter and uneven colon surface present challenges for comprehensive imaging. Extending the OCT imaging range addresses this issue by enabling a thorough examination of the entire colon, facilitating the detection of surface polyps, tumors, and their infiltration depth. Once these regions of interest are identified, high-resolution imaging becomes essential for detailed evaluation. To meet these demands, this study integrates two different imaging modes, an extended-range mode, and a high-detail mode, within a rigid rectoscope. The extended-range mode enables visualization of deeper structures, while the high-detail mode enhances image quality for precise, contact-based assessments. The system allows seamless, real-time transitions between the modes using a 3.2 MHz-OCT system and a fiber-optic MEMS switch.
The increasing incidence of laryngeal carcinomas requires approaches for early diagnosis and treatment. In clinical practice, white light endoscopy of the laryngeal region is typically followed by biopsy under general anesthesia. Thus, image based diagnosis using optical coherence tomography (OCT) has been proposed to study sub-surface tissue layers at high resolution. However, accessing the region of interest requires robust miniature OCT probes that can be forwarded through the working channel of a laryngoscope. Typically, such probes generate A-scans, i.e., single column depth images, which are rather difficult to in terpret. We propose a novel approach using the endoscopic camera images to spatially align these A-scans. Given the natural tissue motion and movements of the laryngoscope, the resulting OCT images show a three-dimensional representation of the sub-surface structures, which is simpler to interpret. We present the overall imaging setup and the motion tracking method. Moreover, we describe an experimental setup to assess the precision of the spatial alignment. We study different tracking templates and report root-mean-squared errors of 0.08 mm and 0.18 mm for sinusoidal and freehand motion, respectively. Furthermore, we also demonstrate the in-vivo application of the approach, illustrating the benefit of spatially meaningful alignment of the A-scans to study laryngeal tissue.
Circumferential scanning in endoscopic imaging is crucial across various disciplines, and optical coherence tomography (OCT) is often the preferred choice due to its high-speed, high-resolution, and micron-scale imaging capabilities. Moreover, real-time and high-speed 3D endoscopy is a pivotal technology for medical screening and precise surgical guidance, among other applications. However, challenges such as image jitter and non-uniform rotational distortion (NURD) are persistent obstacles that hinder real-time visualization during high-speed OCT procedures. To address this issue, we developed an innovative, low-cost endoscope that employs a brushless DC motor for scanning, and a sensorless technique for triggering and synchronizing OCT imaging with the scanning motor. This sensorless approach uses the motor’s electrical feedback (back electromotive force, BEMF) as a virtual Hall sensor to initiate OCT image acquisition and synchronize it with a Fourier Domain Mode-Locked (FDML)-based Megahertz OCT system. Notably, the implementation of BEMF-triggered OCT has led to a substantial reduction in image jitter and NURD (<4 mrad), thereby opening up a new window for real-time visualization capabilities. This approach suggests potential benefits across various applications, aiming to provide a more accurate, deployable, and cost-effective solution. Subsequent studies can explore the adaptability of this system to specific clinical scenarios and its performance under practical endoscopic conditions.
Objective: Optical coherence elastography (OCE) allows for high resolution analysis of elastic tissue properties. However, due to the limited penetration of light into tissue, miniature probes are required to reach structures inside the body, e.g., vessel walls. Shear wave elastography relates shear wave velocities to quantitative estimates of elasticity. Generally, this is achieved by measuring the runtime of waves between two or multiple points. For miniature probes, optical fibers have been integrated and the runtime between the point of excitation and a single measurement point has been considered. This approach requires precise temporal synchronization and spatial calibration between excitation and imaging. Methods: We present a miniaturized dual-fiber OCE probe of $1 \,\mathrm{m}\mathrm{m}$ diameter allowing for robust shear wave elastography. Shear wave velocity is estimated between two optics and hence independent of wave propagation between excitation and imaging. We quantify the wave propagation by evaluating either a single or two measurement points. Particularly, we compare both approaches to ultrasound elastography. Results: Our experimental results demonstrate that quantification of local tissue elasticities is feasible. For homogeneous soft tissue phantoms, we obtain mean deviations of $0.15 \,\mathrm{m}\mathrm{s}^{-1}$ and $0.02 \,\mathrm{m}\mathrm{s}^{-1}$ for single-fiber and dual-fiber OCE, respectively. In inhomogeneous phantoms, we measure mean deviations of up to $0.54 \,\mathrm{m}\mathrm{s}^{-1}$ and $0.03 \,\mathrm{m}\mathrm{s}^{-1}$ for single-fiber and dual-fiber OCE, respectively. Conclusion: We present a dual-fiber OCE approach that is much more robust in inhomogeneous tissues. Moreover, we demonstrate the feasibility of elasticity quantification in ex-vivo coronary arteries. Significance: This study introduces an approach for robust elasticity quantification from within the tissue.
High-speed endoscopic optical coherence tomography (OCT) imaging in the MHz range has shown great potential in various medical applications ranging from cancer screening to vascular disease monitoring. High-speed imaging always suffers from non-uniform rotational distortion (NURD) due to asynchronous motor rotation with the OCT system. Several research groups have previously attempted to solve this problem, using either an expensive motor with a sensor or numerical correction after data acquisition. However, both techniques pose challenges for practical use. Therefore, in this study, we use an inexpensive sensorless brushless DC motor with a Fourier domain mode-locked (FDML) laser-based MHz OCT system and try to resolve the problem of synchronization using three different modalities, (i) Slave-mode: The FDML frequency serves as a master frequency for the motor, which is phase-locked to the FDML frequency, (ii) Master-mode: The revolution trigger obtained from the motor's back electromotive force (BEMF) signal serves as a trigger signal for the OCT imaging system, (iii) Both: Fully synchronized setup, where the motor rotation is synchronized with the laser and the imaging system is synchronized with the motor to achieve phase-stable OCT imaging. The first case slightly fluctuates in live preview and imaging due to the absence of a revolution trigger, while the second has varying motor speeds. Therefore, we use the third case to phase-lock the motor with FDML and get a distortion-free live preview and image acquisition. Finally, we demonstrate high-speed SS-OCT structural imaging (at 3.3 MHz A-scan rates) of a finger with a 16 mm diameter probe (at 40,000 rpm).
PURPOSE:To evaluate the feasibility and accuracy of a radiation-free implantation of a thoracic aortic stent graft employing fiberoptic and electromagnetic tracking in an anthropomorphic phantom.MATERIALS AND METHODS:An anthropomorphic phantom was manufactured based on computed tomography (CT) angiography data from a patient. An aortic stent graft application system was equipped with a fiber Bragg gratings and 3 electromagnetic sensors. The stent graft was navigated in the phantom by 3 interventionalists using the tracking data generated by both technologies. One implantation procedure was performed. The technical success of the procedure was evaluated using digital subtraction angiography and CT angiography (before and after the intervention). Tracking accuracy was determined at various anatomical landmarks based on separately acquired fluoroscopic images. The mean/maximum errors were measured for the stent graft application system and the tip/end of the stent graft.RESULTS:The procedure resulted in technical success with a mean error below 3 mm for the entire application system and <2 mm for the position of the tip of the stent graft. Navigation/implantation and handling of the device were rated sufficiently accurate and on par with comparable, routinely used stent graft application systems.CONCLUSIONS:The study demonstrates successful stent graft implantation during a thoracic endovascular aortic repair procedure employing advanced guidance techniques and avoiding fluoroscopic imaging. This is an essential step in facilitating the implantation of stent grafts and reducing the health risks associated with ionizing radiation during endovascular procedures.
In endovascular aneurysm repair (EVAR) procedures, the stent graft navigation and implantation is currently performed under a two-dimensional (2D) imaging-based guidance requiring X-rays and contrast agent. In [1], a novel three-dimensional (3D) stent graft guidance approach based on tracking systems is introduced. The method is based on a 3D guidance method which combines fiber optical shape sensing with electromagnetic tracking to obtain the 3D shape [2] of the tracked instrument, e.g., a stent graft system. In this work, the approach is extended to provide also the 3D stent graft shape.
In endovascular aneuysm repair (EVAR) procedures, medical instruments are currently navigated with a two‐dimensional imaging based guidance requiring X‐rays and contrast agent.
During endovascular aneurysm repair (EVAR) procedures, medical instruments are guided with two-dimensional (2D) fluoroscopy and conventional digital subtraction angiography. However, this guidance requires X-ray exposure and contrast agent administration, and the depth information is missing. To overcome these drawbacks, a three-dimensional (3D) guidance approach based on tracking systems is introduced and evaluated [1].
In endovascular aneurysm repair (EVAR) procedures, the stent graft navigation and implantation is currently performed under a two-dimensional (2D) imaging based guidance requiring X-rays and contrast agent. In this work, a novel 3D stent graft guidance approach based on tracking systems is introduced. A calibration method and the visualization of the stent graft guidance are described. The tracking based stent graft guidance is evaluated by conducting an EVAR procedure on a torso phantom using a stent graft system equipped with an optical fiber and three EM sensors. The physicians were able to navigate the stent graft to the landing zone, and to place and implant it as intended using the introduced guidance. This showed that the application of the stent graft guidance is feasible in a clinical environment and promising for the reduction of radiation and contrast agent.
Purpose: To assess the efficacy of an instrument-integrated OCT (iiOCT)-based distance sensor during Participants: Patients requiring vitreoretinal surgery. Methods: Five patients were enrolled. Standard preoperative OCT images were obtained. After vitrectomy, a predefined set of actions was performed using the iiOCT-based sensor. Images then were processed to assess the signal-to-noise ratio (SNR) at various angles to the retina and at different distances between the instrument tip and the retinal surface. Preoperative and intraoperative OCT images were compared qualitatively and quantitatively. Main Outcomes Measures: The feasibility in performing surgical tasks using the iiOCT-based sensor during vitreoretinal surgery, the SNR when imaging the retina, differences among intraoperative and preoperative OCT images, and characteristics of intraoperative retinal movements detected with the iiOCT-based probe. Results: Surgeons were able to perform all the tasks but one. The PSS was able to maintain a fixed distance. The SNR of the iiOCT-based sensor signal was adequate to determine the distance to the retina and to control the PSS. Analysis of iiOCT-based sensor A-scans identified 3 clearly distinguishable retinal layers, including the inner retinal boundary and the interface at the retinal pigment epithelium-Bruch's membrane. Thickness values differed by less than 5% from that measured by preoperative OCT, indicating its accuracy. The Fourier analysis of iiOCTbased sensor recordings identified anteroposterior retinal movements attributed to heartbeat and respiration. Conclusions: This iiOCT-based sensor was tested successfully and promises reliable use during robotassisted surgery. An iiOCT-based sensor is a promising step toward OCT-guided robotic retinal surgery. Ophthalmology Science 2021;1:100085 & COPY; 2021 by the American Academy of Ophthalmology. This is an open access article under the CC BY-NC-ND license (http://creativecommons.org/licenses/by-nc-nd/4.0/).
For minimal invasive procedures like endovascular aortic repair procedures the instruments are navigated with 2D fluoroscopy imaging and digital subtraction angiography, which have several disadvantages. Optical fibers with fiber Bragg gratings (FBG), which allow to sense local strain respectively local curvature and bending angles, can be used for the guidance of medical tools to reduce the X-ray exposure and the used contrast agent. However, FBG-based shape sensing of flexible and long instruments is challenging and the computation includes many steps.
Previous research reported catheter pose-dependent virtual angioscopy images for endovascular aortic repair (EVAR) (phantom studies) without any validation with video images. The goal of our study focused on conducting this validation using a video graphics array (VGA) camera. The spatial relationship between the coordinate system of the virtual camera and the VGA camera was computed with a Hand-Eye calibration so that both cameras produced similar images. A re-projection error of 3.18 pixels for the virtual camera and 2.14 pixels for the VGA camera was obtained with a designed three-dimensional (3D) printed chessboard. Similar images of the vessel (3D printed aorta) were acquired with both cameras except for the different depth. Virtual angioscopy images provide information from inside the vessel that may facilitate the understanding of the tip position of the endovascular tools while performing EVAR.
Purpose During endovascular aneurysm repair (EVAR) procedures, medical instruments are guided with two-dimensional (2D) fluoroscopy and conventional digital subtraction angiography. However, this requires X-ray exposure and contrast agent is used, and the depth information is missing. To overcome these drawbacks, a three-dimensional (3D) guidance approach based on tracking systems is introduced and evaluated. Methods A multicore fiber with fiber Bragg gratings for shape sensing and three electromagnetic (EM) sensors for locating the shape were integrated into a stentgraft system. A model for obtaining the located shape of the first 38 cm of the stentgraft system with two EM sensors is introduced and compared with a method based on three EM sensors. Both methods were evaluated with a vessel phantom containing a 3D-printed vessel made of silicone and agar-agar simulating the surrounding tissue. Results The evaluation of the guidance methods resulted in average errors from 1.35 to 2.43 mm and maximum errors from 3.04 to 6.30 mm using three EM sensors, and average errors from 1.57 to 2.64 mm and maximum errors from 2.79 to 6.27 mm using two EM sensors. Moreover, the videos made from the continuous measurements showed that a real-time guidance is possible with both approaches. Conclusion The results showed that an accurate real-time guidance with two and three EM sensors is possible and that two EM sensors are already sufficient. Thus, the introduced 3D guidance method is promising to use it as navigation tool in EVAR procedures. Future work will focus on developing a method with less EM sensors and a detailed latency evaluation of the guidance method.
In endovascular aortic repair (EVAR) procedures fluoroscopy and conventional digital subtraction angiography are currently used to guide the medical instruments inside the patient. Drawbacks of these methods are X-ray exposure and the usage of contrast agents. Moreover, the fluoroscopy provides only a 2D view, which makes the guidance more difficult. For this reason, a catheter prototype including an optical fiber for shape sensing and three electromagnetic (EM) sensors, which provide the position and orientation information, was built to enable a 3D catheter guidance.
Introduction: Currently, endovascular aortic repair (EVAR) procedures are guided using fluoroscopy and 2D digital subtraction angiography. The research project Nav EVAR (funded by the German Federal Ministry of Education and Research, grant number 13GW0228C) aims to reduce the x-ray exposure and the administration of contrast agent. This project includes the development of a guidance system based on electromagnetic (EM) tracking for catheter location and Fiber Bragg Gratings (FBG) for catheter shape sensing. The goals of this study were to evaluate the accuracies of the catheter location and the catheter shape sensing separately, and to carry out an initial experiment combining both technologies. Methods: A custom-made 9F catheter was build containing an Aurora EM sensor (Northern Digital Inc.) at its tip and a FBG system (DTG©, FBGS Technologies GmbH). The EM sensor position was obtained by the EM tracking system and then transformed into the computed tomography (CT) planning data by using metallic markers placed on the patient's torso. An optimized shape sensing model was used to reconstruct the first 38 cm of the catheter. The combination of both technologies allowed the localization of the reconstructed shape. The EM tracking system was evaluated with a human torso model including a 3D-printed patient-specific aortic system. The catheter was inserted into the iliac artery and the EM sensor accuracy was assessed at five positions (Figure 1) by obtaining the ground truth from CT scans. The FBG system was evaluated by inserting the catheter into a 3D-printed patient-specific aortic system. The accuracy was assessed by comparing the reconstructed shape with the ground truth from a CT scan. The feasibility of the combined system was tested by visualizing the located shape with MeVisLab software (MeVis Medical Solutions AG). Results: For the EM tracking system, the error was 1.60 ± 0.86 mm (mean ± standard deviation, maximum error 2.56 mm). For the FBG system, the error was 1.13 ± 0.43 mm (maximum error 2.11 mm) over the whole 38 cm. Figure 2 shows the CT scan with the reconstructed shape. Regarding the combined guidance, the located shape moved in the same way as the catheter in the real scenario. Conclusion: Both technologies provided an error of less than 5 mm in realistic endovascular scenarios. This accuracy is required to ensure that the renal arteries are not blocked by the stent placement. The EM sensor accuracy was comparable to other studies [1-2]. Previous studies of FBG systems focused on medical needle shape sensing [3-4]. The shape reconstruction error was higher compared to previous studies, but our endovascular was more complex and realistic [5]. The combined system showed promising results. However, these are initial experiments that do not take into account any anatomical deformations during EVAR procedures. Future work will include the optimization of our catheter guidance system, intraoperative imaging for updating the actual anatomy and further evaluations with patient-specific models. Disclosure: Nothing to disclose
Purpose: Endovascular aortic repair procedures are currently conducted with 2D fluoroscopy imaging. Tracking systems based on fiber Bragg gratings are an emerging technology for the navigation of minimal-invasive instruments which can reduce the x-ray exposure and the used contrast agent. Shape sensing of flexible structures is challenging and includes many calculations steps which are prone to different errors. To reduce this errors, we present an optimized shape sensing model. Methods: We analyzed for every step of the shape sensing process, which errors can occur, how the error affects the shape and how it can be compensated or minimized. Experiments were done with a multicore fiber system with 38 cm sensing length and the effects of different methods and parameters were analyzed. Furthermore we compared 3D shape reconstructions with the segmented shape of the corresponding CT scans of the fiber to evaluate the accuracy of our optimized shape sensing model. Finally we tested our model in a realistic endovascular scenario by using a 3D printed vessel system created from patient data. Results: Depending on the complexity of the shape we reached an average error of 0.35 to 1.15 mm and maximal error of 0.75 to 7.53 mm over the whole 38 cm sensing length. In the endovascular scenario we obtained an average and maximal error of 1.13 mm and 2.11 mm, respectively. Conclusions: The accuracies of the 3D shape sensing model are promising and we plan to combine the shape sensing based on fiber Bragg gratings with the position and orientation of an electromagnetic sensor system to obtain the located shape of the catheter.
We present a forward-viewing fiber scanning endoscope (FSE) for high-speed volumetric optical coherence tomography (OCT). The reduction in size of the probe was achieved by substituting the focusing optics by an all-fiber-based imaging system which consists of a combination of scanning single-mode fibers, a glass spacer, made from a step-index multi-mode fiber, and a gradient-index fiber. A lateral resolution of 11 μm was achieved at a working distance of 1.2 mm. The newly designed piezo-based FSE has an outer diameter of 1.6 mm and a rigid length of 13.5 mm. By moving the whole imaging optic in spirals for scanning the sample, the beam quality remains constant over the entire field of view with a diameter of 0.8 mm. The scanning frequency was adjusted to 1.22 kHz for use with a 3.28 MHz Fourier domain mode locked OCT system. Densely sampled volumes have been imaged at a rate of 6 volumes per second.