PoCaPNet: A Novel Approach for Surgical Phase Recognition Using Speech and X-Ray Images

CoRR(2023)

引用 0|浏览13
暂无评分
摘要
Surgical phase recognition is a challenging and necessary task for the development of context-aware intelligent systems that can support medical personnel for better patient care and effective operating room management. In this paper, we present a surgical phase recognition framework that employs a Multi-Stage Temporal Convolution Network using speech and X-Ray images for the first time. We evaluate our proposed approach using our dataset that comprises 31 port-catheter placement operations and report 82.56 \% frame-wise accuracy with eight surgical phases. Additionally, we investigate the design choices in the temporal model and solutions for the class-imbalance problem. Our experiments demonstrate that speech and X-Ray data can be effectively utilized for surgical phase recognition, providing a foundation for the development of speech assistants in operating rooms of the future.
更多
查看译文
关键词
surgical phase recognition,speech
AI 理解论文
溯源树
样例
生成溯源树,研究论文发展脉络