北京生物醫(yī)學(xué)工程

基于HoloLens的增強現(xiàn)實手術(shù)導(dǎo)航系統(tǒng)研究

Research on augmented reality surgery navigation system based on HoloLens

作者：于德旺王殊軼姜陶然陳俊丁竹谷雯雪

單位：上海理工大學(xué)醫(yī)療器械與食品學(xué)院（上海 200093）上海交通大學(xué)醫(yī)學(xué)院附屬第九人民醫(yī)院整復(fù)外科（上海 200011）

關(guān)鍵詞： HoloLens; 手術(shù)導(dǎo)航系統(tǒng); 增強現(xiàn)實; 誤差; 影響因素; 人因工程

分類號：R318.04

出版年·卷·期（頁碼）：2020·39·3（244-250）

摘要：

目的開發(fā)基于HoloLens的AR手術(shù)導(dǎo)航系統(tǒng)，分析此系統(tǒng)誤差影響因素，定量探究各個因素對誤差的影響大小，為此類導(dǎo)航系統(tǒng)誤差的降低明確側(cè)重點。方法以Unity3D為開發(fā)平臺開發(fā)的手術(shù)導(dǎo)航系統(tǒng)實現(xiàn)了3種三維注冊方法：基于識別圖三維注冊、三點注冊和手動注冊。從人因工程的角度出發(fā)結(jié)合臨床醫(yī)生手術(shù)操作行為、HoloLens性能和臨床使用環(huán)境三方面分析誤差的可能影響因素，即三維注冊方法、頭部轉(zhuǎn)動、周圍人數(shù)和觀測角度。將這些因素設(shè)置為3個水平，設(shè)計正交實驗驗證并測量不同因素不同水平下每次實驗的誤差大小，通過方差分析確定影像程度是否顯著。結(jié)果導(dǎo)航系統(tǒng)3種注冊方法平均誤差值為4.16 mm。4個因素產(chǎn)生的誤差量分別為3.88mm、0.91mm、4.77mm和3.38mm。結(jié)論系統(tǒng)能夠?qū)崿F(xiàn)導(dǎo)航功能但存在一定誤差，誤差影響程度由大到小為頭部轉(zhuǎn)動、三維注冊方法、周圍人數(shù)和觀測角度，其中頭部轉(zhuǎn)動和三維注冊方法具有顯著性影響，這為基于HoloLens的AR手術(shù)導(dǎo)航系統(tǒng)誤差的降低和交互方式的設(shè)計提供新的思路。

Objective To develop an augmented reality (AR) surgical navigation system based on HoloLens, to analyze influence factors for its system error and to quantitatively investigate the effects of these factors on error, thereby pinpointing the focus to reduce error for this type of navigation system. Methods The surgical navigation system was developed on the platform of Unity3D and three kinds of three-dimensional registration methods were realized, i.e., three-dimensional registration based on identification map, three-point registration and manual registration. From the perspective of human factors engineering, potential factors influencing the error were analyzed by combining the three aspects of surgical operations by clinicians, HoloLens performance and clinical settings. Specifically, these influence factors included the three-dimensional registration method, the rotation of head, the number of surrounding people and the observation angle, which were set as three levels. An orthogonal experiment was designed to validate and measure the error for each experiment with a differed factor and level, thereby determining whether the influence was significant through variance analysis. Results The average error for the three registration methods of the navigation system was 4.16 mm while the error for the four factors was 3.88mm, 0.91mm, 4.77mm and 3.38mm, respectively. Conclusions The system can realize navigation functions though certain errors existed. Also, the sequence of influence factors is the rotation of head, the three-dimensional registration method, the number of surrounding people and the observation angle in descending order, among which the rotation of head and the three-dimensional registration method has a significant impact on error. These findings can provide new approaches for error reduction in AR surgical navigation systems based on HoloLens and design of the interactive mode.

參考文獻：

[1] 沈軼. 高精度手術(shù)導(dǎo)航的研究與應(yīng)用[D]. 上海：上海交通大學(xué),2012

Shen Y. High precision surgical navigation and its application[D]. Shanghai：Shanghai Jiao Tong University,2012

[2] 鈕艷華, 汪元美, 段會龍. 基于增強現(xiàn)實的外科手術(shù)導(dǎo)航技術(shù)[J]. 中國醫(yī)療器械雜志, 2004, 28(1):50-54.

Niu YH, Wang YM, Duan HL. A survey on augmented- reality- based IGS system[J]. Chinese Journal of Medical Instrumentation, 2004, 28(1):50-54.

[3] 范真誠, 張欣然, 廖洪恩. 精準空間透視融合手術(shù)導(dǎo)航[J]. 中國醫(yī)療設(shè)備, 2016, 31(3):26-32

Fan ZC, Zhang XR, Liao HN. High-precision three-dimensional space see-through surgical navigation [J]. China Medical Devices, 2016, 31 (3):26-32.

[4] 王涌天, 陳靖, 程德文著. 增強現(xiàn)實技術(shù)導(dǎo)論[M].北京:國防工業(yè)出版社,2015.

Wang YT, Chen J, Cheng DW. Augmented reality: an emerging technologies guide to AR[M]. Beijing: National Defense Industry Press.,2015.

[5] Rodrigues DG, Jain A, Rick SR, et.al. Exploring mixed reality in specialized surgical environments[C]//Proceedings of the ACMCHI conference on human factors in computing systems.New York:CHI,2017

[6] Cui N, Kharel P, Gruev V, Augmented reality with Microsoft HoloLens holograms for near infrared fluorescence based image guided surgery[C]// Molecular-Guided Surgery: Molecules, Devices, and Applications III .San Francisco, California: SPIE, 2017.

[7] Qian L, Barthel A,Johnson A,et,al. Comparison of optical see-through head-mounted displays for surgical interventions with object-anchored 2D-display[J].International Journal of Computer Assisted Radiology & Surgery , 2017 , 12 (6) :901-910

[8] Philp P , Matthew I, Graham L , et al. Through the HoloLensTM:looking glass: augmented reality for extremity reconstruction surgery using 3D vascular models with perforating vessels[J]. European Radiology Experimental, 2018, 2(2):1-7

[9] Fatih I,Marion S,Clemens D,et al. Clinical feasibility of a wearable mixed reality device in neurosurgery[J]. World Neurosurgery,2018,118:1-6

[10] Reid V, Adam R, Elvis C,et al.Hologram stability evaluation for Microsoft? HoloLens?[J].MEDICAL IMAGING 2017: Image Perception, Observer Performance, and Technology Assessment,2017, 1013614(3):1-6

[11] ANSI/AAMI HE75:2009(ANSI/AAMI HE 75:2009).Human factors engineering-Design of medical devices[S]. Kensington: American Nuclear Society Specification,2009,

[12] Jiang T, Zhu M, Zan T, et al. A novel augmented reality-based navigation system in perforator flap transplantation - a feasibility study[J]. Annals of Plastic Surgery, 2017, 79:192-196.

[13] Wu ML , Chien JC ,Wu CT, et al.An augmented reality system using improved-iterative closest point algorithm for on-patient medical image visualization[J]. Sensors, 2018, 18(8), 2505.

服務(wù)與反饋：

【文章下載】【加入收藏】

提示：您還未登錄，請登錄！點此登錄

51黑料吃瓜在线观看,51黑料官网|51黑料捷克街头搭讪_51黑料入口最新视频