Modern Image-Guided Surgery: A Narrative Review of Medical Image Processing and Visualization.

Publisher: MDPI Country of Publication: Switzerland NLM ID: 101204366 Publication Model: Electronic Cited Medium: Internet ISSN: 1424-8220 (Electronic) Linking ISSN: 14248220 NLM ISO Abbreviation: Sensors (Basel) Subsets: MEDLINE

Original Publication: Basel, Switzerland : MDPI, c2000-

Surgery, Computer-Assisted*/methods ; Virtual Reality* ; Augmented Reality*; Image Processing, Computer-Assisted

Medical image analysis forms the basis of image-guided surgery (IGS) and many of its fundamental tasks. Driven by the growing number of medical imaging modalities, the research community of medical imaging has developed methods and achieved functionality breakthroughs. However, with the overwhelming pool of information in the literature, it has become increasingly challenging for researchers to extract context-relevant information for specific applications, especially when many widely used methods exist in a variety of versions optimized for their respective application domains. By being further equipped with sophisticated three-dimensional (3D) medical image visualization and digital reality technology, medical experts could enhance their performance capabilities in IGS by multiple folds. The goal of this narrative review is to organize the key components of IGS in the aspects of medical image processing and visualization with a new perspective and insights. The literature search was conducted using mainstream academic search engines with a combination of keywords relevant to the field up until mid-2022. This survey systemically summarizes the basic, mainstream, and state-of-the-art medical image processing methods as well as how visualization technology like augmented/mixed/virtual reality (AR/MR/VR) are enhancing performance in IGS. Further, we hope that this survey will shed some light on the future of IGS in the face of challenges and opportunities for the research directions of medical image processing and visualization.

Comput Assist Surg (Abingdon). 2018 Dec;23(1):42-52. (PMID: 30497291)
BMC Oral Health. 2019 Nov 8;19(1):238. (PMID: 31703708)
Proc IEEE Comput Soc Conf Comput Vis Pattern Recognit. 2021 Jun;2021:2423-2432. (PMID: 35444379)
Int J Comput Assist Radiol Surg. 2021 Apr;16(4):663-671. (PMID: 33709240)
Healthc Technol Lett. 2019 Nov 26;6(6):214-219. (PMID: 32038860)
Int J Comput Assist Radiol Surg. 2022 Oct;17(10):1787-1799. (PMID: 35843963)
Med Image Anal. 2022 Aug;80:102478. (PMID: 35691144)
J Med Phys. 2010 Jan;35(1):3-14. (PMID: 20177565)
Med Image Anal. 2022 Aug;80:102487. (PMID: 35671591)
Phys Med Biol. 2019 May 02;64(9):095022. (PMID: 30921783)
BJR Open. 2019 Nov 28;2(1):20190031. (PMID: 33178962)
Plast Reconstr Surg Glob Open. 2015 Mar 06;3(2):e307. (PMID: 25750846)
Comput Methods Programs Biomed. 2018 May;158:135-146. (PMID: 29544779)
Semin Plast Surg. 2014 Aug;28(3):150-8. (PMID: 25210509)
Clin Orthop Relat Res. 2006 Jan;442:30-4. (PMID: 16394735)
Multimed Tools Appl. 2022;81(18):25101-25145. (PMID: 35342327)
Curr Opin Otolaryngol Head Neck Surg. 2021 Apr 1;29(2):149-155. (PMID: 33394735)
Artif Intell Rev. 2022;55(7):5845-5889. (PMID: 35250146)
Med Image Anal. 2013 Dec;17(8):974-96. (PMID: 23837969)
Int J Comput Assist Radiol Surg. 2021 Oct;16(10):1795-1804. (PMID: 34392469)
Otolaryngol Clin North Am. 1994 Oct;27(5):875-89. (PMID: 7816436)
Turk J Urol. 2019 Sep 1;45(5):357-365. (PMID: 31509508)
Med Phys. 2021 May;48(5):2145-2159. (PMID: 33666243)
IEEE Trans Med Imaging. 2017 Dec;36(12):2536-2545. (PMID: 28574346)
Int J Comput Assist Radiol Surg. 2020 Nov;15(11):1907-1919. (PMID: 32809184)
Med Image Anal. 2023 Jul;87:102810. (PMID: 37054648)
Surg Endosc. 2016 Sep;30(9):4136-49. (PMID: 26659243)
Int J Comput Assist Radiol Surg. 2022 Jul;17(7):1343-1353. (PMID: 35441961)
Annu Int Conf IEEE Eng Med Biol Soc. 2010;2010:5149-52. (PMID: 21095814)
Int J Comput Assist Radiol Surg. 2022 Oct;17(10):1947-1956. (PMID: 35798998)
Ann Surg. 2018 Jun;267(6):1134-1140. (PMID: 28181939)
Comput Med Imaging Graph. 2021 Sep;92:101969. (PMID: 34411966)
Med Phys. 2015 May;42(5):2540-9. (PMID: 25979046)
Int J Comput Assist Radiol Surg. 2022 Jun;17(6):1017-1027. (PMID: 35489006)
Ultrasound Med Biol. 2007 Jul;33(7):991-1009. (PMID: 17512655)
Phys Med Biol. 2020 Oct 22;65(20):20TR01. (PMID: 32217829)
IEEE Trans Biomed Eng. 2011 Jun;58(6):1855-64. (PMID: 21411401)
Int J Comput Assist Radiol Surg. 2019 Aug;14(8):1317-1327. (PMID: 31069643)
Med Phys. 2023 Jan;50(1):74-88. (PMID: 36018732)
Int J Comput Assist Radiol Surg. 2021 Apr;16(4):695-701. (PMID: 33725339)
Int J Comput Assist Radiol Surg. 2022 Sep;17(9):1543-1552. (PMID: 35704238)
Surg Innov. 2020 Apr;27(2):193-202. (PMID: 31920155)
Neural Netw. 2020 Jan;121:74-87. (PMID: 31536901)
Langenbecks Arch Surg. 2013 Apr;398(4):501-14. (PMID: 23430289)
Med Image Anal. 2017 Jan;35:633-654. (PMID: 27744253)
Med Image Anal. 2022 Aug;80:102511. (PMID: 35753278)
Med Image Anal. 2006 Aug;10(4):509-19. (PMID: 16624612)
Curr Med Sci. 2019 Feb;39(1):1-6. (PMID: 30868484)
Int J Comput Assist Radiol Surg. 2020 Oct;15(10):1719-1725. (PMID: 32725399)
Annu Int Conf IEEE Eng Med Biol Soc. 2017 Jul;2017:1756-1759. (PMID: 29060227)
Int J Comput Assist Radiol Surg. 2021 Mar;16(3):515-524. (PMID: 33575933)
Int J Comput Assist Radiol Surg. 2019 Aug;14(8):1303-1315. (PMID: 31055765)
Expert Rev Med Devices. 2021 Jan;18(1):47-62. (PMID: 33283563)
Comput Methods Programs Biomed. 2018 May;158:113-122. (PMID: 29544777)
World Neurosurg. 2018 Oct;118:e422-e427. (PMID: 30257298)
Int J Comput Assist Radiol Surg. 2022 Jun;17(6):981-991. (PMID: 35286586)
Spine (Phila Pa 1976). 2019 Aug 1;44(15):1097-1104. (PMID: 30830046)
BMC Med Imaging. 2015 Nov 02;15:51. (PMID: 26525142)
Int J Comput Assist Radiol Surg. 2021 Jul;16(7):1213-1225. (PMID: 34114173)
Otolaryngol Head Neck Surg. 2018 Nov;159(5):933-937. (PMID: 30200812)
IEEE Trans Med Imaging. 2017 Dec;36(12):2524-2535. (PMID: 28622671)
Int J Comput Assist Radiol Surg. 2022 Jun;17(6):1079-1089. (PMID: 35511394)
Int J Comput Assist Radiol Surg. 2022 Oct;17(10):1765-1773. (PMID: 35622201)
Comput Med Imaging Graph. 2015 Mar;40:205-16. (PMID: 25263644)
Int J Comput Assist Radiol Surg. 2020 Nov;15(11):1881-1894. (PMID: 32870445)
Front Radiol. 2021 Dec 13;1:781868. (PMID: 37492170)
IEEE J Transl Eng Health Med. 2019 Oct 18;7:3300310. (PMID: 32309059)
Int J Comput Assist Radiol Surg. 2021 Sep;16(9):1565-1576. (PMID: 33830426)
Int J Comput Assist Radiol Surg. 2020 Jun;15(6):1013-1021. (PMID: 32323206)
Med Phys. 2019 Aug;46(8):3709-3718. (PMID: 31169914)
Artif Intell Med. 2020 Nov;110:101980. (PMID: 33250150)
Int J Comput Assist Radiol Surg. 2020 Mar;15(3):467-477. (PMID: 31808070)
IEEE J Biomed Health Inform. 2020 Jul;24(7):2093-2106. (PMID: 31751255)
Int J Comput Assist Radiol Surg. 2021 Nov;16(11):2055-2066. (PMID: 34382176)
World Neurosurg. 2018 Jan;109:24-30. (PMID: 28917704)
Med Phys. 2018 Nov;45(11):4986-5003. (PMID: 30168159)
Med Image Anal. 2022 Aug;80:102469. (PMID: 35640385)
Phys Med. 2019 Mar;59:22-29. (PMID: 30928062)
Biomed Res Int. 2021 Mar 29;2021:6620746. (PMID: 33860042)
Int J Comput Assist Radiol Surg. 2022 Oct;17(10):1751-1764. (PMID: 35639202)
Int J Comput Assist Radiol Surg. 2020 Mar;15(3):479-489. (PMID: 31950410)
BMC Med Imaging. 2021 Jan 18;21(1):12. (PMID: 33461500)
J Craniofac Surg. 2019 Mar/Apr;30(2):465-472. (PMID: 30640846)
Int J Comput Assist Radiol Surg. 2022 Nov;17(11):2011-2021. (PMID: 35976596)
Int J Comput Assist Radiol Surg. 2020 Nov;15(11):1895-1905. (PMID: 32725398)
Int J Comput Assist Radiol Surg. 2021 Mar;16(3):407-414. (PMID: 33555563)
Int J Comput Assist Radiol Surg. 2020 Oct;15(10):1619-1630. (PMID: 32770324)
Radiol Technol. 2019 May;90(5):489-501. (PMID: 31088949)
Oral Oncol. 2020 Jan;100:104491. (PMID: 31794886)
Int J Comput Assist Radiol Surg. 2019 Jan;14(1):93-104. (PMID: 30196337)
Neurosurgery. 2019 Jun 1;84(6):1179-1189. (PMID: 30615160)
Surg Endosc. 2003 Dec;17(12):1943-50. (PMID: 14574546)
Otol Neurotol. 2018 Dec;39(10):e1137-e1142. (PMID: 30239435)
Int J Med Robot. 2016 Jun;12(2):158-78. (PMID: 25931190)
Int J Med Robot. 2015 Jun;11(2):223-34. (PMID: 24801120)
IEEE Trans Med Imaging. 2019 Feb 04;:. (PMID: 30716034)
Med Image Anal. 2022 Aug;80:102526. (PMID: 35780592)
Int J Med Robot. 2021 Aug;17(4):e2272. (PMID: 33951748)
Med Image Comput Comput Assist Interv. 2018 Sep;11073:72-80. (PMID: 31098598)
Int J Comput Assist Radiol Surg. 2019 Jun;14(6):967-976. (PMID: 30888596)
Int J Comput Assist Radiol Surg. 2020 May;15(5):867-876. (PMID: 32227280)
J Pers Med. 2022 Feb 18;12(2):. (PMID: 35207796)
IEEE Trans Med Imaging. 2002 Nov;21(11):1344-57. (PMID: 12575871)
Int J Comput Assist Radiol Surg. 2023 Mar;18(3):537-544. (PMID: 36173542)
IEEE Trans Biomed Eng. 2017 Aug;64(8):1815-1825. (PMID: 27834634)
Int J Comput Assist Radiol Surg. 2019 Jun;14(6):955-966. (PMID: 30888597)
Surv Ophthalmol. 2006 May-Jun;51(3):259-73. (PMID: 16644366)
Int J Comput Assist Radiol Surg. 2019 Aug;14(8):1285-1294. (PMID: 31016562)
Int J Comput Assist Radiol Surg. 2022 Jan;17(1):15-26. (PMID: 34449036)
Int J Comput Assist Radiol Surg. 2021 Aug;16(8):1347-1356. (PMID: 33937966)
Med Image Anal. 2019 Feb;52:128-143. (PMID: 30579222)
Int J Comput Assist Radiol Surg. 2022 Feb;17(2):271-281. (PMID: 34725774)
Annu Int Conf IEEE Eng Med Biol Soc. 2015;2015:4210-3. (PMID: 26737223)
Int J Comput Assist Radiol Surg. 2013 Nov;8(6):1015-25. (PMID: 23649730)
Plast Reconstr Surg. 1993 Apr;91(4):642-54; discussion 655-6. (PMID: 8446718)
IEEE Trans Biomed Eng. 2020 Sep;67(9):2683-2695. (PMID: 31985404)
IEEE Trans Image Process. 2015 Nov;24(11):4213-24. (PMID: 26186776)
Stud Health Technol Inform. 2001;81:171-6. (PMID: 11317733)

Keywords: 3D visual interface; augmented/mixed/virtual reality; image-guided surgery; medical image processing; surgical navigation

Date Created: 20231223 Date Completed: 20231225 Latest Revision: 20231225

20231225

PMC10748263

10.3390/s23249872

38139718