ABSTRACT

Virtual and augmented reality can be defined as a three-dimensional real-world simulation allowing the user to directly interact with it. Throughout the years, virtual reality has gained great popularity in medicine and is currently being adopted for a wide range of purposes. Due to its dynamic anatomical nature, permanent drive towards decreasing invasiveness, and strive for innovation, cardiac surgery depicts itself as a unique environment for virtual reality. Despite substantial research limitations in cardiac surgery, the current literature has shown great applicability of this technology, and promising opportunities.

INTRODUCTION

Virtual and augmented reality (VR and AR) can be defined as a three-dimensional (3D) real-world simulation allowing the user to directly interact with it (Figure 1) ^[1]. Through the integration of imaging data and input from users ^[2], VR delivers a 3D graphical output which can be then visualized through a wearable headset (Figure 2). Throughout the years, VR has gained great popularity in medicine and is currently being adopted for a wide range of purposes including medical education, stroke rehabilitation, and teaching of surgical techniques, particularly laparoscopy ^[3,4]. Despite its great advances in numerous areas of medicine, the future potential innovative impact of VR in cardiac surgery has not been extensively discussed yet, with no formal integration of this technology in this specialty. Nevertheless, due to its dynamic anatomical nature, permanent drive towards decreasing invasiveness, and strive for innovation, cardiac surgery depicts itself as a unique environment for VR.

Fig. 1 - Practical implementation of the virtual reality in the surgical operating room.

Download

Fig. 1 - Practical implementation of the virtual reality in the surgical operating room.

Fig. 2 - Schematic display of extended realities. A) Virtual reality: digital space is completely separated from the environment. B) Augmented reality: digital space is integrated into the users’ natural environment. C) Mixed reality: the user is able to stay in his natural environment and still interact with the digital information.

Download

Fig. 2 - Schematic display of extended realities. A) Virtual reality: digital space is completely separated from the environment. B) Augmented reality: digital space is integrated into the users’ natural environment. C) Mixed reality: the user is able to stay in his natural environment and still interact with the digital information.

COMMENTS

The Role of VR in Undergraduate and Postgraduate Cardiac Teaching

See one, do one, teach one - the method of “learning-by-doing” paired with “on-the-job-training” is one of the most popular surgical training methods. Ever since the surgeons have been using real-life scenario simulations, practical skills sessions, and video sessions ^[5] as means of improving their dexterity, the desire for more precise and even more stimulating methods has been growing. As the works to develop robots and interactive technologies to support surgical performance have been underway ^[6], the VR and active engagement techniques came along. Initially, they have been thought to allow 3D view and better insight into the anatomy and procedures. Since the introduction of 3D visualisation, many alternative ways to utilize the new techniques have been developed. The real-time interaction, decreasing invasiveness of procedures, and a reliable tool of surgical skills assessments are only a few to mention for a variety of opportunities given by the VR training in medicine and surgery.

The Role of VR in Preoperative, Intraoperative, and Postoperative Cardiac Surgery

Perhaps one of the greatest potential future applications of VR systems in cardiac surgery will be their assistance and support for the much-desired shift from open sternotomy procedures to minimally invasive ones. Reducing patient’s intraoperative trauma and allowing for faster postoperative recovery have been some of the priorities of cardiac surgery over the past decades, thus leading to the development of endoscopically- and robotically-assisted minimally invasive cardiac procedures ^[7]. Nevertheless, the shift towards minimally invasive cardiac surgery (MICS) has been taking place at a slow pace due to numerous limitations. The latter include its learning curve and the shortage of safe and structured training methods, the difficulties in port location in order to enable effective X-ray and angiography coverage, and the limited access to anatomical and surgical targets ^[8-12]. Indeed, even at wide-angled panoramic views, the use of an endoscope for the visualisation of complex anatomical structures in a 3D and dynamic environment proves to be complicated and could be considered a limitation to MICS. In light of these limitations, VR might be able to offer unique opportunities to improve the visualisation of surgical targets and enhance the beating-heart intracardiac surgical outcomes (Figure 3) ^[13,14].

Fig. 3 - Augmented reality in cardiac surgery (by Sadeghi et al. ^[14]). A and B) Coronary angiography with proximally calcified aneurysm and an occlusion of the left anterior descending artery (LAD) with collateral retrograde filling from the right coronary artery (RCA) and no abnormalities in the left circumflex (Cx) artery. C) Reconstructions of a computed tomography (CT) scan were made by rendering three-dimensional virtual reality (VR) images. D and E) Reconstruction of the CT scan. G-J) Immersive VR was used to plan for the insertion location of thoracoscopic ports (for left internal mammary arteries [LIMA] harvesting) and for determining the ideal location for anterior mini-thoracotomy.

Download

Fig. 3 - Augmented reality in cardiac surgery (by Sadeghi et al. ^[14]). A and B) Coronary angiography with proximally calcified aneurysm and an occlusion of the left anterior descending artery (LAD) with collateral retrograde filling from the right coronary artery (RCA) and no abnormalities in the left circumflex (Cx) artery. C) Reconstructions of a computed tomography (CT) scan were made by rendering three-dimensional virtual reality (VR) images. D and E) Reconstruction of the CT scan. G-J) Immersive VR was used to plan for the insertion location of thoracoscopic ports (for left internal mammary arteries [LIMA] harvesting) and for determining the ideal location for anterior mini-thoracotomy.

Is VR and AR Implementation in Cardiac Surgery Cost-Effective?

Since the conception of VR and AR in a healthcare setting, the cost of its implementation has been a significant barrier to its use in surgery. This is particularly true for cardiac surgery which requires VR and AR simulations to be of high-fidelity and precision, regardless of the purpose of the simulation. For this reason, the sheer processing power alone of a computer suitable for such VR simulations rendered the technology poorly cost-effective ^[15]. However, over the past decade, the economic barriers to the use of VR and AR in a surgical setting have diminished as cheaper technology with significantly stronger processing power becomes commercialized and the opportunities of VR to improve patient safety, surgical training, and audit quality becomes evident.

In particular, implementation costs for VR and AR technology in a surgical setting are becoming more affordable through the use and adaption of commercially available hardware that is non-specific in its use, such as in the case of recently developed VR headsets that provide high-quality visuals and realistic surgeon hand interactions ^[16]. It would not be unreasonable to assume that potentially significant advances in reducing costs when simulating cardiothoracic surgery can be made, particularly comparing to almost a decade ago.

Moreover, VR has shown promising and potential cost-effectiveness in presurgical and interventional planning in congenital cardiac surgery. Whilst in the short-term, VR incurs significant initial set-up and implementation costs relative to 3D printing heart models, in the long-term it has been suggested to control costs, reduce material wastage, and allow for a more immersive and detailed experience for the multidisciplinary team by allowing improved depth perception and visualization ^[17]. In fact, it can also be argued that relatively similar start-up costs exist for 3D printing heart models, including the recruitment of appropriate technicians and specialists to facilitate the operation ^[18]. However, beyond the initial fixed set-up costs, VR may reduce costs compared with 3D printing, as the need for regular purchases of materials and disposal of plastic waste is removed ^[18].

Within surgical teaching, VR can eliminate the even greater costs of cadaveric and animal tissue models whilst providing a wider range of anatomical variation ^[19]. Furthermore, VR allows for repetitions of the learning experience, which not only improves the efficacy of the curricula, but it can also lead to further cost savings in the long-term. Particularly in regard to robotic surgery, which is associated with significant costs in its use and implementation, VR has been shown to be a valuable alternative to operating room learning sessions.

CONCLUSION

From our perspective, VR and AR brings opportunities to rapidly develop the field of cardiac surgery. VR has gained growing popularity and adoption in different medical and surgical fields, being embedded from medical education to preoperative planning, operative assistance, and even postoperative support to patients. The drive for innovation in cardiac surgery has been growing over the past years in search of methods to maximize patient outcomes and quality of life and improve training pathways for young surgeons. Although substantial research limitations persist in the field of VR and AR application to cardiac surgery, the current literature has shown great applicability of this technology, and promising opportunities.

REFERENCES

1. Li L, Yu F, Shi D, Shi J, Tian Z, Yang J, et al. Application of virtual reality technology in clinical medicine. Am J Transl Res. 2017;9(9):3867-80. [MedLine]

2. Southworth MK, Silva JR, Silva JNA. Use of extended realities in cardiology. Trends Cardiovasc Med. 2020;30(3):143-8. doi:10.1016/j.tcm.2019.04.005. [MedLine]

3. Laver KE, George S, Thomas S, Deutsch JE, Crotty M. Virtual reality for stroke rehabilitation. Cochrane Database Syst Rev. 2015;2015(2):CD008349. Update in: Cochrane Database Syst Rev. 2017;11:CD008349. doi:10.1002/14651858.CD008349.pub3.

4. Gurusamy KS, Aggarwal R, Palanivelu L, Davidson BR. Virtual reality training for surgical trainees in laparoscopic surgery. Cochrane Database Syst Rev. 2009;(1):CD006575. Update in: Cochrane Database Syst Rev. 2013;8:CD006575. doi:10.1002/14651858.CD006575.pub2.

5. Vozenilek J, Huff JS, Reznek M, Gordon JA. See one, do one, teach one: advanced technology in medical education. Acad Emerg Med. 2004;11(11):1149-54. doi:10.1197/j.aem.2004.08.003.

6. McCloy R, Stone R. Science, medicine, and the future. Virtual reality in surgery. BMJ. 2001;323(7318):912-5. doi:10.1136/bmj.323.7318.912.

7. Iribarne A, Easterwood R, Chan EY, Yang J, Soni L, Russo MJ, et al. The golden age of minimally invasive cardiothoracic surgery: current and future perspectives. Future Cardiol. 2011;7(3):333-46. doi:10.2217/fca.11.23.

8. Bonaros N, Schachner T, Lehr E, Kofler M, Wiedemann D, Hong P, et al. Five hundred cases of robotic totally endoscopic coronary artery bypass grafting: predictors of success and safety. Ann Thorac Surg. 2013;95(3):803-12. doi:10.1016/j.athoracsur.2012.09.071.

9. Athanasiou T, Ashrafian H, Rowland SP, Casula R. Robotic cardiac surgery: advanced minimally invasive technology hindered by barriers to adoption. Future Cardiol. 2011;7(4):511-22. doi:10.2217/fca.11.40.

10. Doenst T, Diab M, Sponholz C, Bauer M, Färber G. The opportunities and limitations of minimally invasive cardiac surgery. Dtsch Arztebl Int. 2017;114(46):777-84. doi:10.3238/arztebl.2017.0777.

11. Devernay F, Mourgues F, Coste-Manière È. Towards endoscopic augmented reality for robotically assisted minimally invasive cardiac surgery. In: Proceedings International Workshop on Medical Imaging and Augmented Reality. Honk Kong, China: IEEE; 2001. p. 16-20. doi:10.1109/ MIAR.2001.930258.

12. Napa S, Moore M, Bardyn T. Advancing cardiac surgery case planning and case review conferences using virtual reality in medical libraries: evaluation of the usability of two virtual reality apps. JMIR Hum Factors. 2019;6(1):e12008. doi:10.2196/12008.

13. Chiu AM, Dey D, Drangova M, Boyd WD, Peters TM. 3-D image guidance for minimally invasive robotic coronary artery bypass. Heart Surg Forum. 2000;3(3):224-31.

14. Sadeghi AH, Taverne YJHJ, Bogers AJJC, Mahtab EAF. Immersive virtual reality surgical planning of minimally invasive coronary artery bypass for Kawasaki disease. Eur Heart J. 2020;41(34):3279. doi:10.1093/eurheartj/ ehaa518.

15. Greenleaf WJ, Paiantanida T. Medical applications of virtual reality technology. In: Bronzino JD (editor). The Biomedical engineering handbook. 2nd. Boca Raton (FL): CRC Press LCC; 2000 . Available from: https://www.researchgate.net/publication/299632073_ Medical_Applications_of_Virtual_Reality_Technology

16. Parham G, Bing EG, Cuevas A, Fisher B, Skinner J, Mwanahamuntu M, et al. Creating a low-cost virtual reality surgical simulation to increase surgical oncology capacity and capability. Ecancermedicalscience. 2019;13:910. doi:10.3332/ecancer.2019.910. Rad A A, et al. - VR and AR in Cardiac Surgery Braz J Cardiovasc Surg 2022;37(1)123-127 127 Brazilian Journal of Cardiovascular Surgery

17. Ong CS, Krishnan A, Huang CY, Spevak P, Vricella L, Hibino N, et al. Role of virtual reality in congenital heart disease. Congenit Heart Dis. 2018;13(3):357-61. doi:10.1111/chd.12587.

18. Yanagawa B, Ribeiro R, Naqib F, Fann J, Verma S, Puskas JD. See one, simulate many, do one, teach one: cardiac surgical simulation. Curr Opin Cardiol. 2019;34(5):571-7. doi:10.1097/HCO.0000000000000659.

19. Solomon B, Bizekis C, Dellis SL, Donington JS, Oliker A, Balsam LB, et al. Simulating video-assisted thoracoscopic lobectomy: a virtual reality cognitive task simulation. J Thorac Cardiovasc Surg. 2011;141(1):249-55. doi:10.1016/j.jtcvs.2010.09.014.

Authors' roles & responsibilities

AAR Substantial contributions to the conception or design of the work; or the acquisition, analysis, or interpretation of data for the work; drafting the work or revising it critically for important intellectual content; agreement to be accountable for all aspects of the work in ensuring that questions related to the accuracy or integrity of any part of the work are appropriately investigated and resolved; final approval of the version to be published

RV Substantial contributions to the conception or design of the work; or the acquisition, analysis, or interpretation of data for the work; drafting the work or revising it critically for important intellectual content; agreement to be accountable for all aspects of the work in ensuring that questions related to the accuracy or integrity of any part of the work are appropriately investigated and resolved; final approval of the version to be published

AL Substantial contributions to the conception or design of the work; or the acquisition, analysis, or interpretation of data for the work; drafting the work or revising it critically for important intellectual content; agreement to be accountable for all aspects of the work in ensuring that questions related to the accuracy or integrity of any part of the work are appropriately investigated and resolved; final approval of the version to be published

CA Substantial contributions to the conception of the work; agreement to be accountable for all aspects of the work in ensuring that questions related to the accuracy or integrity of any part of the work are appropriately investigated and resolved; final approval of the version to be published

IS Substantial contributions to the conception of the work; agreement to be accountable for all aspects of the work in ensuring that questions related to the accuracy or integrity of any part of the work are appropriately investigated and resolved; final approval of the version to be published

BS Substantial contributions to the conception of the work; agreement to be accountable for all aspects of the work in ensuring that questions related to the accuracy or integrity of any part of the work are appropriately investigated and resolved; final approval of the version to be published

AR Substantial contributions to the conception of the work; agreement to be accountable for all aspects of the work in ensuring that questions related to the accuracy or integrity of any part of the work are appropriately investigated and resolved; final approval of the version to be published

KZ Substantial contributions to the conception of the work; agreement to be accountable for all aspects of the work in ensuring that questions related to the accuracy or integrity of any part of the work are appropriately investigated and resolved; final approval of the version to be published

AZ Substantial contributions to the conception of the work; agreement to be accountable for all aspects of the work in ensuring that questions related to the accuracy or integrity of any part of the work are appropriately investigated and resolved; final approval of the version to be published

AW Substantial contributions to the conception of the work; agreement to be accountable for all aspects of the work in ensuring that questions related to the accuracy or integrity of any part of the work are appropriately investigated and resolved; final approval of the version to be published

Article receive on Friday, September 25, 2020

Article accepted on Sunday, September 27, 2020