Medical augmented reality and virtual reality

Augmented reality (AR) or virtual reality is used in many fields, including medicine, education,manufacturing, and entertainment. With technical advances in optics, computer systems, andsurgical instruments, AR applications to medicine are being vigorously researched. In particular,as surgeries using laparoscopy, endoscopy, or catheterized intervention have increased,AR plays an important role in many medical applications. AR is defined as a technique to combinethe real world and virtual objects, which are digital content artificially generated by a computer.As another aspect of AR is the registration between the real world and virtual objects, itaims at an accurate estimation of the three-dimensional (3D) position and orientation of virtualobjects related to the real world. Essentially, AR can allow users to see 3D virtual objects superimposedupon the real world. With the help of AR, a surgeon can view invisible organs duringthe surgery and improve the accuracy and safety of treatment procedures. After a brief descriptionof the technical issues of medical AR, its applications will be introduced in this article.