Imaging Sci Dent.  2014 Jun;44(2):155-160. 10.5624/isd.2014.44.2.155.

Use of a gesture user interface as a touchless image navigation system in dental surgery: Case series report

• Rosa GM
• Elizondo M

• KMID: 1799598
• DOI: http://doi.org/10.5624/isd.2014.44.2.155

Abstract

PURPOSE
The purposes of this study were to develop a workstation computer that allowed intraoperative touchless control of diagnostic and surgical images by a surgeon, and to report the preliminary experience with the use of the system in a series of cases in which dental surgery was performed.
MATERIALS AND METHODS
A custom workstation with a new motion sensing input device (Leap Motion) was set up in order to use a natural user interface (NUI) to manipulate the imaging software by hand gestures. The system allowed intraoperative touchless control of the surgical images.
RESULTS
For the first time in the literature, an NUI system was used for a pilot study during 11 dental surgery procedures including tooth extractions, dental implant placements, and guided bone regeneration. No complications were reported. The system performed very well and was very useful.
CONCLUSION
The proposed system fulfilled the objective of providing touchless access and control of the system of images and a three-dimensional surgical plan, thus allowing the maintenance of sterile conditions. The interaction between surgical staff, under sterile conditions, and computer equipment has been a key issue. The solution with an NUI with touchless control of the images seems to be closer to an ideal. The cost of the sensor system is quite low; this could facilitate its incorporation into the practice of routine dental surgery. This technology has enormous potential in dental surgery and other healthcare specialties.

Keyword

Medical Informatics Computing; User-Computer Interface; Diagnostic Imaging; Surgery, Oral

MeSH Terms

Bone Regeneration
Delivery of Health Care
Dental Implants
Diagnostic Imaging
Gestures*
Hand
Medical Informatics Computing
Pilot Projects
Surgery, Oral
Tooth Extraction
User-Computer Interface
Dental Implants

Figure

• 

  Fig. 1 Schematic diagram shows the custom image workstation set up to use a natural user interface in dental surgery.

• 

  Fig. 2 A. Photograph shows the general view of use of the natural user interface that enables touchless control of the imaging system and helps to maintain the surgical environment during surgery. The system can be controlled with two fingers of one hand (B), or one finger of each of the two hands (C) can be used to control the images by two points (for modification of scale, zooming, or rotation).

Reference

1. Josh B. What is the natural user interface? Deconstructing the NUI [Internet]. Woodbridge: InfoStrat Advanced Technology Group;2010. 03. 01. cited 2013 Oct 4. Available from: http://nui.joshland.org/2010/03/what-is-natural-user-interface-book.html.

2. Strazdins G, Komandur S, Styve A. In : Rekdalsbakken W, Bye RT, Zhang H, editors. Kinect-based systems for maritime operation simulators? Proceedings of 27th European Conference on Modelling and Simulation, ECMS 2013; 2013 May 27-30; Ålesund, Norway. Digitaldruck Pirrot GmbH;2013. p. 205–211.

3. Weichert F, Bachmann D, Rudak B, Fisseler D. Analysis of the accuracy and robustness of the leap motion controller. Sensors (Basel). 2013; 13:6380–6393.

4. Rosa G. First use of Leap Motion during dental implant surgery [Internet]. YouTube.com;cited 2013 Oct 4. Available from: https://www.youtube.com/watch?v=1dc8G5lTVtI.

5. Strickland M, Tremaine J, Brigley G, Law C. Using a depth-sensing infrared camera system to access and manipulate medical imaging from within the sterile operating field. Can J Surg. 2013; 56:E1–E6.

6. Ruppert GC, Reis LO, Amorim PH, de Moraes TF, da Silva JV. Touchless gesture user interface for interactive image visualization in urological surgery. World J Urol. 2012; 30:687–691.

7. Boulos MN, Blanchard BJ, Walker C, Montero J, Tripathy A, Gutierrez-Osuna R. Web GIS in practice X: a Microsoft Kinect natural user interface for Google Earth navigation. Int J Health Geogr. 2011; 10:45.