Merging virtual objects with the real world: seeing ultrasound imagery within the patient

TLDR: Initial results which show “live” ultrasound echography data visualized within a pregnant human subject is described, which may have many other applications, e.g., image guided surgical procedures and on location 3D interactive architecture preview.

Abstract: We describe initial results which show “live” ultrasound echography data visualized within a pregnant human subject. The visualization is achieved by using a small video camera mounted in front of a conventional head-mounted display worn by an observer. The camera’s video images are composite with computer-generated ones that contain one or more 2D ultrasound images properly transformed to the observer’s current viewing position. As the observer walks around the subject. the ultrasound images appear stationary in 3-space within the subject. This kind of enhancement of the observer’s vision may have many other applications, e.g., image guided surgical procedures and on location 3D interactive architecture preview. CR Categories: 1.3.7 [Three-Dimensional Graphics and Realism] Virtual Reality, 1,3.I [Hardware architecture]: Three-dimensional displays, 1.3.6 [Methodology and Techniques]: Interaction techniques, J.3 ILife and Medical Sciences]: Medical information systems. Additional