In 1997, Azuma published a survey on augmented reality (AR). Our goal is to complement, rather than replace, the original survey by presenting representative examples of the new advances. We refer one to the original survey for descriptions of potential applications (such as medical visualization, maintenance and repair of complex equipment, annotation, and path planning); summaries of AR system characteristics (such as the advantages and disadvantages of optical and video approaches to blending virtual and real, problems in display focus and contrast, and system portability); and an introduction to the crucial problem of registration, including sources of registration error and error-reduction strategies.

https://www.cc.gatech.edu/~blair/papers/ARsurveyCGA.pdf

Recent advances in augmented reality

We are on the verge of ubiquitously adopting Augmented Reality (AR) technologies to enhance our percep- tion and help us see, hear, and feel our environments in new and enriched ways. AR will support us in fields such as education, maintenance, design and reconnaissance, to name but a few. This paper describes the field of AR, including a brief definition and development history, the enabling technologies and their characteristics. It surveys the state of the art by reviewing some recent applications of AR technology as well as some known limitations regarding human factors in the use of AR systems that developers will need to overcome.

/pdf/a-survey-of-augmented-reality-technologies-applications-and-3d9hf1tnc4.pdf

A Survey of Augmented Reality Technologies, Applications and Limitations

A mobile terminal including a body; a touchscreen provided to a front and extending to side of the body and configured to display content; and a controller configured to detect one side of the body comes into contact with one side of an external terminal, display a first area on the touchscreen corresponding to a contact area of the body and the external terminal and a second area including the content, receive an input of moving the content displayed in the second area to the first area, display the content in the first area, and share the content in the first area with the external terminal.

Mobile terminal and method for controlling the same

Deformable image registration is a fundamental task in medical image processing. Among its most important applications, one may cite: 1) multi-modality fusion, where information acquired by different imaging devices or protocols is fused to facilitate diagnosis and treatment planning; 2) longitudinal studies, where temporal structural or anatomical changes are investigated; and 3) population modeling and statistical atlases used to study normal anatomical variability. In this paper, we attempt to give an overview of deformable registration methods, putting emphasis on the most recent advances in the domain. Additional emphasis has been given to techniques applied to medical images. In order to study image registration methods in depth, their main components are identified and studied independently. The most recent techniques are presented in a systematic fashion. The contribution of this paper is to provide an extensive account of registration techniques in a systematic manner.

/pdf/deformable-medical-image-registration-a-survey-2uee59wp1z.pdf

Deformable Medical Image Registration: A Survey

Although Augmented Reality technology was first developed over forty years ago, there has been little survey work giving an overview of recent research in the field. This paper reviews the ten-year development of the work presented at the ISMAR conference and its predecessors with a particular focus on tracking, interaction and display research. It provides a roadmap for future augmented reality research which will be of great value to this relatively young field, and also for helping researchers decide which topics should be explored when they are beginning their own studies in the area.

/pdf/trends-in-augmented-reality-tracking-interaction-and-display-1juiru9a4u.pdf

Trends in augmented reality tracking, interaction and display: A review of ten years of ISMAR

http://campar.in.tum.de/pub/khamene2006portal/khamene2006portal.pdf

Automatic registration of portal images and volumetric CT for patient positioning in radiation therapy

An ultrasound scanning system having an ultrasound transducer (10) which provides ultrasound images (33), a computer to process the ultrasound information and to render the ultrasound image (33) correctly positioned and scaled for display on a flat panel monitor (29) which has a display size similar to the actual physical size of the ultrasound image (33). A half silvered mirror (30) redirects the image (33) so that the user (32) perceives the image (33) as if it occupied the actual physical location of the structures (34, 35) appearing in the image (33). An illumination (22) unit projects onto a patient (13) a line of light (3) that is within the imaging plane (4) projected by the ultrasound transducer (10) into the patient (13). Alternatively a video camera may be used to display a guide line (15) that is coplanar with the imaging plane (4). A mechanical mount (16) combines the transducer (10), monitor (29), mirror (30), and source of illumination (22) or video camera in a correct geometrical alignment.

Method and apparatus for ultrasound guidance of needle biopsies

A fluoroscopy image is registered with data representing a volume, identifying a catheter position relative to a volume represented by preoperative volume data. The catheter position relative to a patient volume represented by data acquired without scanning the catheter is displayed. For example, a 2D fluoroscopy image is registered with respect to coordinates of a 3D preoperative CT or MRI volume by registering the fluoroscopy image and the preoperative volume to 3D ultrasound coordinates.

Registering 2d and 3d data using 3d ultrasound data

An apparatus for pose determination using single camera tracking in a workspace includes a computer programmed for making the pose determination and a tracker camera coupled to the computer for providing a tracking image and for which calibration information is stored. A plurality of marker bodies bears markers adapted for attachment to respective objects to be tracked, the markers exhibiting characteristics for providing respective images of themselves in the tracking image, such that the respective images provide sufficient information in the tracking image for respective pose determination for each of the objects in conjunction with the calibration information.

Apparatus and method for surgical navigation

A system and method for positioning a patient for radiotherapy is provided. The method comprises: acquiring a first x-ray image sequence of a target inside the patient at a first angle; acquiring first respiratory signals of the patient while acquiring the first x-ray image sequence; acquiring a second x-ray image sequence of the target at a second angle; acquiring second respiratory signals of the patient while acquiring the second x-ray image sequence; synchronizing the first and second x-ray image sequences with the first and second respiratory signals to form synchronized first and second x-ray image sequences; identifying the target in the synchronized first and second x-ray image sequences; and determining three-dimensional (3D) positions of the target through time in the synchronized first and second x-ray image sequences.

Frank Sauer

Papers

Automatic registration of portal images and volumetric CT for patient positioning in radiation therapy

Method and apparatus for ultrasound guidance of needle biopsies

Registering 2d and 3d data using 3d ultrasound data

Apparatus and method for surgical navigation

System and method for patient positioning for radiotherapy in the presence of respiratory motion