Kalman filters have received much attention with the increasing demands for robotic automation. This paper briefly surveys the recent developments for robot vision. Among many factors that affect the performance of a robotic system, Kalman filters have made great contributions to vision perception. Kalman filters solve uncertainties in robot localization, navigation, following, tracking, motion control, estimation and prediction, visual servoing and manipulation, and structure reconstruction from a sequence of images. In the 50th anniversary, we have noticed that more than 20 kinds of Kalman filters have been developed so far. These include extended Kalman filters and unscented Kalman filters. In the last 30 years, about 800 publications have reported the capability of these filters in solving robot vision problems. Such problems encompass a rather wide application area, such as object modeling, robot control, target tracking, surveillance, search, recognition, and assembly, as well as robotic manipulation, localization, mapping, navigation, and exploration. These reports are summarized in this review to enable easy referral to suitable methods for practical solutions. Representative contributions and future research trends are also addressed in an abstract level.

Kalman Filter for Robot Vision: A Survey

The use of laparoscopic and robotic procedures has increased in general surgery. Minimally invasive robotic surgery has made tremendous progress in a relatively short period of time, realizing improvements for both the patient and surgeon. This has led to an increase in the use and development of robotic devices and platforms for general surgery. The purpose of this review is to explore current and emerging surgical robotic technologies in a growing and dynamic environment of research and development. This review explores medical and surgical robotic endoscopic surgery and peripheral technologies currently available or in development. The devices discussed here are specific to general surgery, including laparoscopy, colonoscopy, esophagogastroduodenoscopy, and thoracoscopy. Benefits and limitations of each technology were identified and applicable future directions were described. A number of FDA-approved devices and platforms for robotic surgery were reviewed, including the da Vinci Surgical System, Sensei X Robotic Catheter System, FreeHand 1.2, invendoscopy E200 system, Flex® Robotic System, Senhance, ARES, the Single-Port Instrument Delivery Extended Research (SPIDER), and the NeoGuide Colonoscope. Additionally, platforms were reviewed which have not yet obtained FDA approval including MiroSurge, ViaCath System, SPORT™ Surgical System, SurgiBot, Versius Robotic System, Master and Slave Transluminal Endoscopic Robot, Verb Surgical, Miniature In Vivo Robot, and the Einstein Surgical Robot. The use and demand for robotic medical and surgical platforms is increasing and new technologies are continually being developed. New technologies are increasingly implemented to improve on the capabilities of previously established systems. Future studies are needed to further evaluate the strengths and weaknesses of each robotic surgical device and platform in the operating suite.

Review of emerging surgical robotic technology

Over the past two decades, synergistic innovations in imaging technology have resulted in a revolution in which a range of biomedical applications are now benefiting from fluorescence imaging. Specifically, advances in fluorophore chemistry and imaging hardware, and the identification of targetable biomarkers have now positioned intraoperative fluorescence as a highly specific real-time detection modality for surgeons in oncology. In particular, the deeper tissue penetration and limited autofluorescence of near-infrared (NIR) fluorescence imaging improves the translational potential of this modality over visible-light fluorescence imaging. Rapid developments in fluorophores with improved characteristics, detection instrumentation, and targeting strategies led to the clinical testing in the early 2010s of the first targeted NIR fluorophores for intraoperative cancer detection. The foundations for the advances that underline this technology continue to be nurtured by the multidisciplinary collaboration of chemists, biologists, engineers, and clinicians. In this Review, we highlight the latest developments in NIR fluorophores, cancer-targeting strategies, and detection instrumentation for intraoperative cancer detection, and consider the unique challenges associated with their effective application in clinical settings.

/pdf/beyond-the-margins-real-time-detection-of-cancer-using-3lel13xqh8.pdf

Beyond the margins: real-time detection of cancer using targeted fluorophores.

Background
Autonomous control of surgical robotic platforms may offer enhancements such as higher precision, intelligent manoeuvres, tissue-damage avoidance, etc. Autonomous robotic systems in surgery are largely at the experimental level. However, they have also reached clinical application.

Methods
A literature review pertaining to commercial medical systems which incorporate autonomous and semi-autonomous features, as well as experimental work involving automation of various surgical procedures, is presented. Results are drawn from major databases, excluding papers not experimentally implemented on real robots.

Results
Our search yielded several experimental and clinical applications, describing progress in autonomous surgical manoeuvres, ultrasound guidance, optical coherence tomography guidance, cochlear implantation, motion compensation, orthopaedic, neurological and radiosurgery robots.

Conclusion
Autonomous and semi-autonomous systems are beginning to emerge in various interventions, automating important steps of the operation. These systems are expected to become standard modality and revolutionize the face of surgery. Copyright © 2011 John Wiley & Sons, Ltd.

Evolution of autonomous and semi-autonomous robotic surgical systems: a review of the literature

Research on surgical robotics demands systems for evaluating scientific approaches. Such systems can be divided into dedicated and versatile systems. Dedicated systems are designed for a single surgical task or technique, whereas versatile systems are designed to be expandable and useful in multiple surgical applications. Versatile systems are often based on industrial robots, though, and because of this, are hardly suitable for close contact with humans. To achieve a high degree of versatility the Miro robotic surgery platform (MRSP) consists of versatile components, dedicated front–ends towards surgery and configurable interfaces for the surgeon. This paper presents MiroSurge, a configuration of the MRSP that allows for bimanual endoscopic telesurgery with force feedback. While the components of the MiroSurge system are shown to fulfil the rigid design requirements for robotic telesurgery with force feedback, the system remains versatile, which is supposed to be a key issue for the further development and optimisation.

https://elib.dlr.de/76868/1/IJCARS_2009_JournalPaper_Hagn_CameraReady.pdf

DLR MiroSurge: a versatile system for research in endoscopic telesurgery.

This paper presents the design and control of the sigma.7 haptic device and the new surgical console of the MiroSurge robotic system. The console and the haptic devices are designed with respect to requirements in minimally invasive robotic surgery. Dedicated left and right handed devices are integrated in an operator console in an ergonomic configuration. The height of the whole console is adjustable, allowing the surgeon seated and standed operation. Each of the devices is fully actuated in seven degrees of freedom (DoF). A parallel mechanism with 3 DoF actuates the translational motion and an attached wrist with 3 intersecting axis drives the rotations of the grasping unit. This advantageous design leads to inherently decoupled kinematics and dynamics. Cartesian forces are 20 N within the translational workspace, which is a sphere of about 120 mm diameter for each device. The rotational wrist of the device covers the whole workspace of the human hand and provides maximum torques of about 0.4 Nm. The grasping unit can display forces up to 8 N. An integrated force/torque sensor is used to increase the transparency of the devices by reducing inertia and friction. It is theoretically shown that the non-linear closed loop system behaves like a passive system and experimental results validate the approach. The sigma.7 haptic devices are designed by Force Dimension in cooperation with the German Aerospace Center (DLR). DLR designed the surgical console and integrated the haptic devices in the MiroSurge system.

/pdf/the-sigma-7-haptic-interface-for-mirosurge-a-new-bi-manual-20sd06o5s5.pdf

The sigma.7 haptic interface for MiroSurge: A new bi-manual surgical console

The requirements for an ideal telemanipulator (i.e., robot and surgical instrument) are derived. An overview on telemanipulators reported in literature is given. The new robot for telepresence surgery developed by German Aerospace Center (DLR) is presented in detail in the "DLR Robot" section. Surgical instruments equipped with miniaturized force-torque sensors and additional DoF at the distal end, also developed by DLR, are described in the "DLR Instruments" section. The last section concludes this article and gives directions for further research.

Telemanipulator for remote minimally invasive surgery

This video presents the in-house developed DLR MiroSurge robotic system for surgery. As shown, the system is suitable for both minimally invasive and open surgery. Essential part of the system is the MIRO robot: The soft robotics feature enables intuitive interaction with the robot.

/pdf/the-dlr-mirosurge-a-robotic-system-for-surgery-4azvoo37mr.pdf

The DLR MiroSurge - A robotic system for surgery

This paper introduces the planning and control software of a teleoperation system for research in minimally invasive robotic surgery. It addresses the problem of how to organize a complex system with 41 degrees of freedom as a flexible configurable platform. Robot setup planning, force feedback control and nullspace handling with three robotic arms are considered. The planning software is separated into sequentially executed planning and registration procedures. An optimal setup is first planned in virtual reality and then adapted to variations in the operating room. The real time control system is structured in hierarchical layers. Functions are arranged in the layers with respect to their domain and maximum response time. The design is flexible and expandable while performance is maintained. Structure, functionality and implementation of planning and control are described. The prototypic robotic system provides intuitive bimanual bilateral teleoperation within the planned working space.

/pdf/planning-and-control-of-a-teleoperation-system-for-research-1846oi1jf6.pdf

Andreas Tobergte

Papers

DLR MiroSurge: a versatile system for research in endoscopic telesurgery.

The sigma.7 haptic interface for MiroSurge: A new bi-manual surgical console

Telemanipulator for remote minimally invasive surgery

The DLR MiroSurge - A robotic system for surgery

Planning and control of a teleoperation system for research in minimally invasive robotic surgery