Robotics and computer-integrated manufacturing

This paper provides a review of research into using Augmented Reality (AR) and Mixed Reality(MR) for remote collaboration on physical tasks. AR/MR-based remote collaboration on physical tasks has recently become more prominent in academic research and engineering applications. It has great potential in many fields, such as real-time remote medical consultation, education, training, maintenance, remote assistance in engineering, and other remote collaborative tasks. However, to the best of our knowledge there has not been any comprehensive review of research in AR/MR remote collaboration on physical tasks. Therefore, this paper presents a comprehensive survey of research between 2000 and 2018 in this domain. We collected 215 papers, more than 80% of which were published between 2010 and 2018, and all relevant works are discussed at length. Then we elaborate on the review from typical architectures, applications (e.g., industry, telemedicine, architecture, teleducation and others), and empathic computing. Next, we made an in-depth review of the papers from seven aspects: (1) collection and classification research, (2) using 3D scene reconstruction environments and live panorama, (3) periodicals and conducting research, (4) local and remote user interfaces, (5) features of user interfaces commonly used, (6) architecture and sharing non-verbal cues, (7) applications and toolkits. We find that most papers (160 articles, 74.4%) are published in conferences, using co-located collaboration to emulate remote collaboration is adopted by more than half (126, 58.6%) of the reviewed papers, the shared non-verbal cues can be mainly classified into five types (Virtual Replicas or Physical Proxy(VRP), AR Annotations or a Cursor Pointer(ARACP), avatar, gesture, and gaze), the local/remote interface is mainly divided into four categories (Head-Mounted Displays(HMD), Spatial Augmented Reality(SAR), Windows-Icon-Menu-Pointer(WIMP) and Hand-Held Displays(HHD)). From this, we can draw ten conclusions. Following this we report on issues for future works. The paper also provides an overall academic roadmap and useful insight into the state-of-the-art of AR/MR remote collaboration on physical tasks. This work will be useful for current and future researchers who are interested in collaborative AR/MR systems.

AR/MR Remote Collaboration on Physical Tasks: A Review

Purpose – The integration of e‐business and supply chain enables seamless information flow from suppliers to customer service network via the internet. It also enables better‐coordinated materials flow from customer order to production, storage, distribution and delivery. The purpose of this paper is to describe the work that leads to the realisation of a hierarchical model for e‐supply chain coordination and optimisation.Design/methodology/approach – The model is based on an e‐business information flow network in order to respond rapidly to the dynamics of e‐supply chain and market. It can be used to realize management level strategies, and facilitate the planning and control of detailed operation schedules of supply chain units in an e‐supply chain environment. Three main modules are discussed. They are routing and sequence optimiser (RSO) with the aid of a GA and TS‐based multiple population search strategy (MPSS); supply chain virtual clustering (SCVC) based on fuzzy virtual clustering; and supply cha...

A hierarchical model for e‐supply chain coordination and optimisation

A new kind of Computer-Aided Design (CAD) system is proposed to support the integration and collaboration in Concurrent Engineering (CE). The kernel of the system is the Co-operative Design Modeller (CoDeMo), which supports the multiple-views knowledge integration in the product definition. The enhancement of CoDeMo and CAx systems interoperability is required for achieving a consistent design support environment. This paper mainly deals with CoDeMo interoperability capabilities based on STEP AP203 Edition 2 standard. The aim is to show the benefit and efficiency of STEP-based application in the integration approach of CoDeMo and CAx systems. The architecture, development and application of the STEP pre-processor are described, respectively. A case study is given to illustrate the translation process of product data and to demonstrate the interest of the STEP translator.

Beyond geometric CAD system: implementation of STEP translator for multiple-views product modeller

The purpose of the study is to explore the effectiveness of reverse engineering pedagogy (REP) and forward project‐based pedagogy (FPP) in K‐12 robotics education. A two‐stage study was conducted in two secondary schools, involving a total of 169 students. Based on the experience of the pilot study (Study 1), we refined the REP and examined its effectiveness through a quasi‐experimental design in the formal study (Study 2), which included four teaching models: the Deconstruction Recovery Model, Troubleshooting Model, Element Minitrim Model, and Structural Innovation Model. Results indicated that students in the REP group performed significantly better and perceived a higher degree of compatibility and creative self‐efficacy than those in the FPP group, which is consistent with the final robotics product evaluation. However, no significant difference was found in the learning attitude towards the course. The research findings highlight the value of REP in robotics education, especially in cultivating creativity and enhance learning performance, however, it needs reasonable planning and design.

Investigating the effect of reverse engineering pedagogy in K‐12 robotics education

Production of high-quality products with lower cost and shorter time-to-market is an important challenge in the face of increased global competition, and reverse engineering plays an important role in accelerating product and process development. With the advent of new technologies such as network, multimedia and product data exchange standard STEP (STandard for Exchange of Product model data), there are many advantages to adopt these technologies to enhance the competitiveness of an enterprise. In this paper, a product information recording module for reverse engineering is developed to enhance the performance of product development. A STEP development tool, ST-Developer, and Visual C++ were used to develop this module, which can be used to record key information expeditiously during a collaborative process, and can also be used for further exchange of information, or as the basis for manufacturability evaluation. In this paper, the developed STEP-based information recording system is further integrated with the conventional Computer Supported Cooperative Work methods such as videoconferencing and application-sharing to form a remote collaborative reverse engineering system, which can provides a new strategy for an enterprise to speed up the product development cycle, reducing production cost, as well as sharing knowledge and experience.

/pdf/step-based-product-modeling-system-for-remote-collaborative-cxt84sqqeh.pdf

Y. C. Kao

Papers

STEP-based product modeling system for remote collaborative reverse engineering