Abstract Metaverse platforms have become increasingly prevalent for collaboration in virtual environments. Metaverse platforms, as opposed to virtual reality, augmented reality, and mixed reality, expand with enhanced social meanings within virtual worlds. The research object in this study is the chime bells of Marquis Yi of Zeng, one of China's most treasured cultural heritage sites. We aimed to create a metaverse platform for the chime bells of Marquis Yi of Zeng to provide visitors with a highly immersive and interactive experience. First, we collected the materials and data of the chime bells and other exhibits, as well as historical information. Then, the data were processed and integrated for 3D model reconstruction. In addition, we designed the virtual roaming system through which visitors could interact with the exhibits to obtain multimedia information and even knock to ring the chime bells. Finally, we built our system to connect multiple visitors in different geographic locations and encourage them to collaborate and communicate within the virtual space. This platform helps users visualize cultural heritage, simulates real-life tour experiences with intuitive manners of interaction, and motivates visitors’ interest in traditional culture. This research also reveals the potential use of metaverse-related techniques in cultural heritage sectors. 

/pdf/design-and-implementation-of-a-metaverse-platform-for-2tc5nrna.pdf

Design and implementation of a metaverse platform for traditional culture: the chime bells of Marquis Yi of Zeng

ARE-Platform: An Augmented Reality-Based Ergonomic Evaluation Solution for Smart Manufacturing

Visual Simultaneous Localization and Mapping (VSLAM) has been a hot topic of research since the 1990s, first based on traditional computer vision and recognition techniques and later on deep learning models. Although the implementation of VSLAM methods is far from perfect and complete, recent research in deep learning has yielded promising results for applications such as autonomous driving and navigation, service robots, virtual and augmented reality, and pose estimation. The pipeline of traditional VSLAM methods based on classical image processing algorithms consists of six main steps, including initialization (data acquisition), feature extraction, feature matching, pose estimation, map construction, and loop closure. Since 2017, deep learning has changed this approach from individual steps to implementation as a whole. Currently, three ways are developing with varying degrees of integration of deep learning into traditional VSLAM systems: (1) adding auxiliary modules based on deep learning, (2) replacing the original modules of traditional VSLAM with deep learning modules, and (3) replacing the traditional VSLAM system with end-to-end deep neural networks. The first way is the most elaborate and includes multiple algorithms. The other two are in the early stages of development due to complex requirements and criteria. The available datasets with multi-modal data are also of interest. The discussed challenges, advantages, and disadvantages underlie future VSLAM trends, guiding subsequent directions of research.

/pdf/deep-learning-for-visual-slam-the-state-of-the-art-and-3rp9w48u.pdf

Deep Learning for Visual SLAM: The State-of-the-Art and Future Trends

Augmented (AR) and Mixed Reality (MR) technologies are enablers of the Industry 4.0 paradigm and are spreading at high speed in production. Main applications include design, training, and assembly guidance. The latter is a pressing concern, because assembly is the process that accounts for the biggest portion of total cost within production. Teaching and guiding operators to assemble with minimal effort and error rates is pivotal. This work presents the development of a comprehensive MR application for guiding novice operators in following simple assembly instructions. The app follows innovative programming logic and component tracking in a dynamic environment, providing an immersive experience that includes different guidance aids. The application was tested by experienced and novice users, data were drawn from the performed experiments, and a questionnaire was submitted to collect the users’ perception. Results indicate that the MR application was easy to follow and even gave confidence to inexperienced subjects. The guidance support was perceived as useful by the users, though at times invasive in the field of view. Further development effort is required to draw from this work a complete and usable architecture for MR application in assembly, but this research forms the basis to achieve better, more consistent instructions for assembly guidance based on component tracking.

/pdf/dynamic-mixed-reality-assembly-guidance-using-optical-2ngwi454.pdf

Dynamic Mixed Reality Assembly Guidance Using Optical Recognition Methods

Nowadays, mixed reality has improved operational efficiency and enhanced passenger experience in the aviation industry. Integrated with advanced machine learning and artificial intelligence techniques, mixed reality can easily deal with tons of aviation data to support decision-making processes in this industry. The chapter presents the state-of-the-art applications of mixed reality in smart aviation industry. Opportunities and challenges of integrating mixed reality with advanced machine learning and artificial intelligence techniques into the aviation industry are introduced. This chapter focuses on how the integrated mixed reality can improve the quality and reliability of maintenance, operation, piloting, training, and product design in smart aerospace engineering. It also describes autonomous, self-service, and data visualization systems in smart airports to enhance passenger experience. Finally, this chapter discusses airline’s digital-based responses to the COVID-19 crisis. 

Applications of Mixed Reality for Smart Aviation Industry: Opportunities and Challenges

• Role of Augmented Reality in assembly and maintenance/repair is analysed. • Software and hardware elements of AR to aid manufacturing systems are discussed. • Challenges in AR tracking and registration techniques are discussed. • Future trends of AR to aid manufacturing systems are discussed. Manufacturing industries are currently experiencing the fourth revolution with the rapid advancements in immersive technologies for human-machine interaction (HMI) and flexible manufacturing systems (FMS). Product variance is limited due to barriers in the knowledge transfer between the stakeholders that existed in the pre and post-manufacturing phases. Augmented reality (AR) is a promising technology that can offer a high degree of adaptability and independence to support knowledge transfer at the most crucial manufacturing stages such as assembly, repair & maintenance. This article is focused on presenting the state of the art literature on AR technologies in product assembly and disassembly from the Maintenance/Repair perspective. The working of various modules in AR technology on facilitating a user-friendly guiding platform and its applications are discussed with suitable illustrations. The critical difficulties, such as tracking and rendering techniques for estimating human movement and environment experiences are observed to extend the adaptability of the technology. Future research potential, such as enhancing the virtual interface for reality, identifying worker behaviours, and enabling sharing and collaboration between multiple streams in an industrial context are analyzed. 

Anil kumar Inkulu

Papers

Challenges and opportunities on Augmented reality-based guidance in product assembly and maintenance/repair perspective: A state of the art review