Book Chapter•
MARE: Mobile Augmented Reality BasedExperiments in Science, Technology and Engineering
23 Dec 2015-pp 209-227
TL;DR: This chapter introduces mobile augmented reality (semi-immersive 3D virtualreality) as a vehicle for the delivery of practical laboratory experiments in science, technology and engineering.
Abstract: The average learner today, being quite exposed to information and communication technologytools, is less inclined to read books or manuals and prefers to carry out most of thecommunications on-line using new/modern electronic devices or gadgets. The traditionalteaching styles built around using only face-to-face classroom based lessons no longer suit thelearning styles of the average learner; introducing multimedia or other on-line content intoteaching results in improved performance by the learners. Blended e-learning or other on-lineteaching strategies tend to focus on the delivery of theoretical material; however thepedagogy/training of engineers, technologists and scientists involves a strong hands-onpractical/laboratory training component as they are expected to create new things/technologiesand not just repeat what previous generations did. The benefits of this hands-on or practicalcomponent include stimulating deep and reflective learning, thereby improving the creativeproblem solving capabilities while also providing exposure/insight into real world problemsand challenges. This chapter introduces mobile augmented reality (semi-immersive 3D virtualreality) as a vehicle for the delivery of practical laboratory experiments in science, technologyand engineering. Mobile augmented reality delivers multi-sensorial interactions with acomputing platform over commodity hardware technology that is already widely accepted.Two illustrated examples in the fields of micro-electronics and communications engineeringare presented to highlight the innovative features such as the ability to closely replicate anexisting laboratory based hands-on experiment and use of the mobile augmented realityexperiment as a blended learning aid for laboratory experiments or stand-alone off-lineexperiment for distance learning.
Citations
More filters
16 Sep 2019
TL;DR: This paper investigates and presents the cost effective application of augmented reality (AR) as a mixed reality technology via or to mobile devices such as head-mounted devices, smart phones and tablets.
Abstract: The purpose of this paper is to report on developments and applications of mixed reality cubicles and their impacts on learning in higher education. This paper investigates and presents the cost effective application of augmented reality (AR) as a mixed reality technology via or to mobile devices such as head-mounted devices, smart phones and tablets. Discuss the development of mixed reality applications for mobile (smartphones and tablets) devices leading up to the implementation of a mixed reality cubicle for immersive three dimensional (3D) visualizations.,The approach adopted was to limit the considerations to the application of AR via mobile platforms including head-mounted devices with focus on smartphones and tablets, which contain basic feedback–to-user channels such as speakers and display screens. An AR visualization cubicle was jointly developed and applied by three collaborating institutions. The markers, acting as placeholders acts as identifiable reference points for objects being inserted in the mixed reality world. Hundreds of participants comprising academics and students from seven different countries took part in the studies and gave feedback on impact on their learning experience.,Results from current study show less than 30 percent had used mixed reality environments. This is lower than expected. About 70 percent of participants were first time users of mixed reality technologies. This indicates a relatively low use of mixed reality technologies in education. This is consistent with research findings reported that educational use and research on AR is still not common despite their categorization as emerging technologies with great promise for educational use.,Current research has focused mainly on cubicles which provides immersive experience if used with head-mounted devices (goggles and smartphones), that are limited by their display/screen sizes. There are some issues with limited battery lifetime for energy to function, hence the need to use rechargeable batteries. Also, the standard dimension of cubicles does not allow for group visualizations. The current cubicle has limitations associated with complex gestures and movements involving two hands, as one hand are currently needed for holding the mobile phone.,The use of mixed reality cubicles would allow and enhance information visualization for big data in real time and without restrictions. There is potential to have this extended for use in exploring and studying otherwise inaccessible locations such as sea beds and underground caves. Social implications – Following on from this study further work could be done to developing and application of mixed reality cubicles that would impact businesses, health and entertainment.,The originality of this paper lies in the unique approach used in the study of developments and applications of mixed reality cubicles and their impacts on learning. The diverse composition in nature and location of participants drawn from many countries comprising of both tutors and students adds value to the present study. The value of this research include amongst others, the useful results obtained and scope for developments in the future.
10 citations
Cites background from "MARE: Mobile Augmented Reality Base..."
...In engineering, (Andujar et. al., 2011) discussed the augmentation of remote laboratories, while (Onime et. al., 2014) and (Onime et al, 2015) presented laboratory experiments based on mixed reality tools/technologies....
[...]
14 Dec 2016
TL;DR: The application of Augmented Reality (AR) as a mixed reality technology via (or to) mobile devices such as head-mounted devices, smart-phones and tablets and the results of a study on the familiarity with both VR and AR technologies among students from two institutions of tertiary education are presented.
Abstract: In Cave Automatic Virtual Environments (CAVEs), a computer generated environment is projected all around a user to fully immerse or eliminate all reference to the real world. Typically, Virtual Reality (VR) CAVEs also track and respond to the user's physical orientation, movements and gestures. Mixed reality environments instead focus on combining real world objects with computer generated ones. In this paper, we focus on the application of Augmented Reality (AR) as a mixed reality technology via (or to) mobile devices such as head-mounted devices, smart-phones and tablets. We present the development of mixed reality applications for mobile (smart-phone and tablet) devices leading up to the implementation of an mixed reality (AR) cubicle for immersive Three Dimensional (3D) visualizations. We also present the results of a study on the familiarity with both VR and AR technologies among students from two institutions of tertiary education. The paper concludes with a discussion of planned deployment and upgrade of mixed reality cubicles using mobile VR equipment.
9 citations
Cites background from "MARE: Mobile Augmented Reality Base..."
...As shown, several distinct and complex software processing steps/stages are required in AR applications, these include managing hardware-sensors such as a hardware camera device (required for capturing a view of the real-world), image processing/detection (required for recognising markers), image rendering/texturizing (required for introducing virtual objects into the view of the real world) and a real-time event-driven programming model, which is required for managing user input and interactions between real-objects, virtual-objects and end-user [23]....
[...]
...The Android SDK already contains some limited image processing functionality that is used exclusively for Face Detection, but this is not usable for AR as it lacks the ability to register arbitrary images/patterns for detection [23], however, there are several libraries or engines that provide 3D capabilities on Android platforms....
[...]
...While other works including [22] and [23] show the use of mobile AR in education....
[...]
...Technical flowchart for video see-through augmented reality on mobile devices [23]...
[...]
01 Jan 2016
TL;DR: The 10 revised full papers in this volume present the elaborated outcome of the initial position papers capturing the results oft the roadmapping discussions in the workshop at which comments of several external reviewers for these full publications were also integrated.
Abstract: This book constitutes the thoroughly refereed post-workshop proceedings of the AVI 2016 Workshop on Road Mapping Infrastructures for Advanced Visual Interfaces Supporting Big Data Applications in Virtual Research Environments, AVI-BDA 2016, held in Bari, Italy, in June 2016. The 10 revised full papers in this volume present the elaborated outcome of the initial position papers capturing the results oft the roadmapping discussions in the workshop at which comments of several external reviewers for these full publications were also integrated.
6 citations
10 Nov 2020
TL;DR: A reclassification of markers for mixed reality environments that is also applicable to the use of markers in robot navigation systems and 3D modelling is presented and is capable of improving the definitions of existing simple marker and markerless mixed Reality environments as well as supporting more complex features within mixedreality environments.
Abstract: This paper presents a reclassification of markers for mixed reality environments that is also applicable to the use of markers in robot navigation systems and 3D modelling. In the case of Augmented Reality (AR) mixed reality environments, markers are used to integrate computer generated (virtual) objects into a predominantly real world, while in Augmented Virtuality (AV) mixed reality environments, the goal is to integrate real objects into a predominantly virtual (computer generated) world. Apart from AR/AV classifications, mixed reality environments have also been classified by reality; output technology/display devices; immersiveness as well as by visibility of markers.,The approach adopted consists of presenting six existing classifications of mixed reality environments and then extending them to define new categories of abstract, blended, virtual augmented, active and smart markers. This is supported with results/examples taken from the joint Mixed Augmented and Virtual Reality Laboratory (MAVRLAB) of the Ulster University, Belfast, Northern Ireland; the Abdus Salam International Centre for Theoretical Physics (ICTP), Trieste, Italy and Santasco SrL, Regio Emilia/Milan, Italy.,Existing classification of markers and mixed reality environments are mainly binary in nature and do not adequately capture the contextual relationship between markers and their use and application. The reclassification of markers into abstract, blended and virtual categories captures the context for simple use and applications while the categories of augmented, active and smart markers captures the relationship for enhanced or more complex use of markers. The new classifications are capable of improving the definitions of existing simple marker and markerless mixed reality environments as well as supporting more complex features within mixed reality environments such as co-location of objects, advanced interactivity, personalised user experience.,It is thought that applications and devices in mixed reality environments when properly developed and deployed enhances the real environment by making invisible information visible to the user. The current work only marginally covers the use of internet of things (IoT) devices in mixed reality environments as well as potential implications for robot navigation systems and 3D modelling.,The use of these reclassifications enables researchers, developers and users of mixed reality environments to select and make informed decisions on best tools and environment for their respective application, while conveying information with additional clarity and accuracy. The development and application of more complex markers would contribute in no small measure to attaining greater advancements in extending current knowledge and developing applications to positively impact entertainment, business and health while minimizing costs and maximizing benefits.,The originality of this paper lies in the approach adopted in reclassifying markers. This is supported with results and work carried out at the MAV Reality Laboratory of Ulster University, Belfast–UK, the Abdus Salam International Centre for Theoretical Physics (ICTP), Trieste-Italy and Santasco SrL, Regio Emilia, Milan–Italy. The value of present research lies in the definitions of new categories as well as the discussions of how they improve mixed reality environments and application especially in the health and education sectors.
3 citations
References
More filters
16 Sep 2019
TL;DR: This paper investigates and presents the cost effective application of augmented reality (AR) as a mixed reality technology via or to mobile devices such as head-mounted devices, smart phones and tablets.
Abstract: The purpose of this paper is to report on developments and applications of mixed reality cubicles and their impacts on learning in higher education. This paper investigates and presents the cost effective application of augmented reality (AR) as a mixed reality technology via or to mobile devices such as head-mounted devices, smart phones and tablets. Discuss the development of mixed reality applications for mobile (smartphones and tablets) devices leading up to the implementation of a mixed reality cubicle for immersive three dimensional (3D) visualizations.,The approach adopted was to limit the considerations to the application of AR via mobile platforms including head-mounted devices with focus on smartphones and tablets, which contain basic feedback–to-user channels such as speakers and display screens. An AR visualization cubicle was jointly developed and applied by three collaborating institutions. The markers, acting as placeholders acts as identifiable reference points for objects being inserted in the mixed reality world. Hundreds of participants comprising academics and students from seven different countries took part in the studies and gave feedback on impact on their learning experience.,Results from current study show less than 30 percent had used mixed reality environments. This is lower than expected. About 70 percent of participants were first time users of mixed reality technologies. This indicates a relatively low use of mixed reality technologies in education. This is consistent with research findings reported that educational use and research on AR is still not common despite their categorization as emerging technologies with great promise for educational use.,Current research has focused mainly on cubicles which provides immersive experience if used with head-mounted devices (goggles and smartphones), that are limited by their display/screen sizes. There are some issues with limited battery lifetime for energy to function, hence the need to use rechargeable batteries. Also, the standard dimension of cubicles does not allow for group visualizations. The current cubicle has limitations associated with complex gestures and movements involving two hands, as one hand are currently needed for holding the mobile phone.,The use of mixed reality cubicles would allow and enhance information visualization for big data in real time and without restrictions. There is potential to have this extended for use in exploring and studying otherwise inaccessible locations such as sea beds and underground caves. Social implications – Following on from this study further work could be done to developing and application of mixed reality cubicles that would impact businesses, health and entertainment.,The originality of this paper lies in the unique approach used in the study of developments and applications of mixed reality cubicles and their impacts on learning. The diverse composition in nature and location of participants drawn from many countries comprising of both tutors and students adds value to the present study. The value of this research include amongst others, the useful results obtained and scope for developments in the future.
10 citations
14 Dec 2016
TL;DR: The application of Augmented Reality (AR) as a mixed reality technology via (or to) mobile devices such as head-mounted devices, smart-phones and tablets and the results of a study on the familiarity with both VR and AR technologies among students from two institutions of tertiary education are presented.
Abstract: In Cave Automatic Virtual Environments (CAVEs), a computer generated environment is projected all around a user to fully immerse or eliminate all reference to the real world. Typically, Virtual Reality (VR) CAVEs also track and respond to the user's physical orientation, movements and gestures. Mixed reality environments instead focus on combining real world objects with computer generated ones. In this paper, we focus on the application of Augmented Reality (AR) as a mixed reality technology via (or to) mobile devices such as head-mounted devices, smart-phones and tablets. We present the development of mixed reality applications for mobile (smart-phone and tablet) devices leading up to the implementation of an mixed reality (AR) cubicle for immersive Three Dimensional (3D) visualizations. We also present the results of a study on the familiarity with both VR and AR technologies among students from two institutions of tertiary education. The paper concludes with a discussion of planned deployment and upgrade of mixed reality cubicles using mobile VR equipment.
9 citations
01 Jan 2016
TL;DR: The 10 revised full papers in this volume present the elaborated outcome of the initial position papers capturing the results oft the roadmapping discussions in the workshop at which comments of several external reviewers for these full publications were also integrated.
Abstract: This book constitutes the thoroughly refereed post-workshop proceedings of the AVI 2016 Workshop on Road Mapping Infrastructures for Advanced Visual Interfaces Supporting Big Data Applications in Virtual Research Environments, AVI-BDA 2016, held in Bari, Italy, in June 2016. The 10 revised full papers in this volume present the elaborated outcome of the initial position papers capturing the results oft the roadmapping discussions in the workshop at which comments of several external reviewers for these full publications were also integrated.
6 citations
10 Nov 2020
TL;DR: A reclassification of markers for mixed reality environments that is also applicable to the use of markers in robot navigation systems and 3D modelling is presented and is capable of improving the definitions of existing simple marker and markerless mixed Reality environments as well as supporting more complex features within mixedreality environments.
Abstract: This paper presents a reclassification of markers for mixed reality environments that is also applicable to the use of markers in robot navigation systems and 3D modelling. In the case of Augmented Reality (AR) mixed reality environments, markers are used to integrate computer generated (virtual) objects into a predominantly real world, while in Augmented Virtuality (AV) mixed reality environments, the goal is to integrate real objects into a predominantly virtual (computer generated) world. Apart from AR/AV classifications, mixed reality environments have also been classified by reality; output technology/display devices; immersiveness as well as by visibility of markers.,The approach adopted consists of presenting six existing classifications of mixed reality environments and then extending them to define new categories of abstract, blended, virtual augmented, active and smart markers. This is supported with results/examples taken from the joint Mixed Augmented and Virtual Reality Laboratory (MAVRLAB) of the Ulster University, Belfast, Northern Ireland; the Abdus Salam International Centre for Theoretical Physics (ICTP), Trieste, Italy and Santasco SrL, Regio Emilia/Milan, Italy.,Existing classification of markers and mixed reality environments are mainly binary in nature and do not adequately capture the contextual relationship between markers and their use and application. The reclassification of markers into abstract, blended and virtual categories captures the context for simple use and applications while the categories of augmented, active and smart markers captures the relationship for enhanced or more complex use of markers. The new classifications are capable of improving the definitions of existing simple marker and markerless mixed reality environments as well as supporting more complex features within mixed reality environments such as co-location of objects, advanced interactivity, personalised user experience.,It is thought that applications and devices in mixed reality environments when properly developed and deployed enhances the real environment by making invisible information visible to the user. The current work only marginally covers the use of internet of things (IoT) devices in mixed reality environments as well as potential implications for robot navigation systems and 3D modelling.,The use of these reclassifications enables researchers, developers and users of mixed reality environments to select and make informed decisions on best tools and environment for their respective application, while conveying information with additional clarity and accuracy. The development and application of more complex markers would contribute in no small measure to attaining greater advancements in extending current knowledge and developing applications to positively impact entertainment, business and health while minimizing costs and maximizing benefits.,The originality of this paper lies in the approach adopted in reclassifying markers. This is supported with results and work carried out at the MAV Reality Laboratory of Ulster University, Belfast–UK, the Abdus Salam International Centre for Theoretical Physics (ICTP), Trieste-Italy and Santasco SrL, Regio Emilia, Milan–Italy. The value of present research lies in the definitions of new categories as well as the discussions of how they improve mixed reality environments and application especially in the health and education sectors.
3 citations