scispace - formally typeset
Proceedings ArticleDOI

Virtual experiment system for electrician training based on Kinect and Unity3D

Hongjian Liao, +1 more
- pp 2659-2662
Reads0
Chats0
TLDR
Compared with traditional WIMP interaction, Kinect somatosensory interaction is combined with Unity3D so that three-dimensional virtual system with strong immersion can be established.
Abstract
In order to establish low-cost and strongly-immersive desktop virtual experiment system, a solution based on Kinect and Unity3D engine technology was herein proposed, with a view to applying Kinect gesture recognition and triggering more spontaneous human-computer interactions in three-dimensional virtual environment. A kind of algorithm tailored to the detection of concave-convex points of fingers is put forward to identify various gestures and interaction semantics. In the context of Unity3D, Finite-State Machine (FSM) programming was applied in intelligent management for experimental logic tasks. A “Virtual Experiment System for Electrician Training” was designed and put into practice by these methods. The applications of “Lighting Circuit” module prove that these methods can be satisfyingly helpful to complete virtual experimental tasks and improve user experience. Compared with traditional WIMP interaction, Kinect somatosensory interaction is combined with Unity3D so that three-dimensional virtual system with strong immersion can be established.

read more

Citations
More filters
Proceedings ArticleDOI

ROS+unity: An efficient high-fidelity 3D multi-UAV navigation and control simulator in GPS-denied environments

TL;DR: A 3D simulator based on robot operation system (ROS) and a game engine, Unity3D, which can handle real-time multi-UAV navigation and control algorithms, including online processing of a large number of sensor data is developed.
Journal ArticleDOI

ROSUnitySim: Development and experimentation of a real-time simulator for multi-unmanned aerial vehicle local planning

TL;DR: A novel real-time three-dimensional simulation system, ROSUnitySim, for local planning by miniature unmanned aerial vehicles (UAVs) in cluttered environments based on a robot operation system (ROS) and with a different game engine, Unity3D.
Journal ArticleDOI

USE: An integrative suite for temporally-precise psychophysical experiments in virtual environments for human, nonhuman, and artificially intelligent agents

TL;DR: The Unified Suite for Experiments is an integrated set of hardware and software tools for the design and control of behavioral neuroscience experiments that supports both active tasks in immersive 3D environments and static 2D tasks used in more traditional visual experiments.
Book ChapterDOI

CAIAS Simulator: Self-driving Vehicle Simulator for AI Research

TL;DR: This paper presents a simulation environment which includes virtual structures of a low-cost embedded designed car for the autonomous driving test, tracks, obstacles, and environments and options are available to choose flexible sensors, monitor the output and implement any autonomous driving, steering prediction, deep learning and end-to-end learning algorithm.
Journal ArticleDOI

Research on Intelligent Experimental Equipment and Key Algorithms Based on Multimodal Fusion Perception

TL;DR: A multi-modal intelligent interactive virtual experiment platform (MIIVEP), and a kind of dropper with strong perception ability, which has been verified, tested, evaluated and applied in the intelligent virtual experiment system are built.
References
More filters
Book

Beginning Kinect Programming with the Microsoft Kinect SDK

Jarrett Webb, +1 more
TL;DR: Beginning Kinect Programming with the Microsoft Kinect SDK gets you up and running developing Kinect applications for your PC using Microsoft tools and the official SDK, and covers the basics of three-dimensional vision, skeleton tracking, gesture recognition, and audio.
Proceedings ArticleDOI

Research on key technologies base Unity3D game engine

Jingming Xie
TL;DR: A generating NPCs algorithm and a shooting algorithm are respectively presented to show common key technologies in Unity3D.
Proceedings ArticleDOI

E-Learning Systems in Virtual Environment

TL;DR: In this paper the benefits of virtual reality environment using X3D in E-learning applications are demonstrated via implementing two Web enabled virtual environment E- learning systems.
Proceedings ArticleDOI

A recursive algorithm for calculating the relative convex hull

Gisela Klette
TL;DR: In this article, a recursive algorithm for computing the relative convex hull of a simple polygon that is contained in a second simple polyggon B, is proposed, which is a special subject in computational geometry (shortest paths), in image analysis (calculation of features), in robotics, and so forth.