scispace - formally typeset
Search or ask a question

How to do handwriting in VR and AR? 


Best insight from top research papers

Handwriting in VR and AR can be achieved using various input modalities and techniques. One approach is to adapt existing VR frameworks for handwriting and sketching on physically aligned virtual surfaces to AR environments using devices like the Microsoft HoloLens 2 . Another method involves on-air writing in VR, where users can write in the air using brush, near-field raycast, or pointing gesture input modalities . Additionally, a wearable input system has been developed that enables interaction through 3D handwriting recognition, where users can write text in the air using motion sensors attached to the back of the hand . These techniques provide different ways to input handwriting in VR and AR, offering flexibility and options for users to express their ideas and collaborate in immersive virtual environments.

Answers from top 5 papers

More filters
Papers (5)Insight
Open accessProceedings ArticleDOI
Ken Perlin, Zhenyi He, Fengyuan Zhu 
11 Jan 2018
10 Citations
The paper does not provide information on how to do handwriting in VR and AR. The paper discusses the use of Chalktalk VR/AR for creating drawings and simulations in a brainstorming session.
Journal ArticleDOI
01 Jan 2014
86 Citations
The provided paper does not discuss how to do handwriting in VR and AR.
The paper discusses handwriting as a text input method for VR, but it does not provide specific instructions on how to do handwriting in VR or AR.
The paper investigates the factors that affect on-air handwriting in VR, such as input modality, inking trigger method, and canvas geometry. It does not provide a detailed explanation of how to do handwriting in VR and AR.
The paper discusses adapting a VR framework for handwriting and sketching on physically aligned virtual surfaces to AR environments using the Microsoft HoloLens 2. It demonstrates a multimodal input metaphor using hand tracking and voice commands.

Related Questions

How does virtual reality influence children’s descriptive writing?4 answersVirtual reality (VR) positively impacts children's descriptive writing by providing immersive and authentic learning environments. VR technology, such as spherical video-based VR (SVVR), enhances students' writing performance by offering real-world experiences, promoting deep writing skills, and increasing engagement levels. Studies show that VR-supported approaches lead to improved writing achievements, behavioral engagement, and cognitive engagement in students. By utilizing VR in education, students can connect their learning to real-life situations, enhancing their writing self-concept, self-efficacy, and satisfaction, ultimately improving their descriptive writing skills. The use of VR in teaching descriptive writing not only fosters creativity and linguistic expressiveness but also deepens effective reflection, leading to better outcomes in writing tasks.
How much time spends children with handwriting in school?4 answersChildren spend a significant amount of time with handwriting in school. Estimates from the provided abstracts suggest that children spend between 3.4% and 18.0% of the school day performing handwriting activities. Additionally, it is mentioned that approximately 30-60% of the time children spend in school is associated with handwriting. The focus on handwriting appears to have diminished compared to previous years, but it still remains a main occupation for children in the classroom.
How is AI, AR and VR revolutionsing graphic design?5 answersAI, AR, and VR are revolutionizing graphic design by providing new tools and technologies that enhance creativity and productivity. AI, specifically generative adversarial networks, can be used to speculate and generate unseen cityscapes, leading to the creation of immersive VR environments for architectural investigation. AR and VR technologies, such as zSpace-based VR/AR, are being applied in the field of graphic design, allowing designers to effectively penetrate between abstract thinking and entity, thus promoting a change in design thinking. VR systems with friendly GUI and development environments, like the proposed Open Module Development Environment (OMDE), provide graphic designers with efficient creation, modification, and deletion functions, tailored to their specific interface features and functions. The combination of VR and AI can also enhance engineering design tasks, with VR visualizing complex spatial relationships and AI assisting in redesign suggestions. Overall, AI, AR, and VR technologies offer new opportunities for graphic designers to explore, create, and visualize designs in innovative ways.
What is Handwriting skills?4 answersHandwriting skills refer to the abilities required to produce legible and fluent handwriting. These skills involve the integration of sensorimotor, cognitive, perceptual, visual, and sensory systems. Handwriting skills are important for school-aged children and support learning, reading, memory, and self-confidence. There is a correlation between the development of cognitive abilities and handwriting skills in primary school children, although it is weak and non-significant. The developmental process of handwriting involves the development of accuracy in an earlier stage and the ability to control speed in the next stage. Assessing and supporting handwriting skills is crucial, as poor handwriting can affect self-esteem and disguise ability. Traditional pen and paper tests for evaluating grapho-motor skills (GMS) have limitations, and a new digital platform called Grapho-motor Handwriting Evaluation & Exercise (GHEE) has been developed to overcome these limitations.
How many papers are there which discusses handwriting characteristics?5 answersThere are five papers that discuss handwriting characteristics. One paper proposes an application that uses deep neural networks to automate graphological analysis and determine personality traits based on handwriting features. Another paper focuses on preprocessing methods and statistical texture-based features for writer recognition using handwriting. A third paper explores the use of handwriting in criminology and discusses its importance from a physics and technology perspective. The fourth paper discusses handwriting analysis as a means to detect depression and proposes an automated system for analyzing handwriting features. The fifth paper presents an application for personality identification using Devanagari scripts and a machine learning approach.
What are the advanced deep learning techniques for handwriting recognition?5 answersHandwritten recognition techniques have advanced with the use of deep learning. Some of the prominent deep learning techniques for handwriting recognition include Recurrent Neural Networks (RNNs) and Convolutional Neural Networks (CNNs). These techniques have been widely used for interpreting handwritten texts, including doctor's notes. Additionally, attention sequence to sequence (Seq2Seq) based approaches have also been proposed for Handwritten Text Recognition (HTR). These Seq2Seq approaches are more flexible and suitable for the temporal nature of the text, allowing them to focus on the most relevant features of the input. Overall, deep learning techniques such as RNNs, CNNs, and Seq2Seq have shown promise in improving the accuracy and effectiveness of handwriting recognition systems.