It represents a universally applicable attitude and skill set everyone, not just computer scientists, would be eager to learn and use.

/pdf/computational-thinking-ji-suan-lun-de-si-kao-3qvv34ha3s.pdf

Computational Thinking 計算論的思考

Virtual and augmented reality (VR/AR) are expected to revolutionise entertainment, healthcare, communication and the manufacturing industries among many others. Near-eye displays are an enabling vessel for VR/AR applications, which have to tackle many challenges related to ergonomics, comfort, visual quality and natural interaction. These challenges are related to the core elements of these near-eye display hardware and tracking technologies. In this state-of-the-art report, we investigate the background theory of perception and vision as well as the latest advancements in display engineering and tracking technologies. We begin our discussion by describing the basics of light and image formation. Later, we recount principles of visual perception by relating to the human visual system. We provide two structured overviews on state-of-the-art near-eye display and tracking technologies involved in such near-eye displays. We conclude by outlining unresolved research questions to inspire the next
generation of researchers.

/pdf/near-eye-display-and-tracking-technologies-for-virtual-and-3lyzyt3bl8.pdf

Near-Eye Display and Tracking Technologies for Virtual and Augmented Reality

Redirected walking techniques can enhance the immersion and visual-vestibular comfort of virtual reality (VR) navigation, but are often limited by the size, shape, and content of the physical environments. We propose a redirected walking technique that can apply to small physical environments with static or dynamic obstacles. Via a head- and eye-tracking VR headset, our method detects saccadic suppression and redirects the users during the resulting temporary blindness. Our dynamic path planning runs in real-time on a GPU, and thus can avoid static and dynamic obstacles, including walls, furniture, and other VR users sharing the same physical space. To further enhance saccadic redirection, we propose subtle gaze direction methods tailored for VR perception. We demonstrate that saccades can significantly increase the rotation gains during redirection without introducing visual distortions or simulator sickness. This allows our method to apply to large open virtual spaces and small physical environments for room-scale VR. We evaluate our system via numerical simulations and real user studies.

/pdf/towards-virtual-reality-infinite-walking-dynamic-saccadic-wwm3b459t9.pdf

Towards virtual reality infinite walking: dynamic saccadic redirection

Multimodality in learning analytics and learning science is under the spotlight. The landscape of sensors and wearable trackers that can be used for learning support is evolving rapidly, as well as data collection and analysis methods. Multimodal data can now be collected and processed in real time at an unprecedented scale. With sensors, it is possible to capture observable events of the learning process such as learner's behaviour and the learning context. The learning process, however, consists also of latent attributes, such as the learner's cognitions or emotions. These attributes are unobservable to sensors and need to be elicited by human‐driven interpretations. We conducted a literature survey of experiments using multimodal data to frame the young research field of multimodal learning analytics. The survey explored the multimodal data used in related studies (the input space) and the learning theories selected (the hypothesis space). The survey led to the formulation of the Multimodal Learning Analytics Model whose main objectives are of (O1) mapping the use of multimodal data to enhance the feedback in a learning context; (O2) showing how to combine machine learning with multimodal data; and (O3) aligning the terminology used in the field of machine learning and learning science

https://onlinelibrary.wiley.com/doi/pdf/10.1111/jcal.12288

From signals to knowledge: A conceptual model for multimodal learning analytics

Eye tracking is increasingly being used in Educational Science and so has the interest of the eye tracking community grown in this topic. In this paper we briefly introduce the discipline of Educational Science and why it might be interesting to couple it with eye tracking research. We then introduce three major research areas in Educational Science that have already successfully used eye tracking: First, eye tracking has been used to improve the instructional design of computer-based learning and testing environments, often using hyper- or multimedia. Second, eye tracking has shed light on expertise and its development in visual domains, such as chess or medicine. Third, eye tracking has recently been also used to promote visual expertise by means of eye movement modeling examples. We outline the main educational theories for these research areas and indicate where further eye tracking research is needed to expand them.

/pdf/eye-tracking-in-educational-science-theoretical-frameworks-htqlwahwrt.pdf

Eye tracking in Educational Science: Theoretical frameworks and research agendas.

Currently, there is a "boom" in introductory programming courses to help students develop their computational thinking skills Providing timely, personalized feedback that makes students reflect about what and why they did correctly or incorrectly is critical in such courses However, the limited number of instructors and the great volume of submissions instructors need to assess, especially in Massive Open Online Courses (MOOCs), prove this task a challenge One solution is to hire graders or create peer discussions among students, however, feedback may be too general, incomplete or even incorrect Automatic techniques focus on: a) Functional testing, in which feedback usually does not sufficiently guide novices, b) Software verification to find code bugs, which may confuse novices since these tools usually skip true errors or produce false errors, and c) Comparing using reference solutions, in which a large amount of reference solutions or pre-existing correct submissions are usually required This paper presents a semantic-aware technique to provide personalized feedback that aims to mimic an instructor looking for code snippets in student submissions These snippets are modeled as subgraph patterns with natural language feedback attached to them Submissions are transformed into extended program dependence graphs combining control and data flows We leverage subgraph matching techniques to compute the adequate personalized feedback Also, constraints correlating patterns allow performing fine-grained assessments We have evaluated our method on several introductory programming assignments and a large number of submissions Our technique delivered personalized feedback in milliseconds using a small set of patterns, which makes it appealing in real-world settings

Automated Personalized Feedback in Introductory Java Programming MOOCs

The ability to direct a viewer's attention has important applications in computer graphics, data visualization, image analysis, and training. Existing computer-based gaze manipulation techniques, which direct a viewer's attention about a display, have been shown to be effective for spatial learning, search task completion, and medical training applications. In this work we extend the concept of gaze manipulation beyond digital imagery to include controlled, real-world environments. We address two main challenges in guiding attention to real-world objects: determining what object the viewer is currently paying attention to, and providing (projecting) a visual cue on a different part of the scene in order to draw the viewer's attention there. Our system consists of a pair of eye-tracking glasses to determine the viewer's gaze location, and a projector to create the visual cue in the physical environment. The results of a user study show that we can effectively direct the viewer's gaze in the real-world scene. Our technique has applicability in a wide range of instructional environments, including pilot training and driving simulators.

https://scholarworks.rit.edu/cgi/viewcontent.cgi?article=8851&context=theses

Guiding attention in controlled real-world environments

We use the Subtle Gaze Direction technique (SGD) to guide novices as they try to find abnormalities in mammograms. SGD works by performing image-space modulations on specific regions of the peripheral vision to attract attention. Gaze is monitored and modulations are terminated before they are scrutinized with high-acuity foveal vision. This approach is preferred to overt techniques which permanently alter images to highlight areas of interest. SGD is used to guide novices along the scanpath of an expert radiologist. We hypothesized that this would increase the likelihood of novices correctly identifying irregularities. Results reveal that novices who were guided in this manner performed significantly better than the control group (no gaze manipulation). Furthermore, a short-term post-training lingering effect was observed among subjects guided using SGD. They continued to perform better than the control group once the training was complete and gaze manipulation was disabled.

/pdf/subtle-gaze-manipulation-for-improved-mammography-training-4o03qh7zfs.pdf

Subtle gaze manipulation for improved mammography training

Narrative art tells a story, either as a moment in an ongoing story or as a sequence of events unfolding over time. In many works of art separate panels within the same frame are used to depict the sequence of events. Often, there is no clear delineation between these panels, or any indication of the optimal viewing order. To improve visual literacy we propose using Subtle Gaze Direction (SGD) to direct the viewers gaze across an image in a manner which reveals the story. SGD uses small image space modulations in the luminance channel to guide a viewer's gaze about an image without disrupting their normal visual experience. Using a simple ordering task we compared performance using no modulation and using subtle modulation with the correct order of narrative episodes as intended by the artist. Results from experiments show improved performance when SGD is employed. This experiment establishes the potential of the method as an aid to visual navigation in images where the viewing order is unclear.

/pdf/directing-gaze-in-narrative-art-1q70rrp9yn.pdf

Directing gaze in narrative art

The ability to direct viewer gaze about an image has important application in medical image training and analysis. We use a novel gaze manipulation technique called Subtle Gaze Direction [Bailey et al. 2009] to guide novice users as they try to identify abnormalities in digital mammogram images. Subtle Gaze Direction is achieved by performing brief image-space modulations on specific regions of the viewer's peripheral vision in order to attract their attention. The viewer's gaze is monitored in real-time and the modulations are terminated before the viewer is allowed to scrutinize them with their high-acuity foveal vision. This approach is preferred to more overt techniques which require permanent alterations to the original images in order to highlight specific areas of interest. In our experiment we use Subtle Gaze Direction to guide novices along the scanpath of an expert radiologist. We hypothesized that this approach would increase the likelihood of novices correctly identifying irregularities in the mammograms.

/pdf/subtle-gaze-manipulation-for-improved-mammography-training-1om3gm433e.pdf

Srinivas Sridharan

Papers

Automated Personalized Feedback in Introductory Java Programming MOOCs

Guiding attention in controlled real-world environments

Subtle gaze manipulation for improved mammography training

Directing gaze in narrative art

Subtle gaze manipulation for improved mammography training