A person's emotions and state of mind are apparent in their face and eyes. As a Latin proverb states: 'The face is the portrait of the mind; the eyes, its informers'. This presents a significant challenge for Computer Graphics researchers who generate artificial entities that aim to replicate the movement and appearance of the human eye, which is so important in human-human interactions. This review article provides an overview of the efforts made on tackling this demanding task. As with many topics in computer graphics, a cross-disciplinary approach is required to fully understand the workings of the eye in the transmission of information to the user. We begin with a discussion of the movement of the eyeballs, eyelids and the head from a physiological perspective and how these movements can be modelled, rendered and animated in computer graphics applications. Furthermore, we present recent research from psychology and sociology that seeks to understand higher level behaviours, such as attention and eye gaze, during the expression of emotion or during conversation. We discuss how these findings are synthesized in computer graphics and can be utilized in the domains of Human-Robot Interaction and Human-Computer Interaction for allowing humans to interact with virtual agents and other artificial entities. We conclude with a summary of guidelines for animating the eye and head from the perspective of a character animator.

/pdf/a-review-of-eye-gaze-in-virtual-agents-social-robotics-and-2c9hut2mca.pdf

A Review of Eye Gaze in Virtual Agents, Social Robotics and HCI: Behaviour Generation, User Interaction and Perception

https://statics.scnu.edu.cn/pics/2016/0317/1458208574957758.pdf

Different topological organization of human brain functional networks with eyes open versus eyes closed

Neural substrates of shared attention as social memory: A hyperscanning functional magnetic resonance imaging study.

Ultra-slow Oscillations in fMRI and Resting-State Connectivity: Neuronal and Vascular Contributions and Technical Confounds

In the present paper, we will apply the predictive and reactive control systems (PARCS) theory as a framework that integrates competing theories of neural substrates of awareness by describing the “default mode network” (DMN) and anterior insula (AI) as parts of two different behavioral and homeostatic control systems. The DMN, a network that becomes active at rest when there is no external stimulation or task to perform, has been implicated in self-reflective awareness and prospection. By contrast, the AI is associated with awareness and task-related attention. This has led to competing theories stressing the role of the DMN in self-awareness vs. the role of interoceptive and emotional information integration in the AI in awareness of the emotional moment. In PARCS, the respective functions of the DMN and AI in a specific control system explains their association with different qualities of awareness, and how mental states can shift from one state (e.g., prospective self-reflection) to the other (e.g., awareness of the emotional moment) depending on the relative dominance of control systems. These shifts between reactive and predictive control are part of processes that enable the intake of novel information, integration of this novel information within existing knowledge structures, and the creation of a continuous personal context in which novel information can be integrated and understood. As such, PARCS can explain key characteristics of mental states, such as their temporal and spatial focus (e.g., a focus on the here and now vs. the future; a first person vs. a third person perspective). PARCS further relates mental states to brain states and functions, such as activation of the DMN or hemispheric asymmetry in frontal cortical functions. Together, PARCS deepens the understanding of a broad range of mental states, including mindfulness, mind wandering, rumination, autobiographical memory, imagery, and the experience of self.

/pdf/internally-directed-cognition-and-mindfulness-an-integrative-4ir6dxc7my.pdf

Internally-directed cognition and mindfulness: An integrative perspective derived from predictive and reactive control systems theory

It remains unknown why we generate spontaneous eyeblinks every few seconds, more often than necessary for ocular lubrication. Because eyeblinks tend to occur at implicit breakpoints while viewing videos, we hypothesized that eyeblinks are actively involved in the release of attention. We show that while viewing videos, cortical activity momentarily decreases in the dorsal attention network after blink onset but increases in the default-mode network implicated in internal processing. In contrast, physical blackouts of the video do not elicit such reciprocal changes in brain networks. The results suggest that eyeblinks are actively involved in the process of attentional disengagement during a cognitive behavior by momentarily activating the default-mode network while deactivating the dorsal attention network.

https://www.pnas.org/content/pnas/early/2012/12/19/1214804110.full.pdf

Seishi Itoi

Papers

Blink-related momentary activation of the default mode network while viewing videos