It is generally accepted that augmented feedback, provided by a human expert or a technical display, effectively enhances motor learning. However, discussion of the way to most effectively provide augmented feedback has been controversial. Related studies have focused primarily on simple or artificial tasks enhanced by visual feedback. Recently, technical advances have made it possible also to investigate more complex, realistic motor tasks and to implement not only visual, but also auditory, haptic, or multimodal augmented feedback. The aim of this review is to address the potential of augmented unimodal and multimodal feedback in the framework of motor learning theories. The review addresses the reasons for the different impacts of feedback strategies within or between the visual, auditory, and haptic modalities and the challenges that need to be overcome to provide appropriate feedback in these modalities, either in isolation or in combination. Accordingly, the design criteria for successful visual, auditory, haptic, and multimodal feedback are elaborated.

/pdf/augmented-visual-auditory-haptic-and-multimodal-feedback-in-2jc0b0ky7k.pdf

Augmented visual, auditory, haptic, and multimodal feedback in motor learning: A review

Perceptual events derive their significance to an animal from their meaning about the world, that is from the information they carry about their causes. The brain should thus be able to efficiently infer the causes underlying our sensory events. Here we use multisensory cue combination to study causal inference in perception. We formulate an ideal-observer model that infers whether two sensory cues originate from the same location and that also estimates their location(s). This model accurately predicts the nonlinear integration of cues by human subjects in two auditory-visual localization tasks. The results show that indeed humans can efficiently infer the causal structure as well as the location of causes. By combining insights from the study of causal inference with the ideal-observer approach to sensory cue combination, we show that the capacity to infer causal structure is not limited to conscious, high-level cognition; it is also performed continually and effortlessly in perception.

/pdf/causal-inference-in-multisensory-perception-57tf03r3ls.pdf

Causal inference in multisensory perception.

Synchronous presentation of stimuli to the auditory and visual systems can modify the formation of a percept in either modality. For example, perception of auditory speech is improved when the speaker's facial articulatory movements are visible. Neural convergence onto multisensory sites exhibiting supra-additivity has been proposed as the principal mechanism for integration. Recent findings, however, have suggested that putative sensory-specific cortices are responsive to inputs presented through a different modality. Consequently, when and where audiovisual representations emerge remain unsettled. In combined psychophysical and electroencephalography experiments we show that visual speech speeds up the cortical processing of auditory signals early (within 100 ms of signal onset). The auditory–visual interaction is reflected as an articulator-specific temporal facilitation (as well as a nonspecific amplitude reduction). The latency facilitation systematically depends on the degree to which the visual signal predicts possible auditory targets. The observed auditory–visual data support the view that there exist abstract internal representations that constrain the analysis of subsequent speech inputs. This is evidence for the existence of an “analysis-by-synthesis” mechanism in auditory–visual speech perception.

/pdf/visual-speech-speeds-up-the-neural-processing-of-auditory-3p182zea5e.pdf

Visual speech speeds up the neural processing of auditory speech

http://www.utdallas.edu/~assmann/hcs6367/van_wassenhove_grant_poeppel07.pdf

Temporal window of integration in auditory-visual speech perception.

Humans, like other animals, are exposed to a continuous stream of signals, which are dynamic, multimodal, extended, and time varying in nature. This complex input space must be transduced and sampled by our sensory systems and transmitted to the brain where it can guide the selection of appropriate actions. To simplify this process, it's been suggested that the brain exploits statistical regularities in the stimulus space. Tests of this idea have largely been confined to unimodal signals and natural scenes. One important class of multisensory signals for which a quantitative input space characterization is unavailable is human speech. We do not understand what signals our brain has to actively piece together from an audiovisual speech stream to arrive at a percept versus what is already embedded in the signal structure of the stream itself. In essence, we do not have a clear understanding of the natural statistics of audiovisual speech. In the present study, we identified the following major statistical features of audiovisual speech. First, we observed robust correlations and close temporal correspondence between the area of the mouth opening and the acoustic envelope. Second, we found the strongest correlation between the area of the mouth opening and vocal tract resonances. Third, we observed that both area of the mouth opening and the voice envelope are temporally modulated in the 2-7 Hz frequency range. Finally, we show that the timing of mouth movements relative to the onset of the voice is consistently between 100 and 300 ms. We interpret these data in the context of recent neural theories of speech which suggest that speech communication is a reciprocally coupled, multisensory event, whereby the outputs of the signaler are matched to the neural processes of the receiver.

/pdf/the-natural-statistics-of-audiovisual-speech-3j6fxkno2w.pdf

The Natural Statistics of Audiovisual Speech

Three experiments are reported on the influence of different timing relations on the McGurk effect. In the first experiment, it is shown that strict temporal synchrony between auditory and visual speech stimuli is not required for the McGurk effect. Subjects were strongly influenced by the visual stimuli when the auditory stimuli lagged the visual stimuli by as much as 180 msec. In addition, a stronger McGurk effect was found when the visual and auditory vowels matched. In the second experiment, we paired auditory and visual speech stimuli produced under different speaking conditions (fast, normal, clear). The results showed that the manipulations in both the visual and auditory speaking conditions independently influenced perception. In addition, there was a small but reliable tendency for the better matched stimuli to elicit more McGurk responses than unmatched conditions. In the third experiment, we combined auditory and visual stimuli produced under different speaking conditions (fast, clear) and delayed the acoustics with respect to the visual stimuli. The subjects showed the same pattern of results as in the second experiment. Finally, the delay did not cause different patterns of results for the different audiovisual speaking style combinations. The results suggest that perceivers may be sensitive to the concordance of the time-varying aspects of speech but they do not require temporal coincidence of that information.

/pdf/temporal-constraints-on-the-mcgurk-effect-3y318i62po.pdf

Temporal constraints on the McGurk effect

The aim of this systematic review was to collect and align the research on social cognition impairments in adults with Attention-deficit/hyperactivity disorder (ADHD). In particular, we selected and analyzed papers on emotion recognition and processing, Theory of Mind (TOM), empathy, and other facets of social cognition as decision making. We identified 16 papers published between 2012 and 2022 which meet inclusion criteria. Papers search, selection, and extraction followed the PRISMA guidelines. In order to summarize data from papers, we used a narrative synthesis approach. Results show different evidence of impairment in social cognition domains in adults with ADHD. Our systematic review suggests the importance of promoting more research on this topic because it is essential to keep in mind that social cognition plays a central role in socialization and social relationships.

/pdf/social-cognition-in-adult-adhd-a-systematic-review-rin2686k.pdf

Social Cognition in Adult ADHD: A Systematic Review

(1) Background: Patients with mild cognitive impairment (MCI) often present impairment in executive functions (EFs). This study aimed to investigate the effect of high-frequency repetitive transcranial magnetic stimulation (rTMS) on EFs in patients with MCI. (2) Methods: A prospective trial was conducted on 11 patients with MCI. Participants underwent 25 min of 20 Hz rTMS for ten days on the right temporo-parietal junction (RTPJ) and medial prefrontal cortex (MPFC). Before (T0) and after rTMS treatment (T1), global cognitive profile and EFs were investigated using the Montreal cognitive assessment (MoCA), trial making test (TMT) A and B, and frontal assessment battery (FAB). Depression symptoms were assessed using the geriatric depression scale (GDS). Statistical analysis included Wilcoxon signed-rank test. (3) Results: After treatment, patients showed a significant improvement in the MoCA EFs subtask (T0 vs. T1, p = 0.015) and TMT-B (T0 vs. T1, p = 0.028). Five MCI patients with EF impairment showed full recovery of these deficits. No significant changes in the GDS were observed. (4) Conclusions: rTMS stimulation over the TPJ and MPFC induced significant short-term improvements in EFs in MCI patients. These findings suggest that the TPJ and MPFC may be involved in the attention-executive skills to redirect attention toward behaviorally relevant stimuli.

/pdf/transcranial-magnetic-stimulation-improves-executive-6vdeqxto.pdf

Transcranial Magnetic Stimulation Improves Executive Functioning through Modulation of Social Cognitive Networks in Patients with Mild Cognitive Impairment: Preliminary Results

Background Adults with ADHD exhibit a neuropsychological profile that may present deficits in many cognitive domains, particularly attention and executive functions (EFs). However, some authors do not consider executive disfunction as an important part of the clinical profile of the syndrome; this could be related to the use of inappropriate neuropsychological tests, probably not adapted and not sufficiently ecological. Moreover, new data are required on specific correlation of attentive-executive symptoms with socio-demographic factors. Therefore, the aim of this study is to analyze the neuropsychological performance of a group of adults with ADHD, also evaluating the influence of gender, age and education level. Methods We retrospectively collected health-related personal data of 40 adult ADHD patients, clinically diagnosed and evaluated via a battery of 4 neuropsychological tests and 1 self-administered questionnaire. Gender, age and years of education differences were assessed. Results Attention and EFs deficits have been highlighted mainly on the d2-R and 5-point neuropsychological tests, which therefore seem to be more sensitive in measuring the attention-executive dysfunction in an adult ADHD population, than TAP Go/No-go and ROCFT. ADHD patients also manifested subjective behavioral impulsivity disorders on BIS-11. There were no statistically significant gender differences in cognitive performance. On the contrary, younger patients performed worse on subscales TAP Go/No-go errors and 5-points number of drawings, while participants with a higher education level performed better on subscales d2-R speed of execution and d2-R errors. This supports a reduction in the number of errors and the execution time as a function of older age and a higher level of education. Finally, patients with higher education also self-reported greater impulsivity in planning. Conclusion Our preliminary findings suggest that adult ADHD is not a lifelong stable disorder, but it may change over time. Moreover, attention-executive deficits may be influenced and partially counterbalanced by experience (i.e., advancing age) and a higher level of education. This could underlie the development of specific psycho-behavioral and cognitive compensatory strategies. The use of self-administered questionnaires is therefore recommended to highlight attentional and executive difficulties that may not result in neuropsychological tests.

/pdf/attentive-executive-functioning-and-compensatory-strategies-3fwupf1y.pdf

Attentive-executive functioning and compensatory strategies in adult ADHD: A retrospective case series study

Background: Despite modern antiretroviral therapy, human immunodeficiency virus-1 (HIV-1) ribonucleic acid (RNA) escape into the cerebrospinal fluid (CSF) may occur. We examined the prevalence of and factors associated with CSF HIV-1 escape among people living with HIV (PLWH) in Switzerland. Setting: The Neurocognitive Assessment in the Metabolic and Aging Cohort study is an ongoing, prospective, longitudinal, multicenter study within the Swiss HIV Cohort Study. The neuro-HIV platform is a multidisciplinary, single-day outpatient consultation at Lausanne University Hospital. Methods: We pooled data from the Neurocognitive Assessment in the Metabolic and Aging Cohort study and the neuro-HIV platform participants who underwent lumbar puncture between 2011 and 2019. Both patient groups had neurocognitive symptoms. Cerebrospinal fluid HIV-1 escape was defined as the presence of quantifiable CSF HIV-1 RNA when plasma HIV-1 RNA was suppressed or CSF HIV-1 RNA greater than plasma HIV-1 RNA when the latter was detectable. Results: Of 1166 PLWH assessed, 288 underwent lumbar puncture. Cerebrospinal fluid HIV-1 escape was observed in 25 PLWH (8.7%) of whom 19 (76%) had suppressed plasma HIV-1 RNA. Characteristics of PLWH were comparable whether they had CSF HIV-1 escape or not, including comorbidities, time since HIV diagnosis (15 vs 16 years, P = 0.9), median CD4 nadir (158.5/mm3 vs 171/mm3, P = 0.6), antiretroviral CSF penetration-effectiveness score (7 vs 7 points, P = 0.8), and neurocognitive diagnosis based on Frascati criteria and radiological findings. Conclusions: In this large pooled sample of PLWH with neurocognitive symptoms, CSF HIV-1 escape occurred in 8.7% of PLWH. People living with HIV with CSF HIV-1 escape presented no distinctive clinical or paraclinical characteristics. We conclude that lumbar puncture is unavoidable in confirming CSF HIV-1 escape.

L. Sacco

Papers

Temporal constraints on the McGurk effect

Social Cognition in Adult ADHD: A Systematic Review

Transcranial Magnetic Stimulation Improves Executive Functioning through Modulation of Social Cognitive Networks in Patients with Mild Cognitive Impairment: Preliminary Results

Attentive-executive functioning and compensatory strategies in adult ADHD: A retrospective case series study

Cerebrospinal Fluid HIV-1 Escape in Patients With Neurocognitive Symptoms: Pooled Data From a Neuro-HIV Platform and the NAMACO Study