Leu-M

Fast Fourier Transform

FusionGAN: A generative adversarial network for infrared and visible image fusion

Infrared and visible image fusion methods and applications: A survey

Photoplethysmography and its application in clinical physiological measurement

The fusion of infrared and visible images of the same scene aims to generate a composite image which can provide a more comprehensive description of the scene. In this paper, we propose an infrared...

Infrared and visible image fusion with convolutional neural networks

Medical image fusion technique plays an an increasingly critical role in many clinical applications by deriving the complementary information from medical images with different modalities. In this paper, a medical image fusion method based on convolutional neural networks (CNNs) is proposed. In our method, a siamese convolutional network is adopted to generate a weight map which integrates the pixel activity information from two source images. The fusion process is conducted in a multi-scale manner via image pyramids to be more consistent with human visual perception. In addition, a local similarity based strategy is applied to adaptively adjust the fusion mode for the decomposed coefficients. Experimental results demonstrate that the proposed method can achieve promising results in terms of both visual quality and objective assessment.

A medical image fusion method based on convolutional neural networks

As an essential branch of context awareness, activity awareness, especially daily activity monitoring and fall detection, is important to healthcare for the elderly and patients with chronic diseases. In this paper, a framework for activity awareness using surface electromyography and accelerometer (ACC) signals is proposed. First, histogram negative entropy was employed to determine the start- and end-points of static and dynamic active segments. Then, the angle of each ACC axis was calculated to indicate body postures, which assisted with sorting dynamic activities into two categories: dynamic gait activities and dynamic transition ones, by judging whether the pre- and post-postures are both standing. Next, the dynamic gait activities were identified by the double-stream hidden Markov models. Besides, the dynamic transition activities were distinguished into normal transition activities and falls by resultant ACC amplitude. Finally, a continuous daily activity monitoring and fall detection scheme was performed with the recognition accuracy over 98%, demonstrating the excellent fall detection performance and the great feasibility of the proposed method in daily activities awareness.

A Framework for Daily Activity Monitoring and Fall Detection Based on Surface Electromyography and Accelerometer Signals

Emotion recognition based on electroencephalography (EEG) is a significant task in the brain-computer interface field. Recently, many deep learning-based emotion recognition methods are demonstrated to outperform traditional methods. However, it remains challenging to extract discriminative features for EEG emotion recognition, and most methods ignore useful information in channel and time. This paper proposes an attention-based convolutional recurrent neural network (ACRNN) to extract more discriminative features from EEG signals and improve the accuracy of emotion recognition. First, the proposed ACRNN adopts a channel-wise attention mechanism to adaptively assign the weights of different channels, and a CNN is employed to extract the spatial information of encoded EEG signals. Then, to explore the temporal information of EEG signals, extended self-attention is integrated into an RNN to recode the importance based on intrinsic similarity in EEG signals. We conducted extensive experiments on the DEAP and DREAMER databases. The experimental results demonstrate that the proposed ACRNN outperforms state-of-the-art methods.

Juan Cheng

Papers

Infrared and visible image fusion with convolutional neural networks

A medical image fusion method based on convolutional neural networks

A Framework for Daily Activity Monitoring and Fall Detection Based on Surface Electromyography and Accelerometer Signals

EEG-based Emotion Recognition via Channel-wise Attention and Self Attention

Multi-focus image fusion: A Survey of the state of the art