Activity recognition plays a key role in providing activity assistance and care for users in smart homes. In this work, we present an activity recognition system that classifies in the near real-time a set of common daily activities exploiting both the data sampled by sensors embedded in a smartphone carried out by the user and the reciprocal Received Signal Strength (RSS) values coming from worn wireless sensor devices and from sensors deployed in the environment. In order to achieve an effective and responsive classification, a decision tree based on multisensor data-stream is applied fusing data coming from embedded sensors on the smartphone and environmental sensors before processing the RSS stream. To this end, we model the RSS stream, obtained from a Wireless Sensor Network (WSN), using Recurrent Neural Networks (RNNs) implemented as efficient Echo State Networks (ESNs), within the Reservoir Computing (RC) paradigm. We targeted the system for the EvAAL scenario, an international competition that aims at establishing benchmarks and evaluation metrics for comparing Ambient Assisted Living (AAL) solutions. In this paper, the performance of the proposed activity recognition system is assessed on a purposely collected real-world dataset, taking also into account a competitive neural network approach for performance comparison. Our results show that, with an appropriate configuration of the information fusion chain, the proposed system reaches a very good accuracy with a low deployment cost.

/pdf/human-activity-recognition-using-multisensor-data-fusion-1ogpml7le4.pdf

Human Activity Recognition using Multisensor Data Fusion based on Reservoir Computing

Towards wireless sensor, actuator and robot networks

Robotic ecologies are networks of heterogeneous robotic devices pervasively embedded in everyday environments, where they cooperate to perform complex tasks. While their potential makes them increasingly popular, one fundamental problem is how to make them both autonomous and adaptive, so as to reduce the amount of preparation, pre-programming and human supervision that they require in real world applications. The project RUBICON develops learning solutions which yield cheaper, adaptive and efficient coordination of robotic ecologies. The approach we pursue builds upon a unique combination of methods from cognitive robotics, machine learning, planning and agent-based control, and wireless sensor networks. This paper illustrates the innovations advanced by RUBICON in each of these fronts before describing how the resulting techniques have been integrated and applied to a proof of concept smart home scenario. The resulting system is able to provide useful services and pro-actively assist the users in their activities. RUBICON learns through an incremental and progressive approach driven by the feedback received from its own activities and from the user, while also self-organizing the manner in which it uses available sensors, actuators and other functional components in the process. This paper summarises some of the lessons learned by adopting such an approach and outlines promising directions for future work.

/pdf/robotic-ubiquitous-cognitive-ecology-for-smart-homes-6294yt3ot0.pdf

Robotic Ubiquitous Cognitive Ecology for Smart Homes

A cognitive robotic ecology approach to self-configuring and evolving AAL systems

In this paper we present an application of Reservoir Computing to indoor robot localization, based on input received signal strength signals from a wireless sensor network. The proposed localization system allows to combine good predictive performance with particularly efficient and practical solutions. Promising results are shown in preliminary experiments on a real-world scenario.

Robot Localization by Echo State Networks Using RSS

Robotic ecologies are networks of heterogeneous robotic devices pervasively embedded in everyday environments, where they cooperate to perform complex tasks. While their potential makes them increasingly popular, one fundamental problem is how to make them self-adaptive, so as to reduce the amount of preparation, pre-programming and human supervision that they require in real world applications. The EU FP7 project RUBICON develops self-sustaining learning solutions yielding cheaper, adaptive and efficient coordination of robotic ecologies. The approach we pursue builds upon a unique combination of methods from cognitive robotics, agent control systems, wireless sensor networks and machine learning. This paper briefly illustrates how these techniques are being extended, integrated, and applied to AAL applications.

/pdf/robotic-ubiquitous-cognitive-network-3r8uz3xb6u.pdf

Rafa López

Papers

Robotic UBIquitous COgnitive Network