Online class imbalance learning is a new learning problem that combines the challenges of both online learning and class imbalance learning. It deals with data streams having very skewed class distributions. This type of problems commonly exists in real-world applications, such as fault diagnosis of real-time control monitoring systems and intrusion detection in computer networks. In our earlier work, we defined class imbalance online, and proposed two learning algorithms OOB and UOB that build an ensemble model overcoming class imbalance in real time through resampling and time-decayed metrics. In this paper, we further improve the resampling strategy inside OOB and UOB, and look into their performance in both static and dynamic data streams. We give the first comprehensive analysis of class imbalance in data streams, in terms of data distributions, imbalance rates and changes in class imbalance status. We find that UOB is better at recognizing minority-class examples in static data streams, and OOB is more robust against dynamic changes in class imbalance status. The data distribution is a major factor affecting their performance. Based on the insight gained, we then propose two new ensemble methods that maintain both OOB and UOB with adaptive weights for final predictions, called WEOB1 and WEOB2. They are shown to possess the strength of OOB and UOB with good accuracy and robustness.

/pdf/resampling-based-ensemble-methods-for-online-class-imbalance-2zifkaev5y.pdf

Resampling-Based Ensemble Methods for Online Class Imbalance Learning

Over the last two decades, water smart metering programs have been launched in a number of medium to large cities worldwide to nearly continuously monitor water consumption at the single household level. The availability of data at such very high spatial and temporal resolution advanced the ability in characterizing, modeling, and, ultimately, designing user-oriented residential water demand management strategies. Research to date has been focusing on one or more of these aspects but with limited integration between the specialized methodologies developed so far. This manuscript is the first comprehensive review of the literature in this quickly evolving water research domain. The paper contributes a general framework for the classification of residential water demand modeling studies, which allows revising consolidated approaches, describing emerging trends, and identifying potential future developments. In particular, the future challenges posed by growing population demands, constrained sources of water supply and climate change impacts are expected to require more and more integrated procedures for effectively supporting residential water demand modeling and management in several countries across the world. We review high resolution residential water demand modeling studies.We provide a classification of existing technologies and methodologies.We identify current trends, challenges and opportunities for future development.

/pdf/benefits-and-challenges-of-using-smart-meters-for-advancing-3nblgijm2n.pdf

Benefits and challenges of using smart meters for advancing residential water demand modeling and management

Review and classification of recent observers applied in chemical process systems

Brief paper: Interval observer design for consistency checks of nonlinear continuous-time systems

As an emerging research topic, online class imbalance learning often combines the challenges of both class imbalance and concept drift. It deals with data streams having very skewed class distributions, where concept drift may occur. It has recently received increased research attention; however, very little work addresses the combined problem where both class imbalance and concept drift coexist. As the first systematic study of handling concept drift in class-imbalanced data streams, this paper first provides a comprehensive review of current research progress in this field, including current research focuses and open challenges. Then, an in-depth experimental study is performed, with the goal of understanding how to best overcome concept drift in online learning with class imbalance. Based on the analysis, a general guideline is proposed for the development of an effective algorithm.

A Systematic Study of Online Class Imbalance Learning with Concept Drift

The efficient distribution of water is a subject of major concern for water utilities and authorities [1]. While some leaks in water distribution networks (WDNs) are unavoidable, one of the main challenges in improving the efficiency of drinking water networks is to minimize leaks. Leaks can cause significant economic losses in fluid transportation and extra costs for the final consumer due to the waste of energy and chemicals in water treatment plants. Leaks may also damage infrastructure and cause third-party damage and health risks. In many WDNs, losses due to leakage are estimated to account up to 30% of the total amount of extracted water [2]; a very important issue in a world struggling to satisfy water demands of a growing population.

/pdf/leak-localization-in-water-networks-a-model-based-3v7eos39uh.pdf

Leak Localization in Water Networks: A Model-Based Methodology Using Pressure Sensors Applied to a Real Network in Barcelona [Applications of Control]

This paper proposes a fault diagnosis method using a timed discrete-event approach based on interval observers that improves the integration of fault detection and isolation tasks. The interface between fault detection and fault isolation considers the activation degree and the occurrence time instant of the diagnostic signals using a combination of several theoretical fault signature matrices that store the knowledge of the relationship between diagnostic signals and faults. The fault isolation module is implemented using a timed discrete-event approach that recognizes the occurrence of a fault by identifying a unique sequence of observable events (fault signals). The states and transitions that characterize such a system can directly be inferred from the relation between fault signals and faults. The proposed fault diagnosis approach has been motivated by the problem of detecting and isolating faults of the Barcelona's urban sewer system limnimeters (level meter sensors). The results obtained in this case study illustrate the benefits of using the proposed approach in comparison with the standard fault detection and isolation approach.

/pdf/fault-diagnosis-using-a-timed-discrete-event-approach-based-3nnammu3wt.pdf

Fault Diagnosis Using a Timed Discrete-Event Approach Based on Interval Observers: Application to Sewer Networks

Observer gain effect in linear interval observer-based fault detection

This paper describes a model-driven decision-support system (software tool) implementing a model-based methodology for on-line leakage detection and localization which is useful for a large class of water distribution networks. Since these methods present a certain degree of complexity which limits their use to experts, the proposed software tool focuses on the integration of a method emphasizing its use by water network managers as a decision support system. The proposed software tool integrates a model-based leakage localization methodology based on the use of on-line telemetry information, as well as a water network calibrated hydraulic model. The application of the resulting decision support software tool in a district metered area (DMA) of the Barcelona distribution network is provided and discussed. The obtained results show that the leakage detection and localization may be performed efficiently reducing the required time.

/pdf/a-decision-support-system-for-on-line-leakage-localization-3hrpw4shtv.pdf

A decision support system for on-line leakage localization

In case of model uncertainty is located in parameters (interval model), an interval observer has been shown to be a suitable strategy to generate an adaptive threshold to be used in residual evaluation. In interval observer-based fault detection methods, the observer gain plays an important role since it determines the minimum detectable fault for a given type of fault and allows enhancing the observer fault detection properties while diminishing model computational drawbacks (i.e. wrapping effect, computational complexity). In this paper, the effect of the observer gain on the time evolution of the residual sensitivity to a fault is analyzed. Then, using these sensitivity studies, the minimum detectable fault time evolution is established. Thus, three types of faults according their detectability time evolution are introduced: permanently (strongly) detected, non-permanently (weakly) detected or just non-detected. Finally, an example based on a mineral grinding- classification process will be used to illustrate the results derived.

Jordi Meseguer

Papers

Leak Localization in Water Networks: A Model-Based Methodology Using Pressure Sensors Applied to a Real Network in Barcelona [Applications of Control]

Fault Diagnosis Using a Timed Discrete-Event Approach Based on Interval Observers: Application to Sewer Networks

Observer gain effect in linear interval observer-based fault detection

A decision support system for on-line leakage localization

Observer gain effect in linear interval observer-based fault detection