A self-constructing neural fuzzy inference network (SONFIN) with online learning ability is proposed in this paper. The SONFIN is inherently a modified Takagi-Sugeno-Kang (TSK)-type fuzzy rule-based model possessing neural network learning ability. There are no rules initially in the SONFIN. They are created and adapted as online learning proceeds via simultaneous structure and parameter identification. In the structure identification of the precondition part, the input space is partitioned in a flexible way according to an aligned clustering-based algorithm. As to the structure identification of the consequent part, only a singleton value selected by a clustering method is assigned to each rule initially. Afterwards, some additional significant terms selected via a projection-based correlation measure for each rule will be added to the consequent part incrementally as learning proceeds. The combined precondition and consequent structure identification scheme can set up an economic and dynamically growing network, a main feature of the SONFIN. In the parameter identification, the consequent parameters are tuned optimally by either least mean squares or recursive least squares algorithms and the precondition parameters are tuned by a backpropagation algorithm. To enhance the knowledge representation ability of the SONFIN, a linear transformation for each input variable can be incorporated into the network so that much fewer rules are needed or higher accuracy can be achieved.

https://ir.nctu.edu.tw:443/bitstream/11536/32809/1/000072774800002.pdf

An online self-constructing neural fuzzy inference network and its applications

This paper proposes a new approach to fuzzy modeling. The suggested fuzzy model can express a given unknown system with a few fuzzy rules as well as Takagi and Sugeno's model (1985), because it has the same structure as that of Takagi and Sugeno's model. It is also as easy to implement as Sugeno and Yasukawa's model (1993) because its identification mimics the simple identification procedure of Sugeno and Yasukawa's model. The suggested algorithm is composed of two steps: coarse tuning and fine tuning. In coarse tuning, fuzzy C-regression model (FCRM) clustering is used, which is a modified version of fuzzy C-means (FCM). In fine tuning, gradient descent algorithm is used to precisely adjust parameters of the fuzzy model instead of nonlinear optimization methods used in other models. Finally, some examples are given to demonstrate the validity of this algorithm.

A new approach to fuzzy modeling

In this paper, an architecture of dynamic fuzzy neural networks (D-FNN) implementing Takagi-Sugeno-Kang (TSK) fuzzy systems based on extended radial basis function (RBF) neural networks is proposed. A novel learning algorithm based on D-FNN is also presented. The salient characteristics of the algorithm are: 1) hierarchical on-line self-organizing learning is used; 2) neurons can be recruited or deleted dynamically according to their significance to the system's performance; and 3) fast learning speed can be achieved. Simulation studies and comprehensive comparisons with some other learning algorithms demonstrate that a more compact structure with higher performance can be achieved by the proposed approach.

Dynamic fuzzy neural networks-a novel approach to function approximation

A fast approach for automatically generating fuzzy rules from sample patterns using generalized dynamic fuzzy neural networks (GD-FNNs) is presented. The GD-FNN is built based on ellipsoidal basis functions and functionally is equivalent to a Takagi-Sugeno-Kang fuzzy system. The salient characteristics of the GD-FNN are: (1) structure identification and parameters estimation are performed automatically and simultaneously without partitioning input space and selecting initial parameters a priori; (2) fuzzy rules can be recruited or deleted dynamically; (3) fuzzy rules can be generated quickly without resorting to the backpropagation (BP) iteration learning, a common approach adopted by many existing methods. The GD-FNN is employed in a wide range of applications ranging from static function approximation and nonlinear system identification to time-varying drug delivery system and multilink robot control. Simulation results demonstrate that a compact and high-performance fuzzy rule-base can be constructed. Comprehensive comparisons with other latest approaches show that the proposed approach is superior in terms of learning efficiency and performance.

A fast approach for automatic generation of fuzzy rules by generalized dynamic fuzzy neural networks

HyFIS: adaptive neuro-fuzzy inference systems and their application to nonlinear dynamical systems

We develop simple but effective fuzzy-rule based models of complex systems from input-output data. We introduce a simple fuzzy-neural network for modeling systems, and we prove that it can represent any continuous function over a compact set. We introduce "fuzzy curves" and use them to: 1) identify significant input variables, 2) determine model structure, and 3) set the initial weights in the fuzzy-neural network model. Our method for input identification is computationally simple and, since we determine the proper network structure and initial weights in advance, we can train the network rapidly. Viewing the network as a fuzzy model gives insight into the real system, and it provides a method to simplify the neural network. >

G.A. Cunningham

Papers

A new approach to fuzzy-neural system modeling