Suggested by the structure of the visual nervous system, a new algorithm is proposed for pattern recognition. This algorithm can be realized with a multilayered network consisting of neuron-like cells. The network, “neocognitron”, is self-organized by unsupervised learning, and acquires the ability to recognize stimulus patterns according to the differences in their shapes: Any patterns which we human beings judge to be alike are also judged to be of the same category by the neocognitron. The neocognitron recognizes stimulus patterns correctly without being affected by shifts in position or even by considerable distortions in shape of the stimulus patterns.

Neocognitron--A New Algorithm for Pattern Recognition Tolerant of Deformations and Shifts in Position

Accurate assessment of undrained shear strength (USS) for soft sensitive clays is a great concern in geotechnical engineering practice. This study applies novel data-driven extreme gradient boosting (XGBoost) and random forest (RF) ensemble learning methods for capturing the relationships between the USS and various basic soil parameters. Based on the soil data sets from TC304 database, a general approach is developed to predict the USS of soft clays using the two machine learning methods above, where five feature variables including the preconsolidation stress (PS), vertical effective stress (VES), liquid limit (LL), plastic limit (PL) and natural water content (W) are adopted. To reduce the dependence on the rule of thumb and inefficient brute-force search, the Bayesian optimization method is applied to determine the appropriate model hyper-parameters of both XGBoost and RF. The developed models are comprehensively compared with three comparison machine learning methods and two transformation models with respect to predictive accuracy and robustness under 5-fold cross-validation (CV). It is shown that XGBoost-based and RF-based methods outperform these approaches. Besides, the XGBoost-based model provides feature importance ranks, which makes it a promising tool in the prediction of geotechnical parameters and enhances the interpretability of model.

Prediction of undrained shear strength using extreme gradient boosting and random forest based on Bayesian optimization

Soft computing techniques are becoming even more popular and particularly amenable to model the complex behaviors of most geotechnical engineering systems since they have demonstrated superior predictive capacity, compared to the traditional methods. This paper presents an overview of some soft computing techniques as well as their applications in underground excavations. A case study is adopted to compare the predictive performances of soft computing techniques including eXtreme Gradient Boosting (XGBoost), Multivariate Adaptive Regression Splines (MARS), Artificial Neural Networks (ANN), and Support Vector Machine (SVM) in estimating the maximum lateral wall deflection induced by braced excavation. This study also discusses the merits and the limitations of some soft computing techniques, compared with the conventional approaches available.

https://dr.ntu.edu.sg/bitstream/10356/146887/2/1-s2.0-S1674987119302361-main.pdf

State-of-the-art review of soft computing applications in underground excavations

With the advent of big data era, deep learning (DL) has become an essential research subject in the field of artificial intelligence (AI). DL algorithms are characterized with powerful feature learning and expression capabilities compared with the traditional machine learning (ML) methods, which attracts worldwide researchers from different fields to its increasingly wide applications. Furthermore, in the field of geochnical engineering, DL has been widely adopted in various research topics, a comprehensive review summarizing its application is desirable. Consequently, this study presented the state of practice of DL in geotechnical engineering, and depicted the statistical trend of the published papers. Four major algorithms, including feedforward neural (FNN), recurrent neural network (RNN), convolutional neural network (CNN) and generative adversarial network (GAN) along with their geotechnical applications were elaborated. In addition, a thorough summary containing pubilished literatures, the corresponding reference cases, the adopted DL algorithms as well as the related geotechnical topics was compiled. Furthermore, the challenges and perspectives of future development of DL in geotechnical engineering were presented and discussed.

Application of deep learning algorithms in geotechnical engineering: a short critical review

Application of supervised machine learning paradigms in the prediction of petroleum reservoir properties: Comparative analysis of ANN and SVM models

Driven pile is widely used as an effective and convenient structural component to transfer superstructure loads to deep stiffer soils. Nevertheless, during the design process of piles, due to the i...

Yongqin Li

Papers

Prediction of undrained shear strength using extreme gradient boosting and random forest based on Bayesian optimization

Application of deep learning algorithms in geotechnical engineering: a short critical review

Assessment of pile drivability using random forest regression and multivariate adaptive regression splines

Prediction of lining response for twin tunnels constructed in anisotropic clay using machine learning techniques

Numerical study of the performance of jet grout piles for braced excavations in soft clay