Computation-intensive design problems are becoming increasingly common in manufacturing industries. The computation burden is often caused by expensive analysis and simulation processes in order to reach a comparable level of accuracy as physical testing data. To address such a challenge, approximation or metamodeling techniques are often used. Metamodeling techniques have been developed from many different disciplines including statistics, mathematics, computer science, and various engineering disciplines. These metamodels are initially developed as “surrogates” of the expensive simulation process in order to improve the overall computation efficiency. They are then found to be a valuable tool to support a wide scope of activities in modern engineering design, especially design optimization. This work reviews the state-of-the-art metamodel-based techniques from a practitioner’s perspective according to the role of metamodeling in supporting design optimization, including model approximation, design space exploration, problem formulation, and solving various types of optimization problems. Challenges and future development of metamodeling in support of engineering design is also analyzed and discussed.Copyright © 2006 by ASME

https://www.sfu.ca/~gwa5/index_files/Microsoft%20Word%20-%20ASME-Metamodeling-6-12-06.pdf

Review of Metamodeling Techniques in Support of Engineering Design Optimization

This article reviews Kriging (also called spatial correlation modeling). It presents the basic Kriging assumptions and formulas, contrasting Kriging and classic linear regression metamodels. Furthermore, it extends Kriging to random simulation, and discusses bootstrapping to estimate the variance of the Kriging predictor. Besides classic one-shot statistical designs such as Latin Hypercube Sampling, it reviews sequentialized and customized designs. It ends with topics for future research.

/pdf/kriging-metamodeling-in-simulation-a-review-2hj4mjqeb7.pdf

Kriging Metamodeling in Simulation: A Review

Kriging metamodeling in simulation : A review

The use of kriging models for approximation and metamodel-based design and optimization has been steadily on the rise in the past decade. The widespread usage of kriging models appears to be hampered by (1) the lack of guidance in selecting the appropriate form of the kriging model, (2) computationally efficient algorithms for estimating the model’s parameters, and (3) an effective method to assess the resulting model’s quality. In this paper, we compare (1) Maximum Likelihood Estimation (MLE) and Cross-Validation (CV) parameter estimation methods for selecting a kriging model’s parameters given its form and (2) and an R 2 of prediction and the corrected Akaike Information Criterion for assessing the quality of the created kriging model, permitting the comparison of different forms of a kriging model. These methods are demonstrated with six test problems. Finally, different forms of kriging models are examined to determine if more complex forms are more accurate and easier to fit than simple forms of kriging models for approximating computer models.

http://www2.mae.ufl.edu/haftka/eoed/protected/ASME04.kriging.pdf

Use of Kriging Models to Approximate Deterministic Computer Models

[1] Surrogate modeling, also called metamodeling, has evolved and been extensively used over the past decades. A wide variety of methods and tools have been introduced for surrogate modeling aiming to develop and utilize computationally more efficient surrogates of high-fidelity models mostly in optimization frameworks. This paper reviews, analyzes, and categorizes research efforts on surrogate modeling and applications with an emphasis on the research accomplished in the water resources field. The review analyzes 48 references on surrogate modeling arising from water resources and also screens out more than 100 references from the broader research community. Two broad families of surrogates namely response surface surrogates, which are statistical or empirical data-driven models emulating the high-fidelity model responses, and lower-fidelity physically based surrogates, which are simplified models of the original system, are detailed in this paper. Taxonomies on surrogate modeling frameworks, practical details, advances, challenges, and limitations are outlined. Important observations and some guidance for surrogate modeling decisions are provided along with a list of important future research directions that would benefit the common sampling and search (optimization) analyses found in water resources.

https://agupubs.onlinelibrary.wiley.com/doi/pdf/10.1029/2011WR011527

Review of surrogate modeling in water resources

This paper summarizes the discussion at the Approximation Methods Panel that was held at the 9
 th
 AIAA/ISSMO Symposium on Multidisciplinary Analysis & Optimization in Atlanta, GA on September 2–4, 2002. The objective of the panel was to discuss the current state-of-the-art of approximation methods and identify future research directions important to the community. The panel consisted of five representatives from industry and government: (1) Andrew J. Booker from The Boeing Company, (2) Dipankar Ghosh from Vanderplaats Research & Development, (3) Anthony A. Giunta from Sandia National Laboratories, (4) Patrick N. Koch from Engineous Software, Inc., and (5) Ren-Jye Yang from Ford Motor Company. Each panelist was asked to (i) give one or two brief examples of typical uses of approximation methods by his company, (ii) describe the current state-of-the-art of these methods used by his company, (iii) describe the current challenges in the use and adoption of approximation methods within his company, and (iv) identify future research directions in approximation methods. Several common themes arose from the discussion, including differentiating between design of experiments and design and analysis of computer experiments, visualizing experimental results and data from approximation models, capturing uncertainty with approximation methods, and handling problems with large numbers of variables. These are discussed in turn along with the future directions identified by the panelists, which emphasized educating engineers in using approximation methods.

D. Ghosh

Papers

Approximation methods in multidisciplinary analysis and optimization: a panel discussion