A survey of current continuous nonlinear multi-objective optimization (MOO) concepts and methods is presented. It consolidates and relates seemingly different terminology and methods. The methods are divided into three major categories: methods with a priori articulation of preferences, methods with a posteriori articulation of preferences, and methods with no articulation of preferences. Genetic algorithms are surveyed as well. Commentary is provided on three fronts, concerning the advantages and pitfalls of individual methods, the different classes of methods, and the field of MOO as a whole. The Characteristics of the most significant methods are summarized. Conclusions are drawn that reflect often-neglected ideas and applicability to engineering problems. It is found that no single approach is superior. Rather, the selection of a specific method depends on the type of information that is provided in the problem, the user’s preferences, the solution requirements, and the availability of software.

Survey of multi-objective optimization methods for engineering

Preface. 1 Introduction to Optimization. 1.1 Introduction. 1.2 Historical Development. 1.3 Engineering Applications of Optimization. 1.4 Statement of an Optimization Problem. 1.5 Classification of Optimization Problems. 1.6 Optimization Techniques. 1.7 Engineering Optimization Literature. 1.8 Solution of Optimization Problems Using MATLAB. References and Bibliography. Review Questions. Problems. 2 Classical Optimization Techniques. 2.1 Introduction. 2.2 Single-Variable Optimization. 2.3 Multivariable Optimization with No Constraints. 2.4 Multivariable Optimization with Equality Constraints. 2.5 Multivariable Optimization with Inequality Constraints. 2.6 Convex Programming Problem. References and Bibliography. Review Questions. Problems. 3 Linear Programming I: Simplex Method. 3.1 Introduction. 3.2 Applications of Linear Programming. 3.3 Standard Form of a Linear Programming Problem. 3.4 Geometry of Linear Programming Problems. 3.5 Definitions and Theorems. 3.6 Solution of a System of Linear Simultaneous Equations. 3.7 Pivotal Reduction of a General System of Equations. 3.8 Motivation of the Simplex Method. 3.9 Simplex Algorithm. 3.10 Two Phases of the Simplex Method. 3.11 MATLAB Solution of LP Problems. References and Bibliography. Review Questions. Problems. 4 Linear Programming II: Additional Topics and Extensions. 4.1 Introduction. 4.2 Revised Simplex Method. 4.3 Duality in Linear Programming. 4.4 Decomposition Principle. 4.5 Sensitivity or Postoptimality Analysis. 4.6 Transportation Problem. 4.7 Karmarkar's Interior Method. 4.8 Quadratic Programming. 4.9 MATLAB Solutions. References and Bibliography. Review Questions. Problems. 5 Nonlinear Programming I: One-Dimensional Minimization Methods. 5.1 Introduction. 5.2 Unimodal Function. ELIMINATION METHODS. 5.3 Unrestricted Search. 5.4 Exhaustive Search. 5.5 Dichotomous Search. 5.6 Interval Halving Method. 5.7 Fibonacci Method. 5.8 Golden Section Method. 5.9 Comparison of Elimination Methods. INTERPOLATION METHODS. 5.10 Quadratic Interpolation Method. 5.11 Cubic Interpolation Method. 5.12 Direct Root Methods. 5.13 Practical Considerations. 5.14 MATLAB Solution of One-Dimensional Minimization Problems. References and Bibliography. Review Questions. Problems. 6 Nonlinear Programming II: Unconstrained Optimization Techniques. 6.1 Introduction. DIRECT SEARCH METHODS. 6.2 Random Search Methods. 6.3 Grid Search Method. 6.4 Univariate Method. 6.5 Pattern Directions. 6.6 Powell's Method. 6.7 Simplex Method. INDIRECT SEARCH (DESCENT) METHODS. 6.8 Gradient of a Function. 6.9 Steepest Descent (Cauchy) Method. 6.10 Conjugate Gradient (Fletcher-Reeves) Method. 6.11 Newton's Method. 6.12 Marquardt Method. 6.13 Quasi-Newton Methods. 6.14 Davidon-Fletcher-Powell Method. 6.15 Broyden-Fletcher-Goldfarb-Shanno Method. 6.16 Test Functions. 6.17 MATLAB Solution of Unconstrained Optimization Problems. References and Bibliography. Review Questions. Problems. 7 Nonlinear Programming III: Constrained Optimization Techniques. 7.1 Introduction. 7.2 Characteristics of a Constrained Problem. DIRECT METHODS. 7.3 Random Search Methods. 7.4 Complex Method. 7.5 Sequential Linear Programming. 7.6 Basic Approach in the Methods of Feasible Directions. 7.7 Zoutendijk's Method of Feasible Directions. 7.8 Rosen's Gradient Projection Method. 7.9 Generalized Reduced Gradient Method. 7.10 Sequential Quadratic Programming. INDIRECT METHODS. 7.11 Transformation Techniques. 7.12 Basic Approach of the Penalty Function Method. 7.13 Interior Penalty Function Method. 7.14 Convex Programming Problem. 7.15 Exterior Penalty Function Method. 7.16 Extrapolation Techniques in the Interior Penalty Function Method. 7.17 Extended Interior Penalty Function Methods. 7.18 Penalty Function Method for Problems with Mixed Equality and Inequality Constraints. 7.19 Penalty Function Method for Parametric Constraints. 7.20 Augmented Lagrange Multiplier Method. 7.21 Checking the Convergence of Constrained Optimization Problems. 7.22 Test Problems. 7.23 MATLAB Solution of Constrained Optimization Problems. References and Bibliography. Review Questions. Problems. 8 Geometric Programming. 8.1 Introduction. 8.2 Posynomial. 8.3 Unconstrained Minimization Problem. 8.4 Solution of an Unconstrained Geometric Programming Program Using Differential Calculus. 8.5 Solution of an Unconstrained Geometric Programming Problem Using Arithmetic-Geometric Inequality. 8.6 Primal-Dual Relationship and Sufficiency Conditions in the Unconstrained Case. 8.7 Constrained Minimization. 8.8 Solution of a Constrained Geometric Programming Problem. 8.9 Primal and Dual Programs in the Case of Less-Than Inequalities. 8.10 Geometric Programming with Mixed Inequality Constraints. 8.11 Complementary Geometric Programming. 8.12 Applications of Geometric Programming. References and Bibliography. Review Questions. Problems. 9 Dynamic Programming. 9.1 Introduction. 9.2 Multistage Decision Processes. 9.3 Concept of Suboptimization and Principle of Optimality. 9.4 Computational Procedure in Dynamic Programming. 9.5 Example Illustrating the Calculus Method of Solution. 9.6 Example Illustrating the Tabular Method of Solution. 9.7 Conversion of a Final Value Problem into an Initial Value Problem. 9.8 Linear Programming as a Case of Dynamic Programming. 9.9 Continuous Dynamic Programming. 9.10 Additional Applications. References and Bibliography. Review Questions. Problems. 10 Integer Programming. 10.1 Introduction 588. INTEGER LINEAR PROGRAMMING. 10.2 Graphical Representation. 10.3 Gomory's Cutting Plane Method. 10.4 Balas' Algorithm for Zero-One Programming Problems. INTEGER NONLINEAR PROGRAMMING. 10.5 Integer Polynomial Programming. 10.6 Branch-and-Bound Method. 10.7 Sequential Linear Discrete Programming. 10.8 Generalized Penalty Function Method. 10.9 Solution of Binary Programming Problems Using MATLAB. References and Bibliography. Review Questions. Problems. 11 Stochastic Programming. 11.1 Introduction. 11.2 Basic Concepts of Probability Theory. 11.3 Stochastic Linear Programming. 11.4 Stochastic Nonlinear Programming. 11.5 Stochastic Geometric Programming. References and Bibliography. Review Questions. Problems. 12 Optimal Control and Optimality Criteria Methods. 12.1 Introduction. 12.2 Calculus of Variations. 12.3 Optimal Control Theory. 12.4 Optimality Criteria Methods. References and Bibliography. Review Questions. Problems. 13 Modern Methods of Optimization. 13.1 Introduction. 13.2 Genetic Algorithms. 13.3 Simulated Annealing. 13.4 Particle Swarm Optimization. 13.5 Ant Colony Optimization. 13.6 Optimization of Fuzzy Systems. 13.7 Neural-Network-Based Optimization. References and Bibliography. Review Questions. Problems. 14 Practical Aspects of Optimization. 14.1 Introduction. 14.2 Reduction of Size of an Optimization Problem. 14.3 Fast Reanalysis Techniques. 14.4 Derivatives of Static Displacements and Stresses. 14.5 Derivatives of Eigenvalues and Eigenvectors. 14.6 Derivatives of Transient Response. 14.7 Sensitivity of Optimum Solution to Problem Parameters. 14.8 Multilevel Optimization. 14.9 Parallel Processing. 14.10 Multiobjective Optimization. 14.11 Solution of Multiobjective Problems Using MATLAB. References and Bibliography. Review Questions. Problems. A Convex and Concave Functions. B Some Computational Aspects of Optimization. B.1 Choice of Method. B.2 Comparison of Unconstrained Methods. B.3 Comparison of Constrained Methods. B.4 Availability of Computer Programs. B.5 Scaling of Design Variables and Constraints. B.6 Computer Programs for Modern Methods of Optimization. References and Bibliography. C Introduction to MATLAB(R) . C.1 Features and Special Characters. C.2 Defining Matrices in MATLAB. C.3 CREATING m-FILES. C.4 Optimization Toolbox. Answers to Selected Problems. Index .

Engineering Optimization : Theory and Practice

Theory of Multiobjective Optimization

Survival Analysis: Techniques for Censored and Truncated Data (2nd ed.) (Book)

Operating room planning and scheduling: A literature review

Scheduling surgical specialties in a medical facility is a very complex process. The choice of schedules and resource availability impact directly on the number of patients treated by specialty, cancellations, wait times, and the overall performance of the system. In this paper we present a system-wide model developed to allow management to explore tradeoffs between OR availability, bed capacity, surgeons' booking privileges, and wait lists. We developed a mixed integer programming model to schedule surgical blocks for each specialty into ORs and applied it to the hospitals in a British Columbia Health Authority, considering OR time availability and post-surgical resource constraints. The results offer promising insights into resource optimization and wait list management, showing that without increasing post-surgical resources hospitals could handle more cases by scheduling specialties differently.

Surgical block scheduling in a system of hospitals: an application to resource and wait list management in a British Columbia health authority

The coordinated multi-item inventory problem refers to the problem of managing inventories where there is a joint fixed cost for replenishing plus an item-by-item fixed cost for each item included in the replenishment order. Given that the optimal solution is likely to be too complex, attention has focused on fixed heuristics, and in particular 'can-order' or s, c, S policies. This paper makes two contributions. First, a new lower bound on the cost of the optimal policy is proposed in order that the performance of heuristics may be measured. Second, motivated by the lower bound, a simple periodic policy is proposed and shown to be an improvement over 'can-order' policies for many data sets.

Periodic Versus Can-Order Policies for Coordinated Multi-Item Inventory Systems

This paper extends the theory of N competitive newsvendors to the case where competition occurs simultaneously in price and inventory. The basic research questions are whether the Nash equilibrium exists in this game, whether it is unique, and how the resulting inventories and prices are affected by competition. Using a novel method, we show the quasiconcavity of the competitive newsvendor's problem and establish the existence of the pure-strategy Nash equilibrium. Through a contraction mapping approach, we develop sufficient conditions for the Nash equilibrium to be unique. We then analyze the properties of the equilibrium and compare it with the optimal solution for the (noncompeting) price-sensitive newsvendor. We prove that at a symmetric equilibrium, retail prices and safety stocks strictly increase with the proportion of a newsvendor's unsatisfied customers that switch to a competitor, but strictly decrease with the intensity of price competition. Total inventories, on the other hand, increase with the intensity of price competition. Furthermore, the competitive equilibrium never has lower safety stocks and higher retail prices (a situation that definitely hurts the customers) than the solution for noncompetitive newsvendors.

Newsvendors Under Simultaneous Price and Inventory Competition

We examine age replacement and ordering decisions for a system with only one component subject to random failure and with room for only one spare in stock. The system incurs costs for replacement, shortage, holding, and breakage; the lead time for receipt of an ordered spare is constant. We consider the solvability and desirability of jointly optimizing these two traditionally separate decisions. We show that the problem has some convexity properties that make it amenable to minimization. For our data set, we find that using separate optimization gives an average loss of 3% relative to the joint minimum; about a tenth of die time the difference was more than 10%, but in general this loss can vary from zero to arbitrarily large.

Joint optimization of maintenance and inventory policies for a simple system

High surgical bed occupancy levels often result in heightened staff stress, frequent surgical cancellations, and long surgical wait times. This congestion is in part attributable to surgical scheduling practices, which often focus on the efficient use of operating rooms but ignore resulting downstream bed utilization. This paper describes a transparent and portable approach to improve scheduling practices, which combines a Monte Carlo simulation model and a mixed integer programming (MIP) model. For a specified surgical schedule, the simulation samples from historical case records and predicts bed requirements assuming no resource constraints. The MIP model complements the simulation model by scheduling both surgeon blocks and patient types to reduce peak bed occupancies. Scheduling guidelines were developed from the optimized schedules to provide surgical planners with a simple and implementable alternative to the MIP model. This approach has been tested and delivered to planners in a health authority in British Columbia, Canada. The models have been used to propose new surgical schedules and to evaluate the impact of proposed system changes on ward congestion.

Derek Atkins

Papers

Surgical block scheduling in a system of hospitals: an application to resource and wait list management in a British Columbia health authority

Periodic Versus Can-Order Policies for Coordinated Multi-Item Inventory Systems

Newsvendors Under Simultaneous Price and Inventory Competition

Joint optimization of maintenance and inventory policies for a simple system

Reducing Surgical Ward Congestion Through Improved Surgical Scheduling and Uncapacitated Simulation