Machine Learning is the study of methods for programming computers to learn. Computers are applied to a wide range of tasks, and for most of these it is relatively easy for programmers to design and implement the necessary software. However, there are many tasks for which this is difficult or impossible. These can be divided into four general categories. First, there are problems for which there exist no human experts. For example, in modern automated manufacturing facilities, there is a need to predict machine failures before they occur by analyzing sensor readings. Because the machines are new, there are no human experts who can be interviewed by a programmer to provide the knowledge necessary to build a computer system. A machine learning system can study recorded data and subsequent machine failures and learn prediction rules. Second, there are problems where human experts exist, but where they are unable to explain their expertise. This is the case in many perceptual tasks, such as speech recognition, hand-writing recognition, and natural language understanding. Virtually all humans exhibit expert-level abilities on these tasks, but none of them can describe the detailed steps that they follow as they perform them. Fortunately, humans can provide machines with examples of the inputs and correct outputs for these tasks, so machine learning algorithms can learn to map the inputs to the outputs. Third, there are problems where phenomena are changing rapidly. In finance, for example, people would like to predict the future behavior of the stock market, of consumer purchases, or of exchange rates. These behaviors change frequently, so that even if a programmer could construct a good predictive computer program, it would need to be rewritten frequently. A learning program can relieve the programmer of this burden by constantly modifying and tuning a set of learned prediction rules. Fourth, there are applications that need to be customized for each computer user separately. Consider, for example, a program to filter unwanted electronic mail messages. Different users will need different filters. It is unreasonable to expect each user to program his or her own rules, and it is infeasible to provide every user with a software engineer to keep the rules up-to-date. A machine learning system can learn which mail messages the user rejects and maintain the filtering rules automatically. Machine learning addresses many of the same research questions as the fields of statistics, data mining, and psychology, but with differences of emphasis. Statistics focuses on understanding the phenomena that have generated the data, often with the goal of testing different hypotheses about those phenomena. Data mining seeks to find patterns in the data that are understandable by people. Psychological studies of human learning aspire to understand the mechanisms underlying the various learning behaviors exhibited by people (concept learning, skill acquisition, strategy change, etc.).

Machine learning

The Compact Muon Solenoid (CMS) detector is described. The detector operates at the Large Hadron Collider (LHC) at CERN. It was conceived to study proton-proton (and lead-lead) collisions at a centre-of-mass energy of 14 TeV (5.5 TeV nucleon-nucleon) and at luminosities up to 10(34)cm(-2)s(-1) (10(27)cm(-2)s(-1)). At the core of the CMS detector sits a high-magnetic-field and large-bore superconducting solenoid surrounding an all-silicon pixel and strip tracker, a lead-tungstate scintillating-crystals electromagnetic calorimeter, and a brass-scintillator sampling hadron calorimeter. The iron yoke of the flux-return is instrumented with four stations of muon detectors covering most of the 4 pi solid angle. Forward sampling calorimeters extend the pseudo-rapidity coverage to high values (vertical bar eta vertical bar <= 5) assuring very good hermeticity. The overall dimensions of the CMS detector are a length of 21.6 m, a diameter of 14.6 m and a total weight of 12500 t.

/pdf/the-cms-experiment-at-the-cern-lhc-4d2umuzboo.pdf

The CMS experiment at the CERN LHC

An Introduction to MultiAgent Systems.

The Smart Grid, regarded as the next generation power grid, uses two-way flows of electricity and information to create a widely distributed automated energy delivery network. In this article, we survey the literature till 2011 on the enabling technologies for the Smart Grid. We explore three major systems, namely the smart infrastructure system, the smart management system, and the smart protection system. We also propose possible future directions in each system. colorred{Specifically, for the smart infrastructure system, we explore the smart energy subsystem, the smart information subsystem, and the smart communication subsystem.} For the smart management system, we explore various management objectives, such as improving energy efficiency, profiling demand, maximizing utility, reducing cost, and controlling emission. We also explore various management methods to achieve these objectives. For the smart protection system, we explore various failure protection mechanisms which improve the reliability of the Smart Grid, and explore the security and privacy issues in the Smart Grid.

/pdf/smart-grid-the-new-and-improved-power-grid-a-survey-4jypbbgv3j.pdf

Smart Grid — The New and Improved Power Grid: A Survey

Smart Grid - The New and Improved Power Grid:

A cyber-physical system is a large and complex infrastructure. Due to the increasing connectivity, the power and cyber systems become more interdependent. Models of the interactions are needed between the power devices and information and communication technology (ICT). A broad range of cyber attacks has become a serious concern. Cyber attacks must be simulated to analyze the consequences on the power grid. Thus, the cyber system must be modeled explicitly and integrated with the power grid model. This paper describes the development and simulation of a novel co-simulation framework that integrates both the cyber and power systems. The objective is to implement the ICT model for real-time interactions with both the power grid and transmission operator. Different industrial grade environments have been developed to simulate the cyber-power interactions. ICT events that may affect the stability of the grid, e.g., cyber attacks, are simulated at the cyber system layer, and their impact analysis is conducted at the power system layer. The proposed co-simulation framework is validated with the IEEE 39-bus system.

ICT modeling for integrated simulation of cyber-physical power systems

A major outage in the electricity distribution system may affect the operation of water and natural gas supply systems, leading to an interruption of multiple services to critical customers. Therefore, enhancing resilience of critical infrastructures requires joint efforts of multiple sectors. In this paper, a distribution system service restoration method considering the electricity-water-gas interdependency is proposed. The objective is to provide electricity, water, and natural gas supplies to critical customers in the desired ratio according to their needs after an extreme event. The operational constraints of electricity, water, and natural gas networks are considered. The characteristics of electricity-driven coupling components, including water pumps and gas compressors, are also modeled. Relaxation techniques are applied to nonconvex constraints posed by physical laws of those networks. Consequently, the restoration problem is formulated as a mixed-integer second-order cone program, which can readily be solved by the off-the-shelf solvers. The proposed method is validated by numerical simulations on electricity-water-gas integrated systems, developed based on benchmark models of the subsystems. The results indicate that considering the interdependency refines the allocation of limited generation resources and demonstrate the exactness of the proposed convex relaxation.

Resilience-Motivated Distribution System Restoration Considering Electricity-Water-Gas Interdependency

Resilience of a distribution system can be enhanced by efficient restoration of critical load following a major outage. Existing models include optimization approaches that consider available information without incorporating the inherent asynchrony of data arrival during execution of the restoration plan. Failure to consider the asynchronous nature of information arrival can lead to underutilization of critical resources. Moreover, analytical models become computationally inefficient for large scale systems. On the other hand, artificial intelligence (AI)-based tools have demonstrated efficient results for power system applications. In this paper, it is proposed a Reinforcement Learning (RL) model that learns how to efficiently restore a distribution system after a major outage. The proposed approach is based on a Monte Carlo Tree Search to expedite the training process. The proposed model strategy provides a robust decision-making tool for asynchronous and partial information scenarios. The results, validated with the IEEE 13-bus test feeder and IEEE 8500-node distribution test feeder, demonstrate the effectiveness and scalability of the proposed method.

Distribution System Resilience Under Asynchronous Information Using Deep Reinforcement Learning

Power system restoration is important for system planning and operation. It enables a grid to be restored from major outages efficiently and safely. The restoration process can be divided to three stages: starting generators, establishing transmission network, and restoring load services. After determining the start-up sequence of generating units, it is critical to find the shortest transmission path to energize transmission network using cranking power from available generators. This paper identified a set of logical constraints for transmission network energization, and formulated the transmission path search as a Mixed Integer Linear Programming (MILP) problem. These constraints could be easily incorporated with other restoration actions such as starting up generating units. Simulation results based on IEEE 39-bus test case demonstrate that the proposed MILP-based transmission path search algorithm is highly efficient and the restoration duration is significantly reduced.

/pdf/optimal-transmission-path-search-in-power-system-restoration-55r44cfa8a.pdf

Optimal transmission path search in power system restoration

There has not been an organized way to efficiently correlate anomaly behaviors in critical infrastructures as information about malicious activities are not gathered from geographically dispersed cyber systems. This paper establishes a systematic approach to identify properties that can be extracted to detect malicious activities in the cyber-based control systems. The malicious detection can be implemented through an on-line anomaly inference system in order to improve situational awareness. In this preliminary investigation, a methodology to infer anomaly is proposed for power systems, representing the anomalous cyber- or power-related events among substation networks.

Chen-Ching Liu

Papers

ICT modeling for integrated simulation of cyber-physical power systems

Resilience-Motivated Distribution System Restoration Considering Electricity-Water-Gas Interdependency

Distribution System Resilience Under Asynchronous Information Using Deep Reinforcement Learning

Optimal transmission path search in power system restoration

Anomaly extraction and correlations for power infrastructure cyber systems