scispace - formally typeset
Search or ask a question

Showing papers on "Multi-agent system published in 1997"


Journal ArticleDOI
Michael Wooldridge1
01 Jan 1997
TL;DR: The paper considers the problem of building a multi-agent system as a software engineering enterprise and discusses three issues: how agents might be specified; how these specifications might be refined or otherwise transformed into efficient implementations: and how implemented agents and multi- agent systems might subsequently be verified, to show that they are correct with respect to their specifications.
Abstract: The technology of intelligent agents and multi-agent systems is expected to alter radically the way in which complex, distributed, open systems are conceptualised and implemented. The paper considers the problem of building a multi-agent system as a software engineering enterprise. Three issues are focused on: how agents might be specified; how these specifications might be refined or otherwise transformed into efficient implementations: and how implemented agents and multi-agent systems might subsequently be verified, to show that they are correct with respect to their specifications. These issues are discussed with reference to a number of case studies. The paper concludes by setting out some issues and open problems for future research.

1,347 citations


Journal ArticleDOI
TL;DR: This paper summarizes several studies of such systems, and derives a set of general principles that artificial multi-agent systems can use to support overall system behavior significantly more complex than the behavior of the individuals agents.
Abstract: Agent architectures need to organize themselves and adapt dynamically to changing circumstances without top-down control from a system operator. Some researchers provide this capability with complex agents that emulate human intelligence and reason explicitly about their coordination, reintroducing many of the problems of complex system design and implementation that motivated increasing software localization in the first place. Naturally occurring systems of simple agents (such as populations of insects or other animals) suggest that this retreat is not necessary. This paper summarizes several studies of such systems, and derives from them a set of general principles that artificial multi-agent systems can use to support overall system behavior significantly more complex than the behavior of the individuals agents.

504 citations


Journal ArticleDOI
TL;DR: A formulation of reinforcement learning that enables learning in noisy, dynamic environments such as in the complex concurrent multi-robot learning domain and experimentally validate the approach on a group of four mobile robots learning a foraging task.
Abstract: This paper describes a formulation of reinforcement learning that enables learning in noisy, dynamic environments such as in the complex concurrent multi-robot learning domain. The methodology involves minimizing the learning space through the use of behaviors and conditions, and dealing with the credit assignment problem through shaped reinforcement in the form of heterogeneous reinforcement functions and progress estimators. We experimentally validate the approach on a group of four mobile robots learning a foraging task.

488 citations


Journal ArticleDOI
TL;DR: A normative, application- and protocol-independent theory of coalitions among bounded-rational agents is devised, and the optimal coalition structure and its stability are significantly affected by the agents' algorithms' performance profiles and the cost of computation.

472 citations


Journal ArticleDOI
TL;DR: This paper discusses an example of the application of a high-level modelling framework which supports both the specification and implementation of a system's conceptual design, and an operational multi-agent system which manages an electricity transportation network for a Spanish electricity utility.
Abstract: This paper discusses an example of the application of a high-level modelling framework which supports both the specification and implementation of a system's conceptual design. This framework, DESIRE (framework for DEsign and Specification of Interacting REasoning components), explicitly models the knowledge, interaction, and coordination of complex tasks and reasoning capabilities in agent systems. For the application domain addressed in this paper, an operational multi-agent system which manages an electricity transportation network for a Spanish electricity utility, a comprehensible specification is presented.

329 citations


Book ChapterDOI
24 Jul 1997
TL;DR: An agent-oriented methodology called MAS-CommonKADS is proposed, which extends the knowledge engineering methodology CommonKADS with techniques from objectoriented and protocol engineering methodologies and develops a case study.
Abstract: This article proposes an agent-oriented methodology called MAS-CommonKADS and develops a case study. This methodology extends the knowledge engineering methodology CommonKADS with techniques from objectoriented and protocol engineering methodologies. The methodology consists of the development of seven models: Agent Model, that describes the characteristics of each agent; Task Model, that describes the tasks that the agents carry out; Expertise Model, that describes the knowledge needed by the agents to achieve their goals; Organisation Model, that describes the structural relationships between agents (software agents and/or human agents); Coordination Model, that describes the dynamic relationships between software agents; Communication Model, that describes the dynamic relationships between human agents and their respective personal assistant software agents; and Design Model, that refines the previous models and determines the most suitable agent architecture for each agent, and the requirements of the agent network.

259 citations


Proceedings Article
27 Jul 1997
TL;DR: Ultimately, this dissertation demonstrates that by learning portions of their cognitive processes, selectively communicating, and coordinating their behaviors via common knowledge, a group of independent agents can work towards a common goal in a complex, real-time, noisy, collaborative, and adversarial environment.
Abstract: Multi-agent systems in complex, real-time domains require agents to act effectively both autonomously and as part of a team. This dissertation addresses multi-agent systems consisting of teams of autonomous agents acting in real-time, noisy, collaborative, and adversarial environments. Because of the inherent complexity of this type of multi-agent system, this thesis investigates the use of machine learning within multi-agent systems. The dissertation makes four main contributions to the fields of Machine Learning and Multi-Agent Systems. First, the thesis defines a team member agent architecture within which a flexible team structure is presented, allowing agents to decompose the task space into flexible roles and allowing them to smoothly switch roles while acting. Team organization is achieved by the introduction of a locker-room agreement as a collection of conventions followed by all team members. It defines agent roles, team formations, and pre-compiled multi-agent plans. In addition, the team member agent architecture includes a communication paradigm for domains with single-channel, low-bandwidth, unreliable communication. The communication paradigm facilitates team coordination while being robust to lost messages and active interference from opponents. Second, the thesis introduces layered learning, a general-purpose machine learning paradigm for complex domains in which learning a mapping directly from agents' sensors to their actuators is intractable. Given a hierarchical task decomposition, layered learning allows for learning at each level of the hierarchy, with learning at each level directly affecting learning at the next higher level. Third, the thesis introduces a new multi-agent reinforcement learning algorithm, namely team-partitioned, opaque-transition reinforcement learning (TPOT-RL). TPOT-RL is designed for domains in which agents cannot necessarily observe the state changes when other team members act. It exploits local, action-dependent features to aggressively generalize its input representation for learning and partitions the task among the agents, allowing them to simultaneously learn collaborative policies by observing the long-term effects of their actions. Fourth, the thesis contributes a fully functioning multi-agent system that incorporates learning in a real-time, noisy domain with teammates and adversaries. Detailed algorithmic descriptions of the agents' behaviors as well as their source code are included in the thesis. Empirical results validate all four contributions within the simulated robotic soccer domain. The generality of the contributions is verified by applying them to the real robotic soccer, and network routing domains. Ultimately, this dissertation demonstrates that by learning portions of their cognitive processes, selectively communicating, and coordinating their behaviors via common knowledge, a group of independent agents can work towards a common goal in a complex, real-time, noisy, collaborative, and adversarial environment.

249 citations


Journal ArticleDOI
TL;DR: The Gala system is described, an implemented system that allows the specification and efficient solution of large imperfect information games and provides a new declarative language for compactly and naturally representing games by their rules.

208 citations


Journal ArticleDOI
01 Jan 1997
TL;DR: An overview of a diverse range of applications where multi-agent systems promise to create a great impact in this domain is given and two applications under development at Daimler-Benz Research are described in some detail.
Abstract: Agent-oriented techniques offer a new approach to support the whole software development process. All the phases in the software development process are treated with a single uniform concept, namely that of agents, and a system modelled by a collection of agents is called a multi-agent system. AOTs as a new advance in information technology can help to respond to the growing interest in making traffic and transportation more efficient, resource-saving and ecological. The authors give an overview of a diverse range of applications where multi-agent systems promise to create a great impact in this domain. To demonstrate the ideas behind AOTs and their applicability in this domain, two applications under development at Daimler-Benz Research are described in some detail.

197 citations


Proceedings ArticleDOI
08 Feb 1997
TL;DR: Challenger as mentioned in this paper is a multiagent system that performs completely distributed resource allocation, consisting of agents which individually manage local resources; these agents communicate with one another to share their resources (in this particular instance, CPU time) in an attempt to more efficient utilize them.
Abstract: In this paper we introduce Challenger, a multiagent system that performs completely distributed resource allocation. Challenger consists of agents which individually manage local resources; these agents communicate with one another to share their resources (in this particular instance, CPU time) in an attempt to more e ciently utilize them. By endowing the agents with relatively simple behaviors which rely on only locally available information, desirable global system objectives can be obtained, such as minimization of mean job ow time. Challenger is similar to other market-based control systems in that the agents act as buyers and sellers in a marketplace, always trying to maximize their own utility. The results of several simulations of Challenger performing CPU load balancing in a network of computers are presented. The main contribution of this research is the addition of learning to the agents, which allows Challenger to perform better under a wider range of conditions than other systems for distributed processor allocation, such as Malone's Enterprise [Mal88].

197 citations


Journal ArticleDOI
TL;DR: This was a lively panel which dealt with the following main issues: cooperation, cooperation, and the centrality of the issue.
Abstract: Cooperation is often presented as one of the key concepts which differentiates multi-agent systems from other related disciplines such as distributed computing, object-oriented systems, and expert systems. However, it is a concept whose precise usage in agent-based systems is at best unclear and at worst highly inconsistent. Given the centrality of the issue, and the different ideological viewpoints on the subject, this was a lively panel which dealt with the following main issues.

Journal ArticleDOI
TL;DR: In this paper it is shown how several modifications of rules and parameters alter further the spatial and hierarchical structure of the simulated urban system.
Abstract: SIMPOP is a knowledge-based simulation system for the description of the evolution of settlement patterns over long time periods. Rules and parameters are introduced into a multiagent systems formalism where each settlement is considered as a separate entity interacting with the others and transforming itself. The rules may allow for the simulation of the ‘urban transition’ from a set of homogeneous, agriculture-oriented, and scattered villages into a complex system of functionnally diverse, competing, and hierarchised urban settlements. In this paper we show how several modifications of rules and parameters alter further the spatial and hierarchical structure of the simulated urban system.

Journal ArticleDOI
01 Nov 1997
TL;DR: This paper develops a multi-agent distributed system infrastructure, RETSINA (REusable Task Structure-based Intelligent Network Agents) that handles adaptation in an open Internet environment and focuses on the adaptive architecture of the information agents.
Abstract: Adaptation in open, multi-agent information gathering systems is important for several reasons. These reasons include the inability to accurately predict future problem-solving workloads, future changes in existing information requests, future failures and additions of agents and data supply resources, and other future task environment characteristic changes that require system reorganization. We have developed a multi-agent distributed system infrastructure, RETSINA (REusable Task Structure-based Intelligent Network Agents) that handles adaptation in an open Internet environment. Adaptation occurs both at the individual agent level as well as at the overall agent organization level. The RETSINA system has three types of agents. Interface agents interact with the user receiving user specifications and delivering results. They acquire, model, and utilize user preferences to guide system coordination in support of the user‘s tasks. Task agents help users perform tasks by formulating problem solving plans and carrying out these plans through querying and exchanging information with other software agents. Information agents provide intelligent access to a heterogeneous collection of information sources. In this paper, we concentrate on the adaptive architecture of the information agents. We use as the domain of application WARREN, a multi-agent financial portfolio management system that we have implemented within the RETSINA framework.

Journal ArticleDOI
TL;DR: This work explains how the scheduling strategy is shared out between agents, how each agent performs a local dynamic scheduling by selecting an adequate dispatching rule, and how agents can coordinate their actions to perform a global dynamic scheduling of the manufacturing system.
Abstract: The proposed scheduling strategy is based on a multi-agent architecture. Each agent of this architecture is dedicated to a work centre (i.e. a set of resources of the manufacturing system); it selects locally and dynamically the most suitable dispatching rules. Depending on local and global considerations, a new selection is carried out each time a predefined event occurs (for example, a machine becomes available, or a machine breaks down). The selection depends on: (1) primary and secondary performance objectives, (2) the operating conditions, and (3) an analysis of the system state, which aims to detect particular symptoms from the values of certain system variables. We explain how the scheduling strategy is shared out between agents, how each agent performs a local dynamic scheduling by selecting an adequate dispatching rule, and how agents can coordinate their actions to perform a global dynamic scheduling of the manufacturing system. Each agent can be implemented through object-oriented formalisms. The selection method is improved through the optimization of the numerical thresholds used in the detection of symptoms. This approach is compared with the use of SPT, SIX, MOD, CEXSPT and CR/SPT on a jobshop problem, already used in other research works. The results indicate significant improvements.

Book ChapterDOI
24 Jul 1997
TL;DR: In this article, the authors describe the need for system modelling techniques that permit their complexity to be effectively managed, and principled methodologies to guide the process of system design, without adequate techniques to support the design process, such systems will not be sufficiently reliable, maintainable or extensible, will be difficult to comprehend, and their elements will be re-usable.
Abstract: Agent technologies are now being applied to the development of large-scale commercial and industrial software systems. Such systems are complex, involving hundreds, perhaps thousands of agents, and there is a pressing need for system modelling techniques that permit their complexity to be effectively managed, and principled methodologies to guide the process of system design. Without adequate techniques to support the design process, such systems will not be sufficiently reliable, maintainable or extensible, will be difficult to comprehend, and their elements will not be re-usable.

Journal ArticleDOI
TL;DR: In this article, a bidding-based approach to the integration of computer-aided design, process planning and real-time scheduling is described, where a product is represented in a STEP model with detailed design and administrative information including design specifications, batch size, and due dates.

Journal ArticleDOI
TL;DR: The state of the art in multiagent systems is surveyed, through examples of projects and techniques, and then several questions that elicit the requirements and goals of a proposed multiagent design application are presented.
Abstract: Knowledge based design integrates a broad range of highly specialized knowledge from expert sources to synthesize or refine a design. Knowledge-based design systems automate at least some of these knowledge sources. However, the constant evolution of standards, technologies, and a dynamic marketplace demands a high degree of adaptability in both design expertise and in the process of applying that expertise. The need for diverse, highly sophisticated, and rapidly changing skills and knowledge makes the multiagent paradigm particularly appropriate for knowledge-based design. As researchers apply multiagent technologies to design domains, challenges include supporting interoperability among heterogeneous agents on diverse platforms, coordinating the design process, and managing conflict. This article surveys the state of the art in multiagent systems, through examples of projects and techniques, and then presents several questions that elicit the requirements and goals of a proposed multiagent design application.

Journal ArticleDOI
TL;DR: This article describes first steps towards the formal specification and verification of multi-agent systems, through the use of temporal belief logics, and develops a logic that may be used to reason about Concurrent METATEM systems.
Abstract: This article describes first steps towards the formal specification and verification of multi-agent systems, through the use of temporal belief logics. The article first describes Concurrent METATEM, a multi-agent programming language, and then develops a logic that may be used to reason about Concurrent METATEM systems. The utility of this logic for specifying and verifying Concurrent METATEM systems is demonstrated through a number of examples. The article concludes with a brief discussion on the wider implications of the work, and in particular on the use of similar logics for reasoning about multi-agent systems in general.

Journal ArticleDOI
01 Jan 1997
TL;DR: The features of complex information-carrying environments and the information-gathering task are examined, demonstrating both the utility of viewing information-Gathering as distributed problem-solving and difficulties with viewing it as distributed processing.
Abstract: Two approaches to the problem of information-gathering, that may be characterised as distributed processing and distributed problem-solving, are contrasted. The former is characteristic of most existing information-gathering systems, and the latter is central to research in multi-agent systems. The features of complex information-carrying environments and the information-gathering task are examined, demonstrating both the utility of viewing information-gathering as distributed problem-solving and difficulties with viewing it as distributed processing. A new approach is proposed to information-gathering based on the distributed problem-solving paradigm and its attendant body of research in multi-agent systems and distributed artificial intelligence. This approach, called cooperative information-gathering, involves concurrent, asynchronous discovery and composition of information spread across a network of information servers. Top-level queries drive the creation of partially elaborated information-gathering plans, resulting in the employment of multiple semi-autonomous cooperative agents for the purpose of achieving goals and subgoals within those plans. The system as a whole satisfies, trading off solution quality and search cost while respecting user-imposed deadlines. Current work on distributed and agent-based approaches to information-gathering is also surveyed.

Journal ArticleDOI
TL;DR: A new multi-criteria conceptual framework mainly based on the definition and the use of projection plans emerging from principal component analysis (PCA) already proposed in a single decision maker context in extension of the Promethee method is presented.

Book
30 Sep 1997
TL;DR: The IMAHDA Revisited, a meta-modelling framework for knowledge discovery and data mining in the Animal Domain, and the RTAPS Implementation, a model for the design and implementation of this system, are Revisited.
Abstract: Preface. 1. Why Intelligent Hybrid Systems. 2. Methodologies. 3. Intelligent Fusion and Transformation Systems. 4. Intelligent Combination Systems. 5. Knowledge Discovery, Data Mining and Hybrid Systems. 6. Association Systems - Task Structure Level Associative Hybrid Architecture. 7. Intelligent Multi-Agent Hybrid Computational Architecture - Part I. 8. Intelligent Multi-Agent Hybrid Computational Architecture - Part II. 9. Alarm Processing - An Application of IMAHDA. 10. Agent Oriented Analysis and Design of the RTAPS - Part I. 11. Agent Oriented Analysis and Design of the RTAPS - Part II. 12. RTAPS Implementation. 13. From Data Repositories to Knowledge Repositories. 14. IMAHDA Revisited. Appendices: A. Input Features of the Animal Domain. B. Classes in the Animal Domain. C. TTS Power Network. D. TTS Substation Power Network. E. Real Time Alarm Data. Index.

Book ChapterDOI
23 Jun 1997
TL;DR: Based on Y. Shoham's paradigm, multi-agent-systems are presented as a specialization of distributed, Object-Oriented systems, equipped with knowledge, general concurrent inference mechanisms dealing with this knowledge, and a declarative agent program.
Abstract: Based on Y. Shoham's paradigm, called Agent-Oriented Programming (AOP), multi-agent-systems are presented as a specialization of distributed, Object-Oriented systems. Equipped with knowledge, general concurrent inference mechanisms dealing with this knowledge, and a declarative agent program, these multi-agent-systems are intended to be a foundation of a new approach uniting advantages of many contributing areas: The precise semantics of Petri nets, the abstraction and encapsulation proposed in Object-Oriented approaches, and the power of logic programming, making it easy to adopt well-known AI-methods. As an example, an urban traffic information system will be designed which solves path searching problems in a distributed graph.

Journal ArticleDOI
01 May 1997
TL;DR: A general framework for building a distributed strategic decision support system (DSDSS) which integrates both advances in distributed decision making and distributed artificial intelligence is presented.
Abstract: Recent advances in artificial intelligence, particularly in the field of multi-agent theory, offer great promises in modeling strategic planning processes. In this domain, the ability to introduce distinct cognitive agents which cooperate to solve the problem enables the processing of more complex and ill-structured problems. This paper presents a general framework for building a distributed strategic decision support system (DSDSS) which integrates both advances in distributed decision making and distributed artificial intelligence. It goes on to describe a cooperative and distributed system with two specific features: the users intervene as human agents in the solution formation, and strategic knowledge and domain knowledge are distributed in different agents which communicate through various blackboards and message passing. An example is provided in the field of strategic marketing which illustrates how the system operates.

Journal ArticleDOI
TL;DR: This work investigates the semantic foundations of a method for modeling agents as entities with a mental state which was suggested by McCarthy and by Newell, and proposes a basic model in which the agent is viewed as a qualitative decision maker with beliefs, preferences, and a decision strategy.

Journal ArticleDOI
TL;DR: Looking at how cooperative multiagent systems designed for monitoring and diagnosing real-time nuclear power plant failures can help operators better anticipate operational problems.
Abstract: Looks at how cooperative multiagent systems designed for monitoring and diagnosing real-time nuclear power plant failures can help operators better anticipate operational problems.

Book ChapterDOI
01 Sep 1997
TL;DR: The notion of programmable coordination medium is proposed as an abstraction provided by the coordination model around which the global behaviour of a coordination architecture can be designed.
Abstract: The design, development and maintenance of multi-component software systems often suffer from the lack of suitable coordination abstractions. The aim of this paper is to show the benefits of coordination models based on global communication abstractions whose behaviour is not fixed, but is extensible so as to accomplish the intended behaviour of the whole system. Accordingly, we propose the notion of programmable coordination medium as an abstraction provided by the coordination model around which the global behaviour of a coordination architecture can be designed. As an example, we show how a Linda-based approach can be empowered by exploiting the notion of programmable tuple space, as supported by the ACLT coordination model.

Journal ArticleDOI
TL;DR: In the field of multi-agent systems as mentioned in this paper, the goal is to build systems capable of flexible autonomous decision making, with societies of such systems cooperating with one-another, but it is often not obvious what such theories should represent and what role the theory is intended to play.
Abstract: As computer scientists, our goals are motivated by the desire to improve computer systems in some way: making them easier to design and implement, more robust and less prone to error, easier to use, faster, cheaper, and so on. In the field of multi-agent systems, our goal is to build systems capable of flexible autonomous decision making, with societies of such systems cooperating with one-another. There is a lot of formal theory in the area but it is often not obvious what such theories should represent and what role the theory is intended to play. Theories of agents are often abstract and obtuse and not related to concrete computational models.

Journal ArticleDOI
01 Sep 1997
TL;DR: This status report will introduce the field of multi-agent systems and its design, and a brief discussion about the multi- agent design approaches will be given, the missing correlations to the task definitions will be critizised, and further research directions will be proposed.
Abstract: The term “ agent ” has became a buzzword these days, not only in academic circles, but also in some computer magazines and application fields of computer science like manufacturing and logistics. Hence, there is a pressing need for a design methodology for multi-agent systems. Or even stronger, there is a demand for an agent engineering technology, which includes computer assistance during the design phases, for the validation of the designed system, and for the implementation of the multi-agent system as a physically distributed system. This status report will introduce the field of multi-agent systems and its design. Three prominent applications will serve as a first motivation of the theme. Based on the ideas of the agent examples a discussion on the term agent will serve as a first motivation of the theme. Based of the theme. Based on the ideas of the agent architecture of an agent, its communication capabilities, and planning in a multi-agent context. After this broad technical introduction the main topic of this work will be tackled. An introduction to five methodologies for the design of multi-agent systems will be given and a new one, the AWIC method, will be presented. Eventually a brief discussion about the multi-agent design approaches will be given, the missing correlations to the task definitions will be critizised, and further research directions will be proposed.

Book ChapterDOI
13 May 1997
TL;DR: This work proposes a definition of commitments that applies especially well to agents in information-rich applications, such as electronic commerce and virtual enterprises and shows how commitments are acquired by agents as a consequence of adopting a role.
Abstract: Commitments are crucial to understanding and designing autonomous agents and multiagent systems. We propose a definition of commitments that applies especially well to agents in information-rich applications, such as electronic commerce and virtual enterprises. Our approach has a number of important features, including not gratuitously translating social concepts to psychological concepts distinguishing between satisfied and inapplicable commitments incorporating social policies to handle the creation, satisfaction, and cancelation of commitments relating commitments to organizational structure in a multiagent system showing how commitments are acquired by agents as a consequence of adopting a role.

Book ChapterDOI
05 May 1997
TL;DR: In order to promote standardisation of modelling methodology, this paper presents a first-cut reference model whose feasibility will subsequently be demonstrated by a number of applications.
Abstract: There is currently a multitude of design approaches all concerned with building simulation models for multi-agent systems. The majority of the designs, however, focus on the requirements of specific application domains. We suggest that it would be desirable to develop a modelling methodology which can act as a generic platform from which to construct simulation models for multi-agent systems. In order to promote standardisation of modelling methodology, this paper presents a first-cut reference model whose feasibility will subsequently be demonstrated by a number of applications.