Testbed

About: Testbed is a research topic. Over the lifetime, 10858 publications have been published within this topic receiving 147147 citations. The topic is also known as: test bed.

Security Testbed for Internet-of-Things Devices

Abstract: The Internet of Things (IoT) is a global ecosystem of information and communication technologies aimed at connecting any type of object (thing), at any time, and in any place, to each other and to the Internet. One of the major problems associated with the IoT is the heterogeneous nature of such deployments; this heterogeneity poses many challenges, particularly, in the areas of security and privacy. Specifically, security testing and analysis of IoT devices is considered a very complex task, as different security testing methodologies, including software and hardware security testing approaches, are needed. In this paper, we propose an innovative security testbed framework targeted at IoT devices. The security testbed is aimed at testing all types of IoT devices, with different software/hardware configurations, by performing standard and advanced security testing. Advanced analysis processes based on machine learning algorithms are employed in the testbed in order to monitor the overall operation of the IoT device under test. The architectural design of the proposed security testbed along with a detailed description of the testbed implementation is discussed. The testbed operation is demonstrated on different IoT devices using several specific IoT testing scenarios. The results obtained demonstrate that the testbed is effective at detecting vulnerabilities and compromised IoT devices.

LARIAT: Lincoln adaptable real-time information assurance testbed

Abstract: The Lincoln adaptable real-time information assurance testbed, LARIAT, is an extension of the testbed created for DARPA 1998 and 1999 intrusion detection (ID) evaluations. LARIAT supports real-time, automated and quantitative evaluations of ID systems and other information assurance (IA) technologies. Components of LARIAT generate realistic background user traffic and real network attacks, verify attack success or failure, score ID system performance, and provide a graphical user interface for control and monitoring. Emphasis was placed on making LARIAT easy to adapt, configure and run without requiring a detailed understanding of the underlying complexity. LARIAT is currently being exercised at four sites and is undergoing continued development and refinement.

An empirical characterization of IFTTT: ecosystem, usage, and performance

Abstract: IFTTT is a popular trigger-action programming platform whose applets can automate more than 400 services of IoT devices and web applications. We conduct an empirical study of IFTTT using a combined approach of analyzing data collected for 6 months and performing controlled experiments using a custom testbed. We profile the interactions among different entities, measure how applets are used by end users, and test the performance of applet execution. Overall we observe the fast growth of the IFTTT ecosystem and its increasing usage for automating IoT-related tasks, which correspond to 52% of all services and 16% of the applet usage. We also observe several performance inefficiencies and identify their causes.

Development and Application of a Real-Time Testbed for Multiagent System Interoperability: A Case Study on Hierarchical Microgrid Control

Abstract: This paper presents the development and application of a real-time testbed for multiagent system interoperability. As utility independent private microgrids are installed constantly, standardized interoperability frameworks are required to define behavioral models of the individual agents for expandability and plug-and-play operation. In this paper, we propose a comprehensive hybrid agent framework combining the foundation for intelligent physical agents (FIPAs), IEC 61850, and data distribution service (DDS) standards. The IEC 61850 logical node concept is extended using FIPA-based agent communication language with application specific attributes and deliberative behavior modeling capability. The DDS middleware is adopted to enable a real-time publisher-subscriber interoperability mechanism between platforms. The proposed multi-agent framework was validated in a laboratory-based testbed involving developed intelligent electronic device prototypes and actual microgrid setups. Experimental results were demonstrated for both decentralized and distributed control approaches. Secondary and tertiary control levels of a microgrid were demonstrated for decentralized hierarchical control case study. A consensus-based economic dispatch case study was demonstrated as a distributed control example. It was shown that the developed agent platform is industrially applicable for actual smart grid field deployment.

City of things: An integrated and multi-technology testbed for IoT smart city experiments

Abstract: While smart cities have the potential to monitor and control the city in real-time through sensors and actuators, there is still an important road ahead to evolve from isolated smart city experiments to real large-scale deployments. Important research questions remain on how and which wireless technologies should be setup for connecting the city, how the data should be analysed and how the acceptance by users of applications can be assessed. In this paper we present the City of Things testbed, which is a smart city testbed located in the city of Antwerp, Belgium to address these questions. It allows the setup and validation of new smart city experiments both at a technology and user level. City of Things consists of a multi-wireless technology network infrastructure, the capacity to easily perform data experiments on top and a living lab approach to validate the experiments. In comparison to other smart city testbeds, City of Things consists of an integrated approach, allowing experimentation on three different layers: networks, data and living lab while supporting a wide range of wireless technologies. We give an overview of the City of Things architecture, explain how researchers can perform smart city experiments and illustrate this by a case study on air quality.