In this overview paper we motivate the need for and research issues arising from a new model of data processing. In this model, data does not take the form of persistent relations, but rather arrives in multiple, continuous, rapid, time-varying data streams. In addition to reviewing past work relevant to data stream systems and current projects in the area, the paper explores topics in stream query languages, new requirements and challenges in query processing, and algorithmic issues.

/pdf/models-and-issues-in-data-stream-systems-3aa6f5lsfv.pdf

Models and issues in data stream systems

The paradigmatic shift from a Web of manual interactions to a Web of programmatic interactions driven by Web services is creating unprecedented opportunities for the formation of online business-to-business (B2B) collaborations. In particular, the creation of value-added services by composition of existing ones is gaining a significant momentum. Since many available Web services provide overlapping or identical functionality, albeit with different quality of service (QoS), a choice needs to be made to determine which services are to participate in a given composite service. This paper presents a middleware platform which addresses the issue of selecting Web services for the purpose of their composition in a way that maximizes user satisfaction expressed as utility functions over QoS attributes, while satisfying the constraints set by the user and by the structure of the composite service. Two selection approaches are described and compared: one based on local (task-level) selection of services and the other based on global allocation of tasks to services using integer programming.

/pdf/qos-aware-middleware-for-web-services-composition-x57gs4mhme.pdf

QoS-aware middleware for Web services composition

This paper proposes COPE, a new architecture for wireless mesh networks. In addition to forwarding packets, routers mix (i.e., code) packets from different sources to increase the information content of each transmission. We show that intelligently mixing packets increases network throughput. Our design is rooted in the theory of network coding. Prior work on network coding is mainly theoretical and focuses on multicast traffic. This paper aims to bridge theory with practice; it addresses the common case of unicast traffic, dynamic and potentially bursty flows, and practical issues facing the integration of network coding in the current network stack. We evaluate our design on a 20-node wireless network, and discuss the results of the first testbed deployment of wireless network coding. The results show that using COPE at the forwarding layer, without modifying routing and higher layers, increases network throughput. The gains vary from a few percent to several folds depending on the traffic pattern, congestion level, and transport protocol.

/pdf/xors-in-the-air-practical-wireless-network-coding-17k31b3st4.pdf

XORs in the air: practical wireless network coding

We discuss the design of an acquisitional query processor for data collection in sensor networks. Acquisitional issues are those that pertain to where, when, and how often data is physically acquired (sampled) and delivered to query processing operators. By focusing on the locations and costs of acquiring data, we are able to significantly reduce power consumption over traditional passive systems that assume the a priori existence of data. We discuss simple extensions to SQL for controlling data acquisition, and show how acquisitional issues influence query optimization, dissemination, and execution. We evaluate these issues in the context of TinyDB, a distributed query processor for smart sensor devices, and show how acquisitional techniques can provide significant reductions in power consumption on our sensor devices.

/pdf/tinydb-an-acquisitional-query-processing-system-for-sensor-2akih312yn.pdf

TinyDB: an acquisitional query processing system for sensor networks

Sensor networks with battery-powered nodes can seldom simultaneously meet the design goals of lifetime, cost, sensing reliability and sensing and transmission coverage. Energy-harvesting, converting ambient energy to electrical energy, has emerged as an alternative to power sensor nodes. By exploiting recharge opportunities and tuning performance parameters based on current and expected energy levels, energy harvesting sensor nodes have the potential to address the conflicting design goals of lifetime and performance. This paper surveys various aspects of energy harvesting sensor systems- architecture, energy sources and storage technologies and examples of harvesting-based nodes and applications. The study also discusses the implications of recharge opportunities on sensor node operation and design of sensor network solutions.

Energy Harvesting Sensor Nodes: Survey and Implications

802.11 has been used well beyond its original intended use of WLANs. Of particular interest to us in this paper is its use in long-distance mesh networks being designed/used for low-cost rural connectivity. We describe in detail a new MAC protocol, called 2P, that is suited for such networks in terms of efficiency. A significant challenge here is the implementation of this protocol on top of off-the-shelf 802.11 hardware, to preserve the cost benefits. We show how this can be achieved, by exploiting the flexibilities available within Prism2-based chipsets. We then present the dependence of 2P on the network topology, and show that it is indeed possible to design in practice, network topologies compatible with 2P. We describe experimental as well as simulation-based evaluations of 2P, and show that 2P achieves significant performance improvement (as much as 20 times more throughput) over 802.11 CSMA/CA in long-distance mesh networks.

Design and evaluation of a new MAC protocol for long-distance 802.11 mesh networks

Monitoring road and traffic conditions in a city is a problem widely studied. Several methods have been proposed towards addressing this problem. Several proposed techniques require dedicated hardware such as GPS devices and accelerometers in vehicles [7][15][8] or cameras on roadside and near traffic signals [13]. All such methods are expensive in terms of monetary cost and human effort required. We propose Wolverine1 - a non-intrusive method that uses sensors present on smartphones. We extend a prior study [12] to improve the algorithm based on using accelerometer, GPS and magnetometer sensor readings for traffic and road conditions detection. We are specifically interested in identifying braking events - frequent braking indicates congested traffic conditions - and bumps on the roads to characterize the type of road. We evaluate the effectiveness of the proposed method based on experiments conducted on the roads in Mumbai, with promising results.

/pdf/wolverine-traffic-and-road-condition-estimation-using-1wml9whzmo.pdf

Wolverine: Traffic and road condition estimation using smartphone sensors

The use of 802.11 long-distance links is a cost-effective means of providing wireless connectivity to rural areas. Although deployments in this setting are increasing, a systematic study of the performance of 802.11 in these settings is lacking. The contributions of this paper are two-fold: (a)we present a detailed performance study of a set of long-distance 802.11b links at various layers of the network stack, and (b)we document the various non-obvious experiences during our study.Our study includes eight long-distance links, ranging from 1km to 37km in length. Unlike prior studies of outdoor 802.11 links, we find that the error rate as a function of the received signal strength behaves close to theory. Time correlation of any packet errors is negligible across a range of time-scales. We have observed at least one of the link to be robust to rain and fog. But any interference on the long-distance links can be detrimental to performance. Apart from this however, such long-distance links can be planned to work well with predictable performance. During our measurements, we have observed a few hardware/driver quirks as well as system bottlenecks apart from the wireless link itself. We believe that our measurements and the documentation of our experience will help future network planning as well as protocol design for these networks.

/pdf/long-distance-802-11b-links-performance-measurements-and-2ljplziuvm.pdf

Long-distance 802.11b links: performance measurements and experience

The past decade has seen communication revolution in the form of cellular telephony as well as the Internet, but much of it has been restricted to the developed world and metro pockets in the developing world. While the use of cellular technologies can cut down on the time to deploy access networks, the cost economics make this non-viable in growing telecom economies. In the Digital Gangetic Plains (DGP) project, we are exploring the use of 802.11 as a long-distance access technology. 802.11 is currently cost-priced due to competitive mass production and hence is attractive for low cost and rapid deployment in rural areas.We have built an extensive testbed in a rural setting consisting of multi-hop directional 802.11 links, the testbed spanning up to 80km at its longest. To our knowledge such a long-distance, multi-hop testbed based on 802.11 is unique thus far. While 802.11 is attractive in terms of cost economics, it was inherently designed for indoor use. Our novel use of the technology for outdoor, long-distance access links presents several challenges. Our experience with the testbed has brought several research as well as operational issues to the fore. In this paper, we describe the novel technical challenges that lie ahead in using 802.11 to bridge the digital divide.

Turning 802.11 inside-out

Railway systems are critical in many regions, and can consist of several tens of thousands of bridges, being used over several decades. It is critical to have a system to monitor the health of these bridges and report when and where maintenance operations are needed. This paper presents BriMon, a wireless sensor network based system for such monitoring. The design of BriMon is driven by two important factors: application requirements, and detailed measurement studies of several pieces of the architecture. In comparison with prior bridge monitoring systems and sensor network prototypes, our contributions are three-fold. First, we have designed a novel event detection mechanism that triggers data collection in response to an oncoming train. Next, BriMon employs a simple yet effective multi-channel data transfer mechanism to transfer the collected data onto a sink located on the moving train. Third, the BriMon architecture is designed with careful consideration of the interaction between the multiple requisite functionalities such as time synchronization, event detection, routing, and data transfer. Based on a prototype implementation, this paper also presents several measurement studies to show that our design choices are indeed quite effective.

/pdf/brimon-a-sensor-network-system-for-railway-bridge-monitoring-402mrujg7q.pdf

Bhaskaran Raman

Papers

Design and evaluation of a new MAC protocol for long-distance 802.11 mesh networks

Wolverine: Traffic and road condition estimation using smartphone sensors

Long-distance 802.11b links: performance measurements and experience

Turning 802.11 inside-out

Brimon: a sensor network system for railway bridge monitoring