In this paper, we review the background and state-of-the-art of big data. We first introduce the general background of big data and review related technologies, such as could computing, Internet of Things, data centers, and Hadoop. We then focus on the four phases of the value chain of big data, i.e., data generation, data acquisition, data storage, and data analysis. For each phase, we introduce the general background, discuss the technical challenges, and review the latest advances. We finally examine the several representative applications of big data, including enterprise management, Internet of Things, online social networks, medial applications, collective intelligence, and smart grid. These discussions aim to provide a comprehensive overview and big-picture to readers of this exciting area. This survey is concluded with a discussion of open problems and future directions.

Big Data: A Survey

Telephone calls, data and other multimedia information is routed through a hybrid network which includes transfer of information across the internet. A media order entry captures complete user profile information for a user. This profile information is utilized by the system throughout the media experience for routing, billing, monitoring, reporting and other media control functions. Users can manage more aspects of a network than previously possible, and control network activities from a central site. The hybrid network also contains logic for responding to requests for quality of service and reserving the resources to provide the requested services.

System and method for providing requested quality of service in a hybrid network

A location reporting paging communication system comprising space satellites, ground stations and a remote receiving unit adapted to resolve a global position from signals transmitted from a communication transmitter. The subscriber in possession of the remote receiving unit updates the paging network with global positioning information. A caller paging a subscriber in possession of the remote receiving unit may request the global location of the remote receiving unit. The paging network could divulge or block such information from a caller depending on the requirements of the subscriber.

Location reporting satellite paging system with optional blocking of location reporting

A seamless solution transparently addresses the characteristics of nomadic systems, and enables existing network applications to run reliably in mobile environments. The solution extends the enterprise network, letting network managers provide mobile users with easy access to the same applications as stationary users without sacrificing reliability or centralized management. The solution combines advantages of existing wire-line network standards with emerging mobile standards to create a solution that works with existing network applications. A Mobility Management Server coupled to the mobile network maintains the state of each of any number of Mobile End Systems and handles the complex session management required to maintain persistent connections to the network and to other peer processes. If a Mobile End System becomes unreachable, suspends, or changes network address (e.g., due to roaming from one network interconnect to another), the Mobility Management Server maintains the connection to the associated peer task—allowing the Mobile End System to maintain a continuous connection even though it may temporarily lose contact with its network medium. In one example, Mobility Management Server communicates with Mobile End Systems using Remote Procedure Call and Internet Mobility Protocols.

Method and apparatus for providing mobile and other intermittent connectivity in a computing environment

Recent technological advancements have led to a deluge of data from distinctive domains (e.g., health care and scientific sensors, user-generated data, Internet and financial companies, and supply chain systems) over the past two decades. The term big data was coined to capture the meaning of this emerging trend. In addition to its sheer volume, big data also exhibits other unique characteristics as compared with traditional data. For instance, big data is commonly unstructured and require more real-time analysis. This development calls for new system architectures for data acquisition, transmission, storage, and large-scale data processing mechanisms. In this paper, we present a literature survey and system tutorial for big data analytics platforms, aiming to provide an overall picture for nonexpert readers and instill a do-it-yourself spirit for advanced audiences to customize their own big-data solutions. First, we present the definition of big data and discuss big data challenges. Next, we present a systematic framework to decompose big data systems into four sequential modules, namely data generation, data acquisition, data storage, and data analytics. These four modules form a big data value chain. Following that, we present a detailed survey of numerous approaches and mechanisms from research and industry communities. In addition, we present the prevalent Hadoop framework for addressing big data challenges. Finally, we outline several evaluation benchmarks and potential research directions for big data systems.

Toward Scalable Systems for Big Data Analytics: A Technology Tutorial

Various methodologies and related apparatus associated with mobility management issues within a packet-based multiaccess mobile communications system, which includes a plurality of mobile user stations and a plurality of network nodes, are provided. Location management techniques include tracking and/or locating mobile stations within the system. The invention makes use of home and visiting location registers in which information such as mobile station addresses and/or host names associated with mobile stations are stored. Mobile access methodologies include a complete mobile access method and a direct mobile access method. The former allows a mobile station to preferably include a unique address in the packets being transmitted, while the latter allows the station to merely use the host name of the destination station. The invention also includes various in-call mobility management techniques, including handoffs, which make use of the concept of an anchor.

Mobility management for a multimedia mobile network

The explosion of data traffic and the availability of enormous bandwidth via dense wavelength division multiplexing (DWDM) and optical amplifier (OA) technologies make it important to study optical layer networking and restoration. This paper is concerned with fast distributed restoration and provisioning for generic mesh-based optical networks. We consider two problems of practical importance: determining the best restoration route for each wavelength demand, given the network topology and the capacities and primary routes of all demands, and determining primary and restoration routes for each wavelength demand to minimize network capacity and cost. The approach we propose for both problems is based on precomputing. For each problem, we describe specific algorithms used for computing routes. We also describe endpoint-based failure detection, message flows, and cross-connect actions for execution of fast restorations. Finally, we report test results for large carrier-scale networks that include both the computational performance of the optimization algorithms and the restoration speed obtained by simulation. Our results indicate that subsecond restoration, high capacity efficiency, and scalability can be achieved without fault isolation and with moderate processing. We also discuss methods for scaling algorithms to problems with very large numbers of demands. The wavelength routing and restoration algorithms, the failure detection, and the message exchange and activation architectures we propose are collectively known as WaveStar™ advanced routing platform.

Optical network design and restoration

A congestion control scheme for connectionless networks relieves congestion by routing a portion of traffic on a congested primary path onto a predefined alternate path constructed such that loop-freedom is guaranteed. Explicit care is taken to avoid spreading congestion onto alternate paths. The control actions are taken in a completely distributed manner, based on local measurements only and therefore no signaling messages need to be exchanged between nodes. If desired, lower loss priority may be assigned to alternate routed traffic. Congestion is monitored locally and thresholds defined to declare the onset and abatement of congestion. The present invention affords at least an order of magnitude improvement in end-to-end cell blocking under sustained focussed overload.

Congestion control for connectionless traffic in data networks via alternate routing

Asynchronous transfer mode (ATM) is now well recognized as the fundamental switching and multiplexing technique for future broadband ISDN. As these networks will be increasingly relied upon for providing a multitude of integrated voice, data, and video services, network reliability is a key concern. There are several intrinsic features of ATM networks that could potentially be exploited to provide improved restoration techniques, beyond those established for synchronous transfer mode (STM) networks, such as digital cross-connect restoration or self-healing rings. These features include ATM cell level error detection, inherent rate adaptation and nonhierarchical multiplexing. The authors explore the use of these features in developing fast restoration strategies for ATM networks. In particular, they address: (1) ATM error detection capabilities for enhanced failure detection, (2) network rerouting strategies, (3) spare capacity allocation, and (4) network control architecture and related implementation aspects. Their findings suggest that fast network span failure detection and bandwidth-efficient rerouting capabilities can be combined to develop restoration strategies for ATM networks with significantly greater performance-cost ratios when compared to existing STM network restoration strategies. >

Fast restoration of ATM networks

Congestion in a high speed connection oriented packet is avoided by an in-call negotiation scheme for reserving bandwidth for real time calls and reserving buffer capacity for bursty calls. For a real time call, a centralized call controller in each switch in the network determines which of its outgoing trunkshas available the peak bandwidth needed to accommodate the call. If so, the callrouting is set up so that the call is directed through that trunk. Calls involving bursty data cause the call controllers in the switches to set up the routing of the call and allocate some minimum bandwidth on selected output trunks. A special packet which contains an indication of a requested buffer capacity is produced by the call transmitter and sent to all the switches along the route. At each switch along the route, a check is made to see if there is sufficient unallocated buffer capacity on associated trunks equal to the requested capacity. If so, that amount of buffer capacity is allocated to the call and the special packet is passed unchanged to the next switch. If that amount of buffer capacity is not available, then the switch may refuse the call by placing an indication of such refusal in the special packet and which is passed to the next switch. When the special packet has reached the intended destination of the call, an acknowledgment packet is produced and sent back to the origin. If the request for buffer capacity has been completely denied by one of the switches or if a smaller amount of requested buffer capacity has been written into the special packet by one of the switches,the acknowledgment packet deallocates the excess previously allocated buffer capacity on its trip back to the origin and notifies the transmitter of the buffer capacity which has been allocated along the route of the call, if any. If the call has not been completely denied, the data making up the call is then sent along the prescribed route at a rate which will not cause an overflow of the buffers allocated to the call.

Subrahmanyam Dravida

Papers

Mobility management for a multimedia mobile network

Optical network design and restoration

Congestion control for connectionless traffic in data networks via alternate routing

Fast restoration of ATM networks

Congestion control for high speed packet networks