Showing papers on "Distributed object published in 2017"

A review about Smart Objects, Sensors, and Actuators

Abstract: Smart Objects and the Internet of Things are two ideas which describe the future, walk together, and complement each other. Thus, the interconnection among objects can make them more intelligent or expand their intelligence to unsuspected limits. This could be achieved with a new network that interconnects each object around the world. However, to achieve this goal, the objects need a network that supports heterogeneous and ubiquitous objects, a network where exists more traffic among objects than among humans, but supporting for both types. For these reasons, both concepts are very close. Cities, houses, cars, machines, or any another object that can sense, respond, work, or make easier the lives of their owner. This is a part of the future, an immediate future. Notwithstanding, first of all, there are to resolve a series of problems. The most important problem is the heterogeneity of objects. This article is going to show a theoretical frame and the related work about Smart Object. The article will explain what are Smart Objects, doing emphasis in their difference with Not- Smart Objects. After, we will present one of the different object classification system, in our opinion, the most complete.

Toward Emulation-Based Performance Assessment of Constrained Application Protocol in Dynamic Networks

Abstract: The Internet of Things (IoT) has emerged as the key networking paradigm for supporting the connectivity of massively distributed objects and numerous simultaneous applications. The constrained application protocol (CoAP) is designed to meet the requirements for IoT data transmission among constrained nodes. The lean design of CoAP enables it to additionally meet the needs of the data transmission in dynamic network environments. In this paper, we conduct an emulation-based quantitative performance assessment of CoAP in comparison with HTTP, assessing data transmission based on key characteristics of dynamic network environments and the designed scenarios. We also designed scenarios and evaluate the performance of investigated protocols using real-world IoT datasets. Our experimental results demonstrate that CoAP performs better than HTTP for data transmission in the dynamic network environments with respect to delivery rate, delay, and overhead. In addition, we analyze the impact of features in dynamic network environments on the performance of data transmission protocols with respect to success rate, delay and overhead, as well as discuss some further extensions for future research.

SwiftAnalytics: Optimizing Object Storage for Big Data Analytics

Abstract: Due to their scalability and low cost, object-based storage systems are an attractive storage solution and widely deployed. To gain valuable insight from the data residing in object storage but avoid expensive copying to a distributed filesystem (e.g. HDFS), it would be natural to directly use them as a storage backend for data-parallel analytics frameworks such as Spark or MapReduce. Unfortunately, executing data-parallel frameworks on object storage exhibits severe performance problems, reducing average job completion times by up to 6.5x. We identify the two most severe performance problems when running data-parallel frameworks on the OpenStack Swift object storage system in comparison to the HDFS distributed filesystem: (i) the fixed mapping of object names to storage nodes prevents local writes and adds delay when objects are renamed, (ii) the coarser granularity of objects compared to blocks reduces data locality during reads. We propose the SwiftAnalytics object storage system to address them: (i) it uses locality-aware writes to control an object's location and eliminate unnecessary I/O related to renames during job completion, speeding up analytics jobs by up to 5.1x, (ii) it transparently chunks objects into smaller sized parts to improve data-locality, leading to up to 3.4x faster reads.

Distributed Object-Oriented Design of Autonomous Control Systems for Connected Vehicle Platoons

Abstract: The contribution of this paper is articulated around a new software design approach of autonomous control systems for connected vehicle platoons Our control system is distributed and real-time based on object-oriented component-based method of design that brakes with the industrial traditions subject to cyclic OS-free approaches We illustrate our design by relevant case studies of the longitudinal speed control widely studied in industrial and academic research around automotive platooning Our software is mainly implemented using the Ada standard of programming (in particular the annexes D and E of real-time and distributed systems) The distribution in our software is managed by the versatile middleware PolyORB The control scenarios and communication aspects covered by the case studies are animated by wheeled robot prototypes commanded by single-board ARM Cortex computers under real-time Linux kernels

Deep Cascaded Networks for Sparsely Distributed Object Detection from Medical Images

Abstract: With the development of deep learning techniques, the performance of object detection has been significantly advanced. Although various methods have been designed to detect landmarks for computer-aided diagnosis, how to efficiently and effectively leverage deep learning approaches to detect sparsely distributed objects, such as mitosis and cerebral microbleeds, from large scale medical images hasn't been fully explored. In this chapter, we introduce a two-stage cascaded deep learning framework, referred as deep cascaded networks, to detect sparsely distributed objects that provide clinical significance with both high efficiency and accuracy. Specifically, the first screening stage with coarse retrieval model rapidly retrieves potential candidates, and subsequently the second discrimination stage with the fine discrimination model focuses on those candidates to further accurately single out the true targets from challenging mimics. Furthermore, we corroborate the importance of volumetric feature representations for volumetric imaging modalities by exploiting 3D convolutional neural networks. Extensive experimental results on the challenging problems, including mitosis detection from 2D histopathological images and cerebral microbleed detection from 3D magnetic resonance images, demonstrated superior performance of our framework in terms of both speed and accuracy.

Data writing and reading method and device and distributed object storage cluster

Abstract: One embodiment of the invention discloses a data writing and reading method and device and a distributed object storage cluster. The data writing method comprises following steps: a storage server receives data to be written from a client and splits the data to be written into multiple sub-data; each sub-data is written to a corresponding network hard disk; for each sub-data, the corresponding relationship between the serial number of the sub-data and the identification information of the network hard disk which the sub-data is written in is sent to a metadata server in the distributed object storage cluster. By means of the embodiment of the invention, each sub-data to be written to data partition is written to the corresponding network hard disk; the storage characteristic of a network hard disk is that the storage data occupies the same amount of space as the data itself; therefore, multiple sub-data to be written into data partition is written to multiple network hard disks without occupying extra space to avoid resource waste and need not to wait for merging with other data to improve the efficiency of reading and writing data.

High-performance computing-oriented distributed data organization method

Abstract: The invention discloses a high-performance computing-oriented distributed data organization method. Data access and data management are separated in an interface layer; and at a computing node end, a client provides a simplified data access interface for an application only, and file access operation, in a POSIX form, completely transparent for the application is supported. According to the method, for a data storage demand of a high-performance computing application, POSIX file system access semantics is simplified, and the data access and the data management are decoupled, so that an efficient and lightweight programming interface is provided for the application; a distributed object storage technology is adopted for performing data organization, so that data organization limitation of a conventional file system is broken through, a more efficient data access protocol is realized, and system expandable capability is further improved; and a memory-based metadata management mode is provided, and a high-performance non-relational key-value database is introduced in a high-performance computer system for the first time, so that an efficient and expandable metadata service can be provided for outside by utilizing excellent characteristics of the high-performance computer system.

Enabling Fine-Grained Access Control in Flexible Distributed Object-Aware Process Management Systems

Abstract: To increase flexibility, object-aware process management systems enable data-driven process execution and dynamic generation of form-based tasks at run-time. Therefore, a powerful access control concept becomes necessary to define which data elements users may read or write at a given point in time during process execution. The access control concept we present in this paper has been realized in the context of the PHILharmonicFlows framework, which provides a distributed data-driven process execution engine. We present solutions that allow for complex as well as fine-grained permissions and roles, which are granted depending on the states of processes and data elements. We show how one can resolve authorization queries in real-time over multiple business objects and process instances. This constitutes a significant advantage over centralized access control systems.

Improving OpenStack Swift interaction with the I/O Stack to Enable Software Defined Storage

Abstract: This paper analyses how OpenStack Swift, a distributed object storage service for a globally used middleware, interacts with the I/O subsystem through the Operating System. This interaction, which seems organised and clean on the middleware side, becomes disordered on the device side when using mechanical disk drives, due to the way threads are used internally to request data. We will show that only modifying the Swift threading model we achieve an 18% mean improvement in performance with objects larger than 512 KiB and obtain a similar performance with smaller objects. Compared to the original scenario, the performance obtained on both scenarios is obtained in a fair way: the bandwidth is shared equally between concurrently accessed objects. Moreover, this threading model allows us to apply techniques for Software Defined Storage (SDS). We show an implementation of a Bandwidth Differentiation technique that can control each data stream and that guarantees a high utilization of the device.

Network data management method, network attached storage gateway and storage service system thereof

Abstract: The invention provides a network data management method, a network attached storage gateway and a storage service system thereof. The network data management method is applied to the storage service system comprising multiple groups of clients, a plurality of network attached storage gateways and a distributed object file system cluster; each group of network attached storage gateways comprises a plurality of network attached storage gateways, the clients are connected with the network attached storage gateways, and the plurality of network attached storage gateways are connected with the distributed object file system cluster; a distributed object file system for storing network data is arranged in the distributed object file system cluster, the distributed object file system maps the network data stored therein to the network attached storage gateways, so that the network attached storage gateways cache the network data; the management method comprises the following steps: receiving an access request of the network data; and executing a network data management operation associated with the access request of the network data. By adoption of the network data management method provided by the invention, high expandability and high reliability are ensured, and meanwhile a high-performance network file system is provided.

Video processing method and system as well as distributed object storage system

Abstract: The invention discloses a video processing method and system as well as a distributed object storage system. The method is applied to the distributed object storage system. The distributed object storage system comprises a Proxy node, storage nodes and a client SDK, wherein the Proxy node is used for cluster information metadata management middleware service, the storage nodes are used for video processing service, and the client SDK obtains cluster metadata on the Proxy node regularly and asynchronously and caches the cluster metadata on a local server. The method has the advantages that the storage nodes and complete file names of video files in a distributed object storage cluster are calculated rapidly on the client SDK, processing requests are directly sent to the storage nodes by bypassing the Proxy node, and accordingly, the data transmission path is shortened, the request forwarding time is shortened, and the video production efficiency is improved; video processing services are deployed on the storage nodes, corresponding files in the client requests are directly handled, results are returned to a client, the client is prevented from downloading the entire video files, purchase of computing resources is reduced, and the whole video production cost is reduced.

Communication between nodes in spontaneous area networks

Abstract: A Spontaneous Area Network (SPAN) is formed by mobile and fixed nodes using wireless transmission links between nodes, usually in a nearby geographical area. Applications allow users to create, join, leave, and manage SPANs and groups in a SPAN. Automatic procedures allow nodes to join other SPANs. Transmission power of the wireless network interface is dynamic, varying depending on battery level, type of information to transmit, state and topology of the network. A delay tolerant object layer abstraction creates, modifies, deletes, publishes, and handles Delay Tolerant Distributed Objects (DTDOs). A Patient Transport Protocol (PTP) ensures a reliable transport of information through the network while avoiding congestion conditions. An aggressive and explosive network protocol (AGENET) has routing and forwarding capacities and uses datagrams to establish communication between different nodes of the SPAN. Cooperation and diversity are exploited to react to node mobility that causes frequent changes in network topology and disconnections.

Distributed object storage

Abstract: The disclosure provides a system, method and computer-readable storage device embodiments. Some embodiments can include an IPv6-centric distributed storage system. An example method includes receiving, at a computing device, a request to create metadata associated with an object from a client, creating the metadata based on the request and transmitting the metadata and an acknowledgment to the client, wherein the metadata contains an address in a storage system for each replica of the object and wherein the metadata can be used to write data to the storage system and read the data from the storage system. There is no file system layer between an application layer and a storage system layer.

Semi-automatic Segmentation of Scattered and Distributed Objects

Abstract: This paper presents a novel object segmentation technique to extract objects that are potentially scattered or distributed over the whole image. The goal of the proposed approach is to achieve accurate segmentation with minimum and easy user assistance. The user provides input in the form of few mouse clicks on the target object which are used to characterize its statistical properties using Gaussian mixture model. This model determines the primary segmentation of the object which is refined by performing morphological operations to reduce the false positives. We observe that the boundary pixels of the target object are potentially misclassified. To obtain an accurate segmentation, we recast our objective as a graph partitioning problem which is solved using the graph cut technique. The proposed technique is tested on several images to segment various types of distributed objects e.g. fences, railings, flowers. We also show some remote sensing application examples, i.e. segmentation of roads, rivers, etc. from aerial images. The obtained results show the effectiveness of the proposed technique.

Flashback method and device of distributed object-based storage system

Abstract: A flashback method of a distributed object-based storage system is characterized by comprising the following steps: performing writing and reading of data of the distributed object-based storage system, data deleting data flashing bac, and deleting of outdated version data; constructing three data storing units, namely, a primary database, a back database and a servering database, based on a storage engine of a key-value data model; and performing data writing and reading, data deleting, data flashing back and deleting of outdated version data based on the three data storage units when a storage system receives a data operation request. With the adoption of the flashback method, the system complexity, increased by the flashback property, of the data can be greatly reduced, and a user can avoid the problems of additional data mirror server, serializing and deserializing of mirror files; a record-level previous version recovery mode is treated as the flashback mechanism, so that the data flashback process is only performed on a specified data set, and as a result, mis-operation can be avoided.

Terminal devices for synchro-information systems with adaptive properties for IoT

Abstract: In modern conditions, effective provision of advanced services to consumers is researched in the context of the concept of a global infrastructure for IoT, is possible through the creation of Unified National Synchro-Information System of Ukraine (UNSIS). Synchro-information for geographically distributed objects of various consumer kinds is formed by terminal devices (terminals) of the UNSIS, which mainly determines its quality characteristics. It is proposed to create terminals built on a basis of slave synchronization devices, using the results of their optimization on a set of optimization criteria using a patented adaptive digital phase discriminator to guarantee a minimum duration of the transient response and adaptivity.

Energy-Efficient Quorum Selection Algorithm for Distributed Object-Based Systems

Abstract: Distributed applications are composed of multiple objects and each object is replicated in order to increase reliability, availability, and performance. On the other hand, the larger amount of electric energy is consumed in a system since multiple replicas of each object are manipulated on multiple servers. In this paper, the energy efficient quorum selection (EEQS) algorithm is proposed to construct a quorum for each method issued by a transaction in the quorum based locking protocol so that the total electric energy consumption of servers to perform methods can be reduced. We show the total energy consumption of servers, the average execution time of each transaction, and the number of aborted transactions can be reduced in the EEQS algorithm compared with the random algorithm in the evaluation.

Using formal methods in distributed system design

Abstract: Distributed systems are groups of networked computers, which have the same goal for their work. The terms “concurrent computing”, “parallel computing”, and “distributed computing” have a lot of overlap, and no clear distinction exists between them. The same system may be characterized both as “parallel” and “distributed”; the processors in a typical distributed system run concurrently in parallel. Parallel computing may be seen as a particular tightly coupled form of distributed computing, and distributed computing may be seen as a loosely coupled form of parallel computing. Nevertheless, it is possible to roughly classify concurrent systems as “parallel” or “distributed” using the following criteria. Philosophy is centrally concerned with arguments. The first question to be asked of any argument (or inference) is whether or not it is valid: that is, does its conclusion really follow from the cited premises? Validity of inference is the central problem of deductive logic.

The Parvicursor infrastructure to facilitate the design of Grid and Cloud computing systems

Abstract: During the past decades, different variants of technology solutions have emerged to eliminate the restrictions on the processing power of computers in solving various problems. Grid and Cloud computing patterns are among the most important of them. In this paper, we introduce a new infrastructure referred to as Parvicursor based on the distributed objects paradigm that can facilitate the construction of scalable and high-performance parallel distributed systems. It proposes several peer-to-peer services to construct scalable distributed system paradigms such as HPC, Grid and Cloud computing. Also, Parvicursor realizes a partial, native, cross-platform, high-performance and C++-based implementation of the .NET ECMA standards. To the best of our knowledge, Parvicursor.NET Framework is the first attempt that allows developers to implement .NET ECMA programs directly in native code. Parvicursor makes use of combining the thread-level parallelism and distributed memory programming models to exploit the strengths of both models in many-core era.

DOORS: Distributed Object Oriented Runtime System (Position Paper)

Abstract: The large software applications of today provide abstractions of the real-life systems that they support. A digital model of the system, and of the changes that occur within, are being maintained and updated, as triggered by real-life events. Morphologically, such applications contain several distinct architectural entities: databases holding the state, central components describing how the system reacts to external events and mechanisms through which the user can view the current state and issue new commands. Each of these entities may use distinct paradigms and employ different technologies. A production-ready software application ends up assembling a relatively high technology stack and provides the final abstractions for both the problem and its solution. In this paper we propose a short-circuit for the long chain of technologies that are usually employed in large, production-ready software applications. The resulting architecture is a distributed, message-based system which behaves as a hybrid between a database and a runtime environment. The system operates with persistent and live entities, encapsulating both state and operations and therefore easily assimilated with OOP classes.

Distributed object tracking based on information weighted UAV selection with priory objects

Abstract: In this work, we propose a distributed cubature information filter based multi-object tracking method with an information weighted selection for unmanned aerial vehicle (UAV) networks. In an UAV network, multiple UAVs can observe multiple objects in the region of interest. Further, the UAVs can exchange the objects local information among themselves and fuse them together to obtain the global state of the objects. As the number of UAVs in the network increases, the information exchange among the UAVs suffers from scalability, bandwidth and energy limitations. Thus, it is usually desirable to allow only a desired number of UAVs with highly relevant information to participate in the information exchange. In our approach, the innovation vector within the information filtering framework is used to calculate the amount of information associated with each UAV. Further, a threshold based selection mechanism is proposed to facilitate the UAVs to take independent decisions on whether to participate in the information exchange or not. In the proposed method, the UAVs take the decision to participate in the information exchange based on the information associated with a dynamic subset of objects known as priory objects while keeping the total number of information exchanges in the network to a desired number (on average).

File Version Based Continuous Data Protection On Distributed Object

Abstract: Continuous Data Protection (CDP) can restore data to any point-in-time, but high storage overhead and drastic system performance drop restricts its application. In this paper, we propose a file version based file level CDP system (FV-CDP) by using cheap distributed storage for backup to low down the storage costs and using local object cache and parralel asynchronous object sending to mask network storage latency. It designs special opration log to identify the file system hierarchy at any point-in-time and exploits parallel restoring in filesystem recovery. The experimental results show that parallel asynchronous objects sending makes the FV-CDP system max write ops to get improved by about 3.4 times, and the parallel recovery reduces file system recovery time by up to 57%. Under high frequency file syetem change workload, FV-CDP causes a large storage space overhead.

Data acquisition method and system for distributed object storage system

Abstract: The invention discloses a data acquisition method and system for a distributed object storage system. The method comprises the following steps: sending a first request to a server according to a preset rule, wherein the first request requests to obtain data of a first metadata sub-table in the distributed object storage system; receiving the data of the first metadata sub-table returned by the server; and sequentially sending a second request for requesting the data of other metadata sub-tables, and receiving the data returned by the server until the server returns an end mark. According to the data acquisition method and system disclosed by the invention, the technical problem of low resource utilization rate during the acquisition of a large amount of data can be solved.

On the Move to Meaningful Internet Systems. OTM 2017 Conferences

Abstract: This double volumes LNCS 10573-10574 constitutes the refereed proceedings of the Confederated International Conferences: Cooperative Information Systems, CoopIS 2017, Ontologies, Databases, and Applications of Semantics, ODBASE 2017, and Cloud and Trusted Computing, C&TC, held as part of OTM 2017 in October 2017 in Rhodes, Greece. The 61 full papers presented together with 19 short papers were carefully reviewed and selected from 180 submissions. The OTM program every year covers data and Web semantics, distributed objects, Web services, databases, information systems, enterprise workflow and collaboration, ubiquity, interoperability, mobility, grid and high-performance computing.

Formal Techniques for Distributed Objects, Components, and Systems

Abstract: We strive to use session type technology to prove behavioural properties of fault-tolerant distributed algorithms. Session types are designed to abstractly capture the structure of (even multi-party) communication protocols. The goal of session types is the analysis and verification of the protocols’ behavioural properties. One important such property is progress, i.e., the absence of (unintended) deadlock. Distributed algorithms often resemble (compositions of) multi-party communication protocols. In contrast to protocols that are typically studied with session types, they are often designed to cope with system failures. An essential behavioural property is (successful) termination, despite failures, but it is often elaborate to prove for distributed algorithms. We extend multi-party session types with optional blocks that cover a limited class of link failures. This allows us to automatically derive termination of distributed algorithms that come within these limits.

System and Method for Manufacturing and Trading Securities and Commodities

Abstract: Systems and methods are disclosed for a distributed trading system. The preferred invention offer solutions to problems that arise with High-Frequency Trading and the future of stock market regulation. The use of a distributed object brokered interface to facilitate transactions not only makes the trading faster but also more secure.

Load balancing method for improving distributed object storage service capability

Abstract: The present invention relates to the technical field of distributed object storage, particularly to a load balancing method for improving the distributed object storage service capability. In the invention, based on monitoring of the traffic and the number of links of a virtual switch, detection of distributed object storage service cluster business load is realized. The ability of accessing the distributed object storage services is improved by increasing the number of the virtual-machine-based object storage services. With respect to the limited load capacity of the traditional single physical-server-based object storage services, by a virtual-machine-based distributed object storage service cluster, the unique load balancing method is adopted to automatically increase the number of the virtual-machine-based object storage services, so as to improve the ability of accessing the distributed object storage services. The flexibility of the distributed object storage service capability is realized. The load balancing method of the invention can be applied to load balancing of distributed object storage services.

Big Data Analysis on Heterogeneous Distributed Systems using Remote Method Invocation

Abstract: Big Data Analysis has become very essential for organizations to arrive at timely decisions, for progressive growth and keeping with the competition. To analyse huge amount of data generated through various business processes, require High Performance Computing machines. But, owning HPC machines and maintaining them, requires large investment and experienced skill set. Moreover, it is difficult to install any proprietary and customized software, on special purpose HPC machines. To overcome all these issues, Distributed Systems can be implemented with the help of cumulative processing power available from large number of under-utilized individual workstations that are commonly available in all organizations. The paper emphasises on executing applications over heterogeneous distributed systems using Java Remote Method Invocation.

A distributed object detector-tracker aided video encoder for smart camera networks

Abstract: In this paper, we propose a Region of Interest(ROI) modulated H.264 video encoder system, based on a distributed object detector-tracker framework, for smart camera networks. Locations of objects of interest, as determined by detector-tracker are used to semantically partition each frame into regions assigned with multiple levels of importance. A distributed architecture is proposed to implement the object detector-tracker framework to mitigate the computational cost. Further, a rate control algorithm with modified Rate-Distortion(RD) cost is proposed to determine Quantization Parameter(QP) and skip decision of Macro Blocks based on their relative levels of importance. Our experiments show that, the proposed system achieves upto 3x reduction in bitrate without significant reduction in PSNR of ROI(head-shoulder region of pedestrians). We also demonstrate the trade-off between total computational cost and compression possible with the proposed distributed detector-tracker framework.

Research on the Method of Flexible Data Bus Technology of the Monitoring of the Hidden Engineering Audit

Abstract: Hidden engineering is the difficulty of the precision tracking audit of public engineering. Single sensor detection means that it is difficult to reveal the internal state of the project systematically. Multi-sensor detection equipment is the new method of hidden engineering audit to track the internal state of the hidden engineering in all directions, all-weather and all day. The disadvantages of all kinds of non-destructive testing system in integration are “system fragmentation, difficult collaborative operation, poor user experience effect, higher building operation cost”. They became major bottleneck in the development of non-destructive network detection. A new data integration bus framework of distributed object is proposed. Various detector level, detection device level, detection system level with configuration integration build a sound, light, electricity, heat, magnetic multi-waveband non-destructive endoscopic fusion technology framework, synthesize the information of the fragments that multi-sensor detection obtained, and achieve to visualize the internal state of hidden engineering.