Latency (engineering)

About: Latency (engineering) is a research topic. Over the lifetime, 3729 publications have been published within this topic receiving 39210 citations. The topic is also known as: lag.

Implementing a high-volume, low-latency market data processing system on commodity hardware using IBM middleware

Abstract: A stock market data processing system that can handle high data volumes at low latencies is critical to market makers. Such systems play a critical role in algorithmic trading, risk analysis, market surveillance, and many other related areas. We show that such a system can be built with general-purpose middleware and run on commodity hardware. The middleware we use is IBM System S, which has been augmented with transport technology from IBM WebSphere MQ Low Latency Messaging. Using eight commodity x86 blades connected with Ethernet and Infiniband, this system can achieve 80 μsec average latency at 3 times the February 2008 options market data rate and 206 μsec average latency at 15 times the February 2008 rate.

TextGNN: Improving Text Encoder via Graph Neural Network in Sponsored Search

Abstract: Text encoders based on C-DSSM or transformers have demonstrated strong performance in many Natural Language Processing (NLP) tasks. Low latency variants of these models have also been developed in recent years in order to apply them in the field of sponsored search which has strict computational constraints. However these models are not the panacea to solve all the Natural Language Understanding (NLU) challenges as the pure semantic information in the data is not sufficient to fully identify the user intents. We propose the TextGNN model that naturally extends the strong twin tower structured encoders with the complementary graph information from user historical behaviors, which serves as a natural guide to help us better understand the intents and hence generate better language representations. The model inherits all the benefits of twin tower models such as C-DSSM and TwinBERT so that it can still be used in the low latency environment while achieving a significant performance gain than the strong encoder-only counterpart baseline models in both offline evaluations and online production system. In offline experiments, the model achieves a 0.14% overall increase in ROC-AUC with a 1% increased accuracy for long-tail low-frequency Ads, and in the online A/B testing, the model shows a 2.03% increase in Revenue Per Mille with a 2.32% decrease in Ad defect rate.

A demonstration of ultra-low-latency data center optical circuit switching

Abstract: We designed and constructed a 24x24-port optical circuit switch (OCS) prototype with a programming time of 68.5 μs, a switching time of 2.8 μs, and a receiver electronics initialization time of 8.7 μs [1]. We demonstrate the operation of this prototype switch in a data center testbed under various workloads.

Finite Block-Length Analog Fountain Codes for Ultra-Reliable Low Latency Communications

Abstract: In this paper, a theoretical framework for the design and evaluation of finite block-length analog fountain codes (AFC) towards ultra-reliable low latency communications (URLLC) is proposed. First, based on the achievable rate analysis and extrinsic information transfer (EXIT) analysis for AFC, we propose a weight adaptive (WA) AFC transmission scheme by introducing a limited feedback link, which can realize the lowest complexity AFC over a wide range SNRs. Further, by combining the conventional EXIT analysis and the dispersion perspective of mutual information, we propose a modified weight selection scheme for short block length WA-AFC (SWA-AFC) scheme. Simulation results show that our SWA-AFC scheme can achieve a superior performance than the existing AFC schemes, and approaching to the Polyansky-Poor-Verdu (PPV) bound.

Ultra‐low‐latency services in 5G systems: A perspective from 3GPP standards

Abstract: The demand for services such as three-dimensional interactive data exchange, augmented reality (AR)/virtual reality (VR), the tactile Internet, factory automation, and autonomous driving is growing rapidly in the vertical domain as well as the consumer domain. Such latency-sensitive services have not been supported in the 4G system, because it was only aimed at increasing the user service capacity. In addition to supporting broadband service, a fifth-generation system (5GS) considers how to support reliable and low-latency communication for latency-sensitive services. To achieve this goal, the 3rd Generation Partnership Party (3GPP), a standardization organization for developing 5GS, classifies service scenarios and requirements using key performance indicators (KPIs) for 5GS, which are used to assess the performance of services. 3GPP technical specification (TS) 22.261 [1] presents various use cases and quantifies their service requirements with different combinations of KPIs (see Table 1) to support different services and different end-user communities. Received: 9 May 2020 | Revised: 15 August 2020 | Accepted: 10 September 2020 DOI: 10.4218/etrij.2020-0200