National University of Defense Technology

About: National University of Defense Technology is a education organization based out in Changsha, China. It is known for research contribution in the topics: Computer science & Radar. The organization has 39430 authors who have published 40181 publications receiving 358979 citations. The organization is also known as: Guófáng Kēxuéjìshù Dàxué & NUDT.

Deep reinforcement learning: a survey

Abstract: Deep reinforcement learning (RL) has become one of the most popular topics in artificial intelligence research. It has been widely used in various fields, such as end-to-end control, robotic control, recommendation systems, and natural language dialogue systems. In this survey, we systematically categorize the deep RL algorithms and applications, and provide a detailed review over existing deep RL algorithms by dividing them into modelbased methods, model-free methods, and advanced RL methods. We thoroughly analyze the advances including exploration, inverse RL, and transfer RL. Finally, we outline the current representative applications, and analyze four open problems for future research.

A novel overmoded slow-wave high-power microwave (HPM) Generator

Abstract: We present the design and experimental results of a novel overmoded slow-wave high-power microwave (HPM) generator that is featured by its compactness, low-operation magnetic field, and potentially high power and high efficiency. The device includes two slow-wave structure (SWS) sections, a resonant cavity, and a tapered waveguide. The resonant cavity was well designed and was used to achieve the axial mode selection and to decrease the length of the SWS sections. The radial mode selection is achieved using the property of "surface wave" of the device to excite the TM/sub 01/ mode while making the higher TM/sub 0n/ modes unexcited. The physical mechanisms of axial and radial mode selections ensure that the microwave is produced with a single mode and a narrow band. The feasibility of low magnetic field operation is also investigated based on the characteristics of the overmoded slow-wave devices. Experiments were carried out at the Spark-2 accelerator. At diode voltage of 474 kV, beam current of 5.2 kA, and guiding magnetic field strength of 0.6 T, a microwave was generated with power of 510 MW, mode of TM/sub 01/, and frequency of 9.54 GHz. The relative half width of the frequency spectrum is /spl Delta/f/f= 0.6%, and the beam-to-microwave efficiency is about 21% in our experiment.

Addressing Transient and Permanent Faults in NoC With Efficient Fault-Tolerant Deflection Router

Abstract: Continuing decrease in the feature size of integrated circuits leads to increases in susceptibility to transient and permanent faults. This paper proposes a fault-tolerant solution for a bufferless network-on-chip, including an on-line fault-diagnosis mechanism to detect both transient and permanent faults, a hybrid automatic repeat request, and forward error correction link-level error control scheme to handle transient faults and a reinforcement-learning-based fault-tolerant deflection routing (FTDR) algorithm to tolerate permanent faults without deadlock and livelock. A hierarchical-routing-table-based algorithm (FTDR-H) is also presented to reduce the area overhead of the FTDR router. Synthesized results show that, compared with the FTDR router, the FTDR-H router can reduce the area by 27% in an 88 network. Simulation results demonstrate that under synthetic workloads, in the presence of permanent link faults, the throughput of an 8 8 network with FTDR and FTDR-H algorithms are 14% and 23% higher on average than that with the fault-on-neighbor (FoN) aware deflection routing algorithm and the cost-based deflection routing algorithm, respectively. Under real application workloads, the FTDR-H algorithm achieves 20% less hop counts on average than that of the FoN algorithm. For transient faults, the performance of the FTDR router can achieve graceful degradation even at a high fault rate. We also implement the fault-tolerant deflection router which can achieve 400 MHz in TSMC 65-nm technology.