Henan Normal University

About: Henan Normal University is a education organization based out in Xinxiang, China. It is known for research contribution in the topics: Catalysis & Ionic liquid. The organization has 10863 authors who have published 11077 publications receiving 166773 citations.

Improve Transformer Models with Better Relative Position Embeddings

Abstract: The transformer model has demonstrated superior results on NLP tasks including machine translation and question answering. In this paper, we argue that the position information is not fully utilized in existing work. For example, the initial proposal of a sinusoid embedding is fixed and not learnable. In this paper, we first review the absolute position embeddings and existing relative position embedding methods. We then propose new methods to encourage increased interaction between query, key and relative position embeddings in the self-attention mechanism. Our most promising approach is a generalization of the absolute position embedding. Our method results in increased accuracy compared to previous approaches in absolute and relative position embeddings on the SQuAD1.1 dataset. In addition, we address the inductive property of whether a position embedding can be robust enough to handle long sequences. We demonstrate empirically that our relative embedding method can be reasonably generalized to and is robust in the inductive perspective. Finally, we show that our proposed method can be effectively and efficiently adopted as a near drop-in replacement for improving the accuracy of large models with little computational overhead.

Nanostructured alkali cation incorporated δ-MnO2 cathode materials for aqueous sodium-ion batteries

Abstract: Nanostructured δ-MnO2 incorporated with alkali cations (A-δ-MnO2, A = K+, Na+) has been synthesized and evaluated as a cathode material for aqueous sodium-ion batteries. It is observed that Na+ ions are easier than K+ ions to intercalate into the layered δ-MnO2 due to their smaller ion radius. The incorporation of K+ and Na+ into δ-MnO2 shows a great influence on the electrochemical performance of the layered δ-MnO2. The full cell with (K, Na)-co-incorporated δ-MnO2 (K : Na : Mn = 0.15 : 0.26 : 1) hierarchical nanospheres as the cathode and NaTi2(PO4)3 as the anode exhibits a specific capacity of 74.6 mA h g−1 at 150 mA g−1, and the capacity remains at ∼62% at a high current density of 600 mA g−1. The electrochemical cycling does not induce observable structural degradation even after 200 cycles. K-incorporated and (K, Na)-co-incorporated δ-MnO2 electrodes have superior capacity and rate capability, which can be ascribed to their hierarchical structure and adequate crystallinity.

Mannite supported hydrothermal synthesis of hollow flower-like ZnO structures for photocatalytic applications

Abstract: With the introduction of mannite, hollow flower-like complex superstructures assembled by ZnO nanorods have been successfully constructed via a simple hydrothermal method. The results reveal that the mannite-directed hydrothermal process is essential for the final products. The morphologies of the ZnO products could be easily tuned by adjusting the molar ratios of mannite to zinc ion, the amount of ammonia, the reaction time and temperature. A possible formation mechanism of the hollow superstructures has been proposed and the optical properties of these ZnO structures were investigated in some detail, which showed high photocatalytic activity towards Congo Red under ultraviolet (UV) irradiation.

A “turn-on” fluorescent sensor for detection of Pb2+ based on graphene oxide and G-quadruplex DNA

Abstract: A rapid, sensitive and selective fluorescence sensor for detection of Pb2+ was developed based on a Pb2+-induced G-quadruplex and graphene oxide. By using a specific G-rich DNA sequence, this strategy provided a promising alternative to Pb2+ determination in the presence of Hg2+ escaping from the use of a masking agent of Hg2+.