Nanjing University of Science and Technology

About: Nanjing University of Science and Technology is a education organization based out in Nanjing, China. It is known for research contribution in the topics: Control theory & Catalysis. The organization has 31581 authors who have published 36390 publications receiving 525474 citations. The organization is also known as: Nánjīng Lǐgōng Dàxué & Nánlǐgōng.

Understanding the Disharmony between Dropout and Batch Normalization by Variance Shift

Abstract: This paper first answers the question "why do the two most powerful techniques Dropout and Batch Normalization (BN) often lead to a worse performance when they are combined together?" in both theoretical and statistical aspects. Theoretically, we find that Dropout would shift the variance of a specific neural unit when we transfer the state of that network from train to test. However, BN would maintain its statistical variance, which is accumulated from the entire learning procedure, in the test phase. The inconsistency of that variance (we name this scheme as "variance shift") causes the unstable numerical behavior in inference that leads to more erroneous predictions finally, when applying Dropout before BN. Thorough experiments on DenseNet, ResNet, ResNeXt and Wide ResNet confirm our findings. According to the uncovered mechanism, we next explore several strategies that modifies Dropout and try to overcome the limitations of their combination by avoiding the variance shift risks.

Optimizing Hybridization of 1T and 2H Phases in MoS2 Monolayers to Improve Capacitances of Supercapacitors

Abstract: We report on a 100-fold capacitance increase in MoS2-based supercapacitors achieved via optimizing the in-plane 1T-2H phase hybridization of the monolayers. Chemically exfoliated MoS2 monolayers were annealed at low temperature to tune their 1T content from 2% to 60%. The obtained hybridization states were confirmed by X-ray photoelectron and Raman spectroscopies. After optimizing the hybridization degree, the electrode based on MoS2 monolayers with 40% of the 1T phase exhibited outstanding performance with a resistance as low as 0.68 kΩ sq−1, specific capacitance of 366.9 F g−1, and retention ratio of 92.2% after 1000 cycles at current densities of 0.5 A g−1.

Output-Feedback Control for Stochastic Nonlinear Systems Subject to Input Saturation and Time-Varying Delay

Abstract: This paper is concerned with the problem of global output-feedback control for a class of stochastic nonlinear time-delay systems in the presence of input saturation and unmeasurable states. As a distinctive feature, the growth assumptions imposed on the drift and diffusion terms are proven to be unnecessary, which can be removed through a technical lemma. In addition, by introducing an auxiliary system whose order is the same as the considered system, and using Lyapunov–Krasovskii functional, the adverse effects generated by input saturation and time-varying delay are eliminated. Then, based on state-observer and backstepping recursive design, an output-feedback controller is constructed to render the closed-loop system be globally bounded almost surely. Particularly, instead of converging to an arbitrarily small neighborhood of zero as in related results, the tracking error is ensured to be tuned by the design parameters and an input saturation error in the mean quartic sense. Finally, a stochastic chemical reactor system is established and shown to demonstrate the effectiveness of the proposed scheme.