Stevens Institute of Technology

About: Stevens Institute of Technology is a education organization based out in Hoboken, New Jersey, United States. It is known for research contribution in the topics: Computer science & Cognitive radio. The organization has 5440 authors who have published 12684 publications receiving 296875 citations. The organization is also known as: Stevens & Stevens Tech.

On the Convergence of FedAvg on Non-IID Data

Abstract: Federated learning enables a large amount of edge computing devices to jointly learn a model without data sharing. As a leading algorithm in this setting, Federated Averaging (\texttt{FedAvg}) runs Stochastic Gradient Descent (SGD) in parallel on a small subset of the total devices and averages the sequences only once in a while. Despite its simplicity, it lacks theoretical guarantees under realistic settings. In this paper, we analyze the convergence of \texttt{FedAvg} on non-iid data and establish a convergence rate of $\mathcal{O}(\frac{1}{T})$ for strongly convex and smooth problems, where $T$ is the number of SGDs. Importantly, our bound demonstrates a trade-off between communication-efficiency and convergence rate. As user devices may be disconnected from the server, we relax the assumption of full device participation to partial device participation and study different averaging schemes; low device participation rate can be achieved without severely slowing down the learning. Our results indicate that heterogeneity of data slows down the convergence, which matches empirical observations. Furthermore, we provide a necessary condition for \texttt{FedAvg} on non-iid data: the learning rate $\eta$ must decay, even if full-gradient is used; otherwise, the solution will be $\Omega (\eta)$ away from the optimal.

Hands-on, simulated, and remote laboratories: A comparative literature review

Abstract: Laboratory-based courses play a critical role in scientific education. Automation is changing the nature of these laboratories, and there is a long-running debate about the value of hands-on versus simulated laboratories. In addition, the introduction of remote laboratories adds a third category to the debate. Through a review of the literature related to these labs in education, the authors draw several conclusions about the state of current research. The debate over different technologies is confounded by the use of different educational objectives as criteria for judging the laboratories: Hands-on advocates emphasize design skills, while remote lab advocates focus on conceptual understanding. We observe that the boundaries among the three labs are blurred in the sense that most laboratories are mediated by computers, and that the psychology of presence may be as important as technology. We also discuss areas for future research.

Microplasmas and applications

Abstract: Atmospheric-pressure, non-equilibrium plasmas are susceptible to instabilities and, in particular, to arcing (glow-to-arc transition). Spatially confining the plasma to dimensions of 1 mm or less is a promising approach to the generation and maintenance of stable, glow discharges at atmospheric-pressure. Often referred to as microdischarges or microplasmas, these weakly-ionized discharges represent a new and fascinating realm of plasma science, where issues such as the possible breakdown of 'pd scaling' and the role of boundary-dominated phenomena come to the fore. Microplasmas are generated under conditions that promote the efficient production of transient molecular species such as the rare gas excimers, which generally are formed by three-body collisions. Pulsed excitation on a sub-microsecond time scale results in microplasmas with significant shifts in both the temperatures and energy distribution functions associated with the ions and electrons. This allows for the selective production of chemically reactive species and opens the door to a wide range of new applications of microplasmas. The implementation of semiconductor and microelectronics and MEMs microfabrication techniques has resulted in the realization of microplasma arrays as large as 250,000 devices. Fabricated in silicon or ceramics with characteristic device dimensions as small as 10 µm and at packing densities up to 104 cm−2, these arrays offer optical and electrical characteristics well suited for applications in medical diagnostics, displays and environmental sensing. Several microplasma device structures, including their fundamental properties and selected applications, will be discussed.

The future of crowd work

Abstract: Paid crowd work offers remarkable opportunities for improving productivity, social mobility, and the global economy by engaging a geographically distributed workforce to complete complex tasks on demand and at scale. But it is also possible that crowd work will fail to achieve its potential, focusing on assembly-line piecework. Can we foresee a future crowd workplace in which we would want our children to participate? This paper frames the major challenges that stand in the way of this goal. Drawing on theory from organizational behavior and distributed computing, as well as direct feedback from workers, we outline a framework that will enable crowd work that is complex, collaborative, and sustainable. The framework lays out research challenges in twelve major areas: workflow, task assignment, hierarchy, real-time response, synchronous collaboration, quality control, crowds guiding AIs, AIs guiding crowds, platforms, job design, reputation, and motivation.