Weitao Duan

TL;DR: The first paper to provide the top challenges faced across the industry for running OCEs at scale and some common solutions is provided.

TL;DR: A new experimental design is leverage for testing whether SUTVA holds, without making any assumptions on how treatment effects may spill over between the treatment and the control group, and the proposed methodology can be applied to settings in which a network is not necessarily observed but, if available, can be used in the analysis.

TL;DR: An experimental design strategy for testing whether the classic assumption of no interference among users, under which the outcome of one user does not depend on the treatment assigned to other users, is rarely tenable on such platforms is introduced.

TL;DR: This article presents a batch sequential experiment design method that uses sliced full factorial-basedLatin hypercube designs (sFFLHDs), which are an extension to the concept of sliced orthogonal array-based Latin hyper cube designs (OALHDs) and shows that the approach has good sampling and fitting qualities through both empirical studies and theoretical arguments.

TL;DR: In this paper, the authors propose a framework that can effectively balance among Speed, Quality and Risk (SQR) principles in A/B testing, which is used to accelerate product innovations in the online world.