It's been over a decade since the first edition of Measurement Error in Nonlinear Models splashed onto the scene, and research in the field has certainly not cooled in the interim. In fact, quite the opposite has occurred. As a result, Measurement Error in Nonlinear Models: A Modern Perspective, Second Edition has been revamped and ex

Measurement Error in Nonlinear Models: A Modern Perspective, Second Edition

In his seminal book, Shewhart (1931) makes no demand on the distribution of the characteristic to be plotted on a control chart. How then can we explain the idea that normality is, if not required, at least highly desirable? I believe that it has come about through the many statistical studies of control-chart behavior. If one is to study how a control chart behaves, it is necessary to relate it to some distribution. The obvious choice is the normal distribution because of its ubiquity as a satisfactory model. This is bolstered by the existence of the Central Limit Theorem.

Sampling: Design and Analysis

Here are two books on a topic new to Technometrics: statistical and mathematical demography. The first author of Applied Mathematical Demography wrote the first two editions of this book alone. The second edition was published in 1985. Professor Keyfritz noted in the Preface (p. vii) that at age 90 he had no interest in doing another edition; however, the publisher encouraged him to find a coauthor. The result is an additional focus for the book in the world of biology that makes it much more relevant for the sciences. The book is now part of the publisher’s series on Statistics for Biology and Health. Much of it, of course, focuses on the many aspects of human populations. The new material focuses on mature population models, the particular focus of the new author (see, e.g., Caswell 2000). As one might expect from a book that was originally written in the 1970s, it does not include a lot of information on statistical computing. The new book by Alho and Spencer is focused on putting a better emphasis on statistics in the discipline of demography (Preface, p. vii). It is part of the publisher’s Series in Statistics. The authors are both statisticians, so the focus is on statistics as used for demographic problems. The authors are targeting human applications, so their perspective on science does not extend any further than epidemiology. The book actually strikes a good balance between statistical tools and demographic applications. The authors use the first two chapters to teach statisticians about the concepts of demography. The next four chapters are very similar to the statistics content found in introductory books on survival analysis, such as the recent book by Kleinbaum and Klein (2005), reported by Ziegel (2006). The next three chapters are focused on various aspects of forecasting demographic rates. The book concludes with chapters focusing on three areas of applications: errors in census numbers, financial applications, and small-area estimates.

Univariate Discrete Distributions

Customer churn is often a rare event in service industries, but of great interest and great value. Until recently, however, class imbalance has not received much attention in the context of data mining [Weiss, G. M. (2004). Mining with rarity: A unifying framework. SIGKDD Explorations, 6(1), 7-19]. In this study, we investigate how we can better handle class imbalance in churn prediction. Using more appropriate evaluation metrics (AUC, lift), we investigated the increase in performance of sampling (both random and advanced under-sampling) and two specific modelling techniques (gradient boosting and weighted random forests) compared to some standard modelling techniques. AUC and lift prove to be good evaluation metrics. AUC does not depend on a threshold, and is therefore a better overall evaluation metric compared to accuracy. Lift is very much related to accuracy, but has the advantage of being well used in marketing practice [Ling, C., & Li, C. (1998). Data mining for direct marketing problems and solutions. In Proceedings of the fourth international conference on knowledge discovery and data mining (KDD-98). New York, NY: AAAI Press]. Results show that under-sampling can lead to improved prediction accuracy, especially when evaluated with AUC. Unlike Ling and Li [Ling, C., & Li, C. (1998). Data mining for direct marketing problems and solutions. In Proceedings of the fourth international conference on knowledge discovery and data mining (KDD-98). New York, NY: AAAI Press], we find that there is no need to under-sample so that there are as many churners in your training set as non churners. Results show no increase in predictive performance when using the advanced sampling technique CUBE in this study. This is in line with findings of Japkowicz [Japkowicz, N. (2000). The class imbalance problem: significance and strategies. In Proceedings of the 2000 international conference on artificial intelligence (IC-AI'2000): Special track on inductive learning, Las Vegas, Nevada], who noted that using sophisticated sampling techniques did not give any clear advantage. Weighted random forests, as a cost-sensitive learner, performs significantly better compared to random forests, and is therefore advised. It should, however always be compared to logistic regression. Boosting is a very robust classifier, but never outperforms any other technique.

https://sci2s.ugr.es/keel/pdf/specific/articulo/burez_handling_2009.pdf

Handling class imbalance in customer churn prediction

Effective land-based solutions to climate change mitigation require actions that maximize soil carbon storage without generating surplus nitrogen. Land management for carbon sequestration is most often informed by bulk soil carbon inventories, without considering the form in which carbon is stored, its capacity, persistency and nitrogen demand. Here, we present coupling of European-wide databases with soil organic matter physical fractionation to determine continental-scale forest and grassland topsoil carbon and nitrogen stocks and their distribution between mineral-associated and particulate organic matter pools. Grasslands and arbuscular mycorrhizal forests store more soil carbon in mineral-associated organic carbon, which is more persistent but has a higher nitrogen demand and saturates. Ectomycorrhizal forests store more carbon in particulate organic matter, which is more vulnerable to disturbance but has a lower nitrogen demand and can potentially accumulate indefinitely. The share of carbon between mineral-associated and particulate organic matter and the ratio between carbon and nitrogen affect soil carbon stocks and mediate the effects of other variables on soil carbon stocks. Understanding the physical distribution of organic matter in pools of mineral-associated versus particulate organic matter can inform land management for nitrogen-efficient carbon sequestration, which should be driven by the inherent soil carbon capacity and nitrogen availability in ecosystems. Land management strategies for enhancing soil carbon sequestration need to be tailored to different soil types, depending on how much organic matter is stored in pools of mineral-associated and particulate organic matter, suggests an analysis of soil organic matter across Europe.

Soil carbon storage informed by particulate and mineral-associated organic matter

Abstract In this article, we share some reflections on the state of statistical science and its evolution in the production systems of official statistics. We first try to make a synthesis of the evolution of statistical thinking. We then examine the evolution of practices in official statistics, which had to face very early on a diversification of sou rces: first with the use of censuses, then sample surveys and finally administrative files. At each stage, a profound revision of methods was necessary. We show that since the middle of the 20th century, one of the major challenges of statistics has been to produce estimates from a variety of sources. To do this, a large number of methods have been proposed which are based on very different f oundations. The term “big data” encompasses a set of sources and new statistical methods. We first examine the potential of valorization of big data in official statistics. Some applications such as image analysis for agricultural prediction are very old and will be further developed. However, we report our skepticism towards web-scrapping methods. Then we examine the use of new deep learning methods. With access to more and more sources, the great challenge will remain the valorization and harmonization of these sources.

Some Thoughts on Official Statistics and its Future (with discussion)

The organisation of a design of experiments, for example, for the realisation of a clinical trial, is crucial. It is often desirable to balance designs so that the means of the covariates are approximately the same in the test and control groups. In survey sampling theory, balanced sampling and calibration are two techniques that improve the precision of estimates. In this paper, we show the links between the two areas. We begin by assessing the gain in precision between a balanced design and a simple random sampling for the least squares estimators and the estimator by differences. We compare rerandomisation techniques and the cube method in order to balance the design. We propose a new method, particularly efficient, which combines the cube method with multivariate matching. A set of simulations is carried out in order to evaluate the different methods. The interest of the calibration is shown even if the design is almost balanced. It is thus shown that tools used by survey statisticians can be useful for experimental designs and clinical trials.

Some Solutions Inspired by Survey Sampling Theory to Build Effective Clinical Trials

Résumé Nous proposons une méthode pour estimer la variance des estimateurs des évolutions qui prend en compte toutes les composantes de ceux-ci : le plan de sondage, le traitement des non-réponses, le traitement des grosses entreprises, la corrélation de la non-réponse d’une vague à l’autre, l’effet dû à l’utilisation d’un panel, la robustification et le calage au moyen d’un estimateur par le ratio. Cette méthode, qui permet la détermination d’intervalles de confiance des évolutions, est ensuite appliquée à l’enquête suisse sur la valeur ajoutée.

https://doc.rero.ch/record/288856/files/Qualite_Tille_2008.pdf

Estimation de la précision d’évolutions dans les enquêtes répétées, application à l’enquête suisse sur la valeur ajoutée

The manuscript introduces a method to select a random sample from a stream by deciding on each sampling unit immediately after observing it. The process could be applied to unequal as well as equal probability sampling. The implementation is straightforward. Algorithm selects a unit in the sample based on a single condition. It is particularly effective to make direct decisions on stream data, despite the data arriving in groups or the stream being linear.

Stream Sampling with Immediate Decision

Geographical data are generally autocorrelated. In this case, it is preferable to select spread units. In this paper, we propose a new method for selecting well-spread samples from a finite spatial population with equal or unequal inclusion probabilities. The proposed method is based on the definition of a spatial structure by using a stratification matrix. Our method exactly satisfies given inclusion probabilities and provides samples that are very well-spread. A set of simulations shows that our method outperforms other existing methods such as the Generalized Random Tessellation Stratified (GRTS) or the Local Pivotal Method (LPM). Analysis of the variance on a real dataset shows that our method is more accurate than these two. Furthermore, a variance estimator is proposed.

/pdf/spatial-spread-sampling-using-weakly-associated-vectors-5awp7ynxwq.pdf

Yves Tillé

Papers

Some Thoughts on Official Statistics and its Future (with discussion)

Some Solutions Inspired by Survey Sampling Theory to Build Effective Clinical Trials

Estimation de la précision d’évolutions dans les enquêtes répétées, application à l’enquête suisse sur la valeur ajoutée

Stream Sampling with Immediate Decision

Spatial Spread Sampling Using Weakly Associated Vectors.