Space-time calibration of radar rainfall data
01 Jan 2001-Journal of The Royal Statistical Society Series C-applied Statistics (John Wiley & Sons, Ltd)-Vol. 50, Iss: 2, pp 221-241
TL;DR: A space–time model for use in environmental monitoring applications is developed as a high dimensional multivariate state space time series model, in which the cross-covariance structure is derived from the spatial context of the component series, in such a way that its interpretation is essentially independent of the particular set of spatial locations at which the data are recorded.
Abstract: Motivated by a specific problem concerning the relationship between radar reflectance and rainfall intensity, the paper develops a space–time model for use in environmental monitoring applications. The model is cast as a high dimensional multivariate state space time series model, in which the cross-covariance structure is derived from the spatial context of the component series, in such a way that its interpretation is essentially independent of the particular set of spatial locations at which the data are recorded. We develop algorithms for estimating the parameters of the model by maximum likelihood, and for making spatial predictions of the radar calibration parameters by using realtime computations. We apply the model to data from a weather radar station in Lancashire, England, and demonstrate through empirical validation the predictive performance of the model.
Citations
More filters
Posted Content•
TL;DR: In this paper, the authors provide a unified and comprehensive theory of structural time series models, including a detailed treatment of the Kalman filter for modeling economic and social time series, and address the special problems which the treatment of such series poses.
Abstract: In this book, Andrew Harvey sets out to provide a unified and comprehensive theory of structural time series models. Unlike the traditional ARIMA models, structural time series models consist explicitly of unobserved components, such as trends and seasonals, which have a direct interpretation. As a result the model selection methodology associated with structural models is much closer to econometric methodology. The link with econometrics is made even closer by the natural way in which the models can be extended to include explanatory variables and to cope with multivariate time series. From the technical point of view, state space models and the Kalman filter play a key role in the statistical treatment of structural time series models. The book includes a detailed treatment of the Kalman filter. This technique was originally developed in control engineering, but is becoming increasingly important in fields such as economics and operations research. This book is concerned primarily with modelling economic and social time series, and with addressing the special problems which the treatment of such series poses. The properties of the models and the methodological techniques used to select them are illustrated with various applications. These range from the modellling of trends and cycles in US macroeconomic time series to to an evaluation of the effects of seat belt legislation in the UK.
4,252 citations
TL;DR: In this paper, the authors propose general classes of nonseparable, stationary covariance functions for spatiotemporal random processes, which are directly in the space-time domain and do not depend on closed-form Fourier inversions.
Abstract: Geostatistical approaches to spatiotemporal prediction in environmental science, climatology, meteorology, and related fields rely on appropriate covariance models. This article proposes general classes of nonseparable, stationary covariance functions for spatiotemporal random processes. The constructions are directly in the space–time domain and do not depend on closed-form Fourier inversions. The model parameters can be associated with the data's spatial and temporal structures, respectively; and a covariance model with a readily interpretable space–time interaction parameter is fitted to wind data from Ireland.
753 citations
TL;DR: A brief overview of hierarchical approaches applied to environmental processes can be found in this article, where the key elements of such models can be considered in three general stages, the data stage, process stage, and parameter stage.
Abstract: Summary
Environmental systems are complicated. They include very intricate spatio-temporal processes, interacting on a wide variety of scales. There is increasingly vast amounts of data for such processes from geographical information systems, remote sensing platforms, monitoring networks, and computer models. In addition, often there is a great variety of scientific knowledge available for such systems, from partial differential equations based on first principles to panel surveys. It is argued that it is not generally adequate to consider such processes from a joint perspective. Instead, the processes often must be considered as a coherently linked system of conditional models. This paper provides a brief overview of hierarchical approaches applied to environmental processes. The key elements of such models can be considered in three general stages, the data stage, process stage, and parameter stage. In each stage, complicated dependence structure is mitigated by conditioning. For example, the data stage can incorporate measurement errors as well as multiple datasets with varying supports. The process and parameter stages can allow spatial and spatio-temporal processes as well as the direct inclusion of scientific knowledge. The paper concludes with a discussion of some outstanding problems in hierarchical modelling of environmental systems, including the need for new collaboration approaches.
Resume
Les systemes environnementaux sont complexes. Ils incluent des processus spatio-temporels tres complexes, interagissant sur une large variete d'echelles. II existe des quantites de plus en plus grandes de donnees sur de tels processus, provenant des systemes d'information geographiques, des plateformes de teledetection, des reseaux de surveillance et des modeles informatiques. De plus, il y a souvent une grande variete de connaissance scientifique disponible sur de tels systemes, depuis les equations differentielles partielles jusqu'aux enquetes de panels. II est reconnu qu'il n'est generalement pas correct de considerer de tels processus d'une perspective commune. Au contraire, les processus doivent souvent etre examines comme des systemes de modeles conditionnels lies de maniere coherente. Cet article fournit un bref apercu des approches hierachiques appliquees aux processus environnementaux. Les elements cles de tels modeles peuvent etre examines a trois etapes principales: l'etape des donnees, celle du traitement et celle des parametres. A chaque etape, la structure complexe de dependance est attenuee par le conditionnement. Par exemple, le stade des donnees peut incorporer des erreurs de mesure ainsi que de multiples ensembles de donnees sous divers supports. Les stades du traitement et des parametres peuvent admettre des processus spatiaux et spatio-temporels ainsi que l'inclusion directe du savoir scientifique. L'article conclut par une discussion de quelques problemes en suspens dans la modelisation hierarchique des systemes environnementaux, incluant le besoin de nouvelles approches de collaboration.
237 citations
Cites background from "Space-time calibration of radar rai..."
...Note that in addition to PDEs, recent work has shown that for continuous space/discrete time processes, one can use integro-difference equations in a hierarchical context to model dynamical systems (Wikle and Cressie 1999; Brown et al. 2000; Brown et al. 2001; Wikle 2001)....
[...]
01 Jan 2003
TL;DR: The scientific focus is to study a spatial phenomenon, s(x)say, which exists throughout a continuous spatial region A ⊂ ℝ2 and can be treated as if it were a realisation of a stochastic process S(·) = {S(x): x ∈ A}.
Abstract: The term geostatistics identifies the part of spatial statistics which is concerned with continuous spatial variation, in the following sense. The scientific focus is to study a spatial phenomenon, s(x)say, which exists throughout a continuous spatial region A ⊂ ℝ2 and can be treated as if it were a realisation of a stochastic process S(·) = {S(x): x ∈ A}. In general, S(·) is not directly observable. Instead, the available data consist of measurements Y 1,..., Y n taken at locations x 1,..., x n sampled within A, and Y i is a noisy version of S(x i ). We shall assume either that the sampling design for x 1,..., x n is deterministic or that it is stochastic but independent of the process S(·), and all analyses are carried out conditionally on x 1,...,x n .
161 citations
TL;DR: In this paper, a non-separable covariance function has been proposed to model the spread of an air pollutant in a stochastic differential equation, which is well suited to a wide range of realistic problems.
Abstract: Statistical space–time modelling has traditionally been concerned with separable covariance functions, meaning that the covariance function is a product of a purely temporal function and a purely spatial function. We draw attention to a physical dispersion model which could model phenomena such as the spread of an air pollutant. We show that this model has a non-separable covariance function. The model is well suited to a wide range of realistic problems which will be poorly fitted by separable models. The model operates successively in time: the spatial field at time t +1 is obtained by 'blurring' the field at time t and adding a spatial random field. The model is first introduced at discrete time steps, and the limit is taken as the length of the time steps goes to 0. This gives a consistent continuous model with parameters that are interpretable in continuous space and independent of sampling intervals. Under certain conditions the blurring must be a Gaussian smoothing kernel. We also show that the model is generated by a stochastic differential equation which has been studied by several researchers previously.
143 citations
References
More filters
23,905 citations
01 Jan 2001
TL;DR: In this paper, the clssical filleting and prediclion problem is re-examined using the Bode-Shannon representation of random processes and the?stat-tran-sition? method of analysis of dynamic systems.
Abstract: The clssical filleting and prediclion problem is re-examined using the Bode-Shannon representation of random processes and the ?stat-tran-sition? method of analysis of dynamic systems. New result are: (1) The formulation and Methods of solution of the problm apply, without modification to stationary and nonstationary stalistics end to growing-memory and infinile -memory filters. (2) A nonlinear difference (or differential) equalion is dericed for the covariance matrix of the optimal estimalion error. From the solution of this equation the coefficients of the difference, (or differential) equation of the optimal linear filter are obtained without further caleulations. (3) Tke fillering problem is shoum to be the dual of the nois-free regulator problem. The new method developed here, is applied to do well-known problems, confirming and extending, earlier results. The discussion is largely, self-contatained, and proceeds from first principles; basic concepts of the theory of random processes are reviewed in the Appendix.
15,391 citations
Book•
30 Mar 1990TL;DR: In this article, the Kalman filter and state space models were used for univariate structural time series models to estimate, predict, and smoothen the univariate time series model.
Abstract: List of figures Acknowledgement Preface Notation and conventions List of abbreviations 1. Introduction 2. Univariate time series models 3. State space models and the Kalman filter 4. Estimation, prediction and smoothing for univariate structural time series models 5. Testing and model selection 6. Extensions of the univariate model 7. Explanatory variables 8. Multivariate models 9. Continuous time Appendices Selected answers to exercises References Author index Subject index.
5,071 citations
Posted Content•
TL;DR: In this paper, the authors provide a unified and comprehensive theory of structural time series models, including a detailed treatment of the Kalman filter for modeling economic and social time series, and address the special problems which the treatment of such series poses.
Abstract: In this book, Andrew Harvey sets out to provide a unified and comprehensive theory of structural time series models. Unlike the traditional ARIMA models, structural time series models consist explicitly of unobserved components, such as trends and seasonals, which have a direct interpretation. As a result the model selection methodology associated with structural models is much closer to econometric methodology. The link with econometrics is made even closer by the natural way in which the models can be extended to include explanatory variables and to cope with multivariate time series. From the technical point of view, state space models and the Kalman filter play a key role in the statistical treatment of structural time series models. The book includes a detailed treatment of the Kalman filter. This technique was originally developed in control engineering, but is becoming increasingly important in fields such as economics and operations research. This book is concerned primarily with modelling economic and social time series, and with addressing the special problems which the treatment of such series poses. The properties of the models and the methodological techniques used to select them are illustrated with various applications. These range from the modellling of trends and cycles in US macroeconomic time series to to an evaluation of the effects of seat belt legislation in the UK.
4,252 citations
"Space-time calibration of radar rai..." refers methods in this paper
...For an introduction to state space models and the Kalman filter, see Harvey (1989) or Young (1999)....
[...]
TL;DR: In this paper, the variation of rainfall intensity at a fixed point in space is discussed for the variation in rainfall intensity over a fixed period of time and the main properties of these models are determined analytically.
Abstract: Stochastic models are discussed for the variation of rainfall intensity at a fixed point in space. First, models are analysed in which storm events arise in a Poisson process, each such event being associated with a period of rainfall of random duration and constant but random intensity. Total rainfall intensity is formed by adding the contributions from all storm events. Then similar but more complex models are studied in which storms arise in a Poisson process, each storm giving rise to a cluster of rain cells and each cell being associated with a random period of rain. The main properties of these models are determined analytically. Analysis of some hourly rainfall data from Denver, Colorado shows the clustered models to be much the more satisfactory.
597 citations