How Closely Do Hypothetical Surveys and Laboratory Experiments Predict Field Behavior

TLDR: In this article, the authors compare the ability of three preference elicitation methods (hypothetical choices, non-, hypothetical choices, and non-hypotheses) and three discrete-choice econometric models (the multinomial logit [MNL], the independent availability logit, and the random parameter logit (RPL)) to predict actual retail shopping behavior in three different product categories (ground beef, wheat flour, and dishwashing liquid).

Abstract: We compare the ability of three preference elicitation methods (hypothetical choices, nonhypothetical choices, and nonhypothetical rankings) and three discrete-choice econometric models (the multinomial logit [MNL], the independent availability logit [IAL], and the random parameter logit [RPL]) to predict actual retail shopping behavior in three different product categories (ground beef, wheat flour, and dishwashing liquid). Overall, we find a high level of external validity. Our specific results suggest that the nonhypothetical elicitation approaches, especially the nonhypothetical ranking method, outperformed the hypothetical choice experiment in predicting retail sales. We also find that the RPL can have superior predictive performance, but that the MNL predicts equally well in some circumstances. experiment.