Foraging across the life span: is there a reduction in exploration with aging?
TL;DR: Overall, the evidence suggests that foraging behavior may undergo significant changes across the life span across internal and external search, and finds evidence of a trend toward reduced exploration with increased age.
Abstract: Does foraging change across the life span, and in particular, with aging? We report data from two foraging tasks used to investigate age differences in search in external environments as well as internal search in memory. Overall, the evidence suggests that foraging behavior may undergo significant changes across the life span across internal and external search. In particular, we find evidence of a trend towards reduced exploration with increased age. We discuss these findings in light of theories that postulate a link between aging and reductions in novelty seeking and exploratory behavior.
Citations
More filters
TL;DR: The idea that children may be more exploratory than adults, and this increased exploration influences learning, is supported using a task that presents a “learning trap.”
19 citations
TL;DR: Building a predictive model of search to disentangle the unique contributions of the three hypotheses of developmental differences, robust and recoverable parameter estimates are found indicating that children generalize less and rely on directed exploration more than adults.
Abstract: How do children and adults differ in their search for rewards? We consider three different hypotheses that attribute developmental differences to either children9s increased random sampling, more directed exploration towards uncertain options, or narrower generalization. Using a search task in which noisy rewards are spatially correlated on a grid, we compare 55 younger children (age 7-8), 55 older children (age 9-11), and 50 adults (age 19-55) in their ability to successfully generalize about unobserved outcomes and balance the exploration-exploitation dilemma. Our results show that children explore more eagerly than adults, but obtain lower rewards. Building a predictive model of search to disentangle the unique contributions of the three hypotheses of developmental differences, we find robust and recoverable parameter estimates indicating that children generalize less and rely on directed exploration more than adults. We do not, however, find reliable differences in terms of random sampling.
18 citations
TL;DR: The results suggest that urban chickadees exhibit less neophobia than their rural counterparts because they have generally learned to tolerate novelty in their habitat, they have adapted to live in an environment that rewards low neophobia, and they are less reluctant to use feeders at new locations.
Abstract: As human populations increase and city borders grow, many animals have to modify foraging behaviors in order to exploit evolutionarily novel urban food sources that could aid their survival. Neophobia, the fear of novelty, can lead to missed opportunities in these cases. Here, we studied the novelty response of wild animals in ecologically relevant conditions while controlling for individual characteristics and potential differences in foraging group size. We predicted that urban black-capped chickadees (Poecile atricapillus) would be more likely to initially contact novelty than rural chickadees and that subordinates and juveniles would be more likely to first contact novelty than dominants and adults, respectively. We ran replicated experiments using three novelty types (object, color, or food) on six sites, during which we registered feeder choice of 71 tagged individuals. We found that urban chickadees showed less neophobia than their rural counterparts, the latter having a higher probability of initially contacting the familiar feeder before approaching the novel feeder. There was no significant effect of an individual’s dominance, age, or sex on its first choice of feeder, nor was there any effect of novelty type. Overall, our results suggest that urban chickadees exhibit less neophobia than their rural counterparts because they have generally learned to tolerate novelty in their habitat, they have adapted to live in an environment that rewards low neophobia, and/or they are less reluctant to use feeders at new locations.
17 citations
TL;DR: Evidence that heightened exploration in adolescence, relative to adulthood, can lead to positive outcomes is provided and contributes to the understanding of the role increased novelty-seeking plays at this point in the lifespan.
Abstract: Adolescence is a period of heightened exploration relative to adulthood and childhood. This predisposition has been linked with negative behaviours related to risk-taking, including dangerous driving, substance misuse and risky sexual practices. However, recent models have argued that adolescents' heightened exploration serves a functional purpose within the lifespan, allowing adolescents to develop experiential knowledge of their surroundings. Yet, there is limited evidence that heightened exploration in adolescence is associated with positive outcomes. To address this, the present pre-registered study utilised a foraging paradigm with a sample of adolescents aged 16-17 (N = 68) and of adults aged 21 and above (N = 69). Participants completed a patch foraging task, which required them to choose between exploiting a known resource which gradually yields fewer rewards, and exploring a novel, unknown resource with a fresh distribution of rewards. Findings demonstrated that adolescents explored more than adults, which - in the context of the current task-represented more optimal patch foraging behaviour. These findings indicate that adolescents' heightened exploration can be beneficial, as they were able to effectively navigate unknown environments and accrue rewards more successfully than adults. This provides evidence that heightened exploration in adolescence, relative to adulthood, can lead to positive outcomes and contributes to our understanding of the role increased novelty-seeking plays at this point in the lifespan.
17 citations
TL;DR: This paper investigated individual differences in this general tendency to explore (exploit) can be captured across three behavioral paradigms that involve exploration-exploitation trade-offs: a foraging task involving sequential search for fish in several ponds, a multiarmed bandit task involving repeatedly choosing from a set of options, and a sequential choice task involving choosing a candidate from a pool of applicants.
Abstract: Recently it has been suggested that individual humans and other animals possess different levels of a general tendency to explore or exploit that may influence behavior in different contexts. In the present work, we investigated whether individual differences in this general tendency to explore (exploit) can be captured across three behavioral paradigms that involve exploration-exploitation trade-offs: A foraging task involving sequential search for fish in several ponds, a multiarmed bandit task involving repeatedly choosing from a set of options, and a sequential choice task involving choosing a candidate from a pool of applicants. Two hundred and sixty-one participants completed two versions of each of the three tasks. Structural equation modeling revealed that there was no single, general factor underlying exploration behavior in all tasks, even though individual differences in exploration were stable across the two versions of the same task. The results suggest that task-specific factors influence individual levels of exploration. This finding causes difficulties in the enterprise of measuring general exploration tendencies using single behavioral paradigms and suggests that more work is needed to understand how general exploration tendencies and task-specific characteristics translate into exploratory behavior in different contexts.
15 citations
Cites methods from "Foraging across the life span: is t..."
...The foraging task was a computerized fishing task in which participants had to maximize the number of fish they could catch within 45 min (Hutchinson et al., 2008; Mata et al., 2009, 2013)....
[...]
References
More filters
Book•
01 Jan 1988TL;DR: This book provides a clear and simple account of the key ideas and algorithms of reinforcement learning, which ranges from the history of the field's intellectual foundations to the most recent developments and applications.
Abstract: Reinforcement learning, one of the most active research areas in artificial intelligence, is a computational approach to learning whereby an agent tries to maximize the total amount of reward it receives when interacting with a complex, uncertain environment. In Reinforcement Learning, Richard Sutton and Andrew Barto provide a clear and simple account of the key ideas and algorithms of reinforcement learning. Their discussion ranges from the history of the field's intellectual foundations to the most recent developments and applications. The only necessary mathematical background is familiarity with elementary concepts of probability. The book is divided into three parts. Part I defines the reinforcement learning problem in terms of Markov decision processes. Part II provides basic solution methods: dynamic programming, Monte Carlo methods, and temporal-difference learning. Part III presents a unified view of the solution methods and incorporates artificial neural networks, eligibility traces, and planning; the two final chapters present case studies and consider the future of reinforcement learning.
37,989 citations
"Foraging across the life span: is t..." refers background in this paper
...Exploration is an adaptive first step because it allows one to acquire information about the environment that will later lead to successful exploitation (Sutton and Barto, 1998)....
[...]
TL;DR: The analysis of censored failure times is considered in this paper, where the hazard function is taken to be a function of the explanatory variables and unknown regression coefficients multiplied by an arbitrary and unknown function of time.
Abstract: The analysis of censored failure times is considered. It is assumed that on each individual arc available values of one or more explanatory variables. The hazard function (age-specific failure rate) is taken to be a function of the explanatory variables and unknown regression coefficients multiplied by an arbitrary and unknown function of time. A conditional likelihood is obtained, leading to inferences about the unknown regression coefficients. Some generalizations are outlined.
28,264 citations
TL;DR: A theory is proposed that increased age in adulthood is associated with a decrease in the speed with which many processing operations can be executed and that this reduction in speed leads to impairments in cognitive functioning because of what are termed the limited time mechanism and the simultaneity mechanism.
Abstract: A theory is proposed to account for some of the age-related differences reported in measures of Type A or fluid cognition. The central hypothesis in the theory is that increased age in adulthood is associated with a decrease in the speed with which many processing operations can be executed and that this reduction in speed leads to impairments in cognitive functioning because of what are termed the limited time mechanism and the simultaneity mechanism. That is, cognitive performance is degraded when processing is slow because relevant operations cannot be successfully executed (limited time) and because the products of early processing may no longer be available when later processing is complete (simultaneity). Several types of evidence, such as the discovery of considerable shared age-related variance across various measures of speed and large attenuation of the age-related influences on cognitive measures after statistical control of measures of speed, are consistent with this theory.
5,094 citations
"Foraging across the life span: is t..." refers background in this paper
...…times have been suggested to capture reliable individual differences in search (Dougherty and Harbison, 2007), any reaction-time based measure poses interpretational problems regarding exploratory tendencies with aging due to overall age differences in motor and cognitive speed (Salthouse, 1996)....
[...]
TL;DR: The present study used meta-analytic techniques to determine the patterns of mean-level change in personality traits across the life course and showed that people increase in measures of social dominance, conscientiousness, and emotional stability in young adulthood and decrease in both of these domains in old age.
Abstract: The present study used meta-analytic techniques (number of samples = 92) to determine the patterns of mean-level change in personality traits across the life course. Results showed that people increase in measures of social dominance (a facet of extraversion), conscientiousness, and emotional stability, especially in young adulthood (age 20 to 40). In contrast, people increase on measures of social vitality (a 2nd facet of extraversion) and openness in adolescence but then decrease in both of these domains in old age. Agreeableness changed only in old age. Of the 6 trait categories, 4 demonstrated significant change in middle and old age. Gender and attrition had minimal effects on change, whereas longer studies and studies based on younger cohorts showed greater change.
2,791 citations
"Foraging across the life span: is t..." refers background in this paper
...Research on humans suggests that openness and novelty seeking declines over the life span as measured by self-report (Roberts et al., 2006; Lucas and Donnellan, 2011)....
[...]
...But what evidence is there of age differences in novelty seeking and exploratory behavior? Research on humans suggests that openness and novelty seeking declines over the life span as measured by self-report (Roberts et al., 2006; Lucas and Donnellan, 2011)....
[...]
Posted Content•
TL;DR: This article presented a psychometric scale that assesses risk taking in various content domains: financial decisions, health/safety, recreational, ethical, and social decisions, and found that respondents' degree of risk taking was highly domain-specific, i.e. not consistently risk-averse or consistently riskseeking across all content domains.
Abstract: We present a psychometric scale that assesses risk taking in five content domains: financial decisions (separately for investing versus gambling), health/safety, recreational, ethical, and social decisions. Respondents rate the likelihood that they would engage in domain-specific risky activities (Part I). An optional Part II assesses respondents’ perceptions of the magnitude of the risks and expected benefits of the activities judged in Part I. The scale’s construct validity and consistency is evaluated for a sample of American undergraduate students. As expected, respondents’ degree of risk taking was highly domain-specific, i.e. not consistently risk-averse or consistently risk-seeking across all content domains. Women appeared to be more risk-averse in all domains except social risk. A regression of risk taking (likelihood of engaging in the risky activity) on expected benefits and perceived risks suggests that gender and content domain differences in apparent risk taking are associated with differences in the perception of the activities’ benefits and risk, rather than with differences in attitude towards perceived risk.
2,340 citations
"Foraging across the life span: is t..." refers background in this paper
...…= 99) completed a number of questionnaire measures that we reasoned could be related to exploratory behavior, including risk-taking in the investment and gambling domain (Weber et al., 2002), maximization tendencies (Schwartz et al., 2002), and future time perspective (Lang and Carstensen, 2002)....
[...]