What is concerned with the functions and purposes of the mind and behavior in the individuals adaptation to the environment?

Plasticity refers to changes in the brain that enable an organism to adapt its behavior in the face of changing environmental demands. The evolutionary role of plasticity is to provide the cognitive flexibility to learn from experiences, to monitor the world based on learned predictions, and adjust actions when these predictions are violated. Both progressive (myelination) and regressive (synaptic pruning) brain changes support this type of adaptation. Experience-driven changes in neural connections underlie the ability to learn and update thoughts and behaviors throughout life. Many cognitive and behavioral indices exhibit nonlinear life-span trajectories, suggesting the existence of specific sensitive developmental periods of heightened plasticity. We propose that age-related differences in learning capabilities and behavioral performance reflect the distinct maturational timetable of subcortical learning systems and modulatory prefrontal regions. We focus specifically on the developmental transition of adolescence, during which individuals experience difficulty flexibly adjusting their behavior when confronted with unexpected and emotionally salient events. In this article, we review the findings illustrating this phenomenon and how they vary by individual.

Keywords: adolescence, development, individual differences, learning, plasticity, reward, self-control

One of the fundamental purposes of brain plasticity is to provide the capacity to adapt and optimize behavior in accordance with the current environmental demands. This capability to learn through experience to obtain reward or to avoid danger serves a clear evolutionary purpose. An organism’s fitness may critically depend on the ability to adjust behavior to maximize the likelihood of a successful hunt or, more contemporarily, a lucrative business deal. Subcortical systems have been shown to support essential, evolutionarily-conserved learning processes involving reward (Galvan et al., 2005; Pagnoni et al., 2002; Schultz et al., 1997) and threat (Delgado et al., 2008; Soliman et al., 2010). But these systems do not operate independently; rather they are part of a broad interactive network of brain regions (Casey et al., 2001). Regions of prefrontal cortex are thought to play a modulatory role within this network, by enabling the suppression of the subcortical regions involved in immediate motivationally-driven behaviors in favor of longer term goal-oriented ones (for a review, see (Somerville and Casey, 2010).

The ability to adapt and optimize behavior varies as a function of age, the individual, as well as context. Age-related differences in cognitive flexibility may arise due to both maturational constraints of developing brain regions (Galvan et al., 2006), and the connectivity between interacting brain systems (Liston et al., 2006). These differences are particularly apparent during transitional periods, when previously adaptive behaviors may gradually become incompatible with a new range of experiences that arise across the lifespan. Flexibility in adjusting behavior to changing environmental demands also depends upon an individual’s unique experiential history. As such, some individuals are less able than others to flexibly suppress an inappropriate action, such as not eating cookies when dieting. That flexibility is particularly challenged in the context of highly salient cues (e.g., an ice cream sundae). This paper examines flexibility and rigidity in behavioral adaptation as environmental demands vary across development and individuals.

Learning across development is a continuous interactive process shaped by both progressive (synaptogenesis, myelination) and regressive (synaptic pruning, apoptosis) neuronal changes (Brown et al., 2005; Casey et al., 2006; De Haan and Johnson, 2003; Thompson and Nelson, 2001) as the brain adapts to its environment. These plastic changes have been classified as either experience-expectant or experience dependent (Greenough et al., 1987). Experience-expectancy characterizes plasticity mechanisms that process environmental inputs common to all individuals of a species whereas experience-dependent mechanisms are sensitive to the specific inputs to which the individuals are exposed. Experience-expectant plasticity is thought to shape species-typical development while learning seems to be more reliant on experience-dependent input (Galvan, 2010; Greenough et al., 1987). As an individual interacts with the environment and experiences accumulate, skills and behaviors become gradually modularized (Johnson and De Haan, 2011; Karmiloff-Smith, 1992) or entrenched (Zevin and Seidenberg, 2004). The capacity for plastic remodeling is reduced throughout development, and the structural and functional architecture of the brain that was once heavily influenced by new experiences, becomes increasingly fixed (Feldman and Brecht, 2005; Zevin and Seidenberg, 2004). Thus, one’s development reflects not only biological constraints, but also the effects of experiential history, which interact to shape and constrain behavior.

One of the essential aspects of plasticity is the capacity to adapt to changing environmental demands over time. Evolution has shaped the brain to successfully deal with the physical and social demands of the world. As these demands change with transitions through childhood, adolescence, young adulthood, and middle to late adulthood, corresponding adjustments in behavior are required. In this paper, we focus on adolescence as one such period of changing environmental demands.

By definition, adolescence poses new demands, as the individual moves from dependence on parents to relative independence. This developmental transition is not specific to humans. Independence-seeking behaviors including increases in peer interactions and novelty-seeking behaviors are prevalent across species. Individuals within a species typically emigrate away from the home territory around the time of sexual maturation, in order to reduce inbreeding, as inbred offspring exhibit lower viability due to greater expression of recessive genes (Bixler, 1992; Moore, 1992; Pereira and Altmann, 1985; Schlegel and Barry, 1991). These independence-seeking behaviors serve adaptive functions (Crockett and Pope, 1993; Irwin and Millstein, 1986; Spear, 2010), increasing the probability of reproductive success, improving life circumstances, and obtaining resources necessary for survival (Belsky et al., 1991; Csikszentmihalyi and Larson, 1987; Daly and Wilson, 1987; Meschke and Silbereisen, 1997). These behaviors have been suggested to be the product of a biologically driven imbalance between heightened novelty- and sensation-seeking and immature “self-regulatory competence” (Steinberg, 2004) or ability to change behavior in accordance with environmental demands. Understanding behavioral and brain changes that impact the adolescent’s ability to adapt to these changing environmental demands is key in understanding plasticity during this period of development.

Through our interactions with the world, we form predictions about what will occur based on the frequency and co-occurrence of experienced events. The rate of occurrence of events can bias our behavior such that we are faster to respond to frequent ones and slower to respond to rare ones. A stimulus becomes familiar or learned through repeated presentations, as in the classic habituation paradigm used with infants (Bornstein, 1998; Fantz, 1964) or the oddball paradigm used in electrophysiological studies (Knight, 1984). Our expectations become biased in favor of frequent or familiar events as evidenced by quicker responses or shorter looking times toward them, and longer responses to rare or novel ones.

Learning to predict specific situations is essential to guide one’s thoughts and actions. When predictions are violated, the organism needs to detect theses occurrences and learn from them in order to adapt behavior accordingly to changing environmental demands (Kahneman and Tversky, 1979). Thus learning depends not only on detecting co-occurrences of events, but on processing the discrepancy between what we learn to expect and what actually happens (Rescorla and Wagner, 1972). In order to behave adaptively in a changing environment, our predictions must be updated based on experience.

Neural circuitry comprised of dopaminergic neurons in the ventral tegmental area of the midbrain and their target areas in the limbic forebrain, particularly the ventral striatum and prefrontal cortex, has been implicated in biasing behavior toward predictable events (Haber, 2003; Nestler, 2004; Volkow et al., 2011). The ventral striatum is proposed to assign value to current rewards as part of the process of learning to predict future events. These value signals are broadcast to prefrontal control regions to help guide future behavior (Knutson et al., 2001; O’Doherty et al., 2002). During learning, dopamine activity shifts from rewards themselves to cues that predict rewards (Hollerman and Schultz, 1998; Mirenowicz and Schultz, 1994). Rather than indicating the presence or absence of rewards or events per se, these dopaminergic neurons are argued to encode a prediction error, signaling the difference between actual and predicted value of an event (Arias-Carrion and Poppel, 2007; Montague et al., 1996; Schultz et al., 1997). If an expected reward is not received then firing of dopaminergic neurons decreases at the time the event should have occurred. When a reward is greater than expected, the firing of dopaminergic neurons increases (Schultz et al., 1997), increasing motivation towards the cue via a learning mechanism referred to as prediction error. Thus, in order to flexibly respond to a changing environment, our brain requires the integration of stimuli, behavioral responses and feedback information that depend on particular cues and contexts. Importantly, this learning process appears to be subject to modulation by age (see Sections 3.2 and 3.3). Here, we focus specifically on developmental changes in learning that occur during adolescence.

The capacity to change one’s actions in order to cope with new demands appears to develop progressively in life (Somerville et al., 2010). A challenge for developmental neuroscience is to understand the neural changes that bridge the gap between detecting changes in the environment and the actual adaptation of behavior. Predictive learning is a cornerstone of behavioral development. Knowing what events to expect when, and in which contexts, is critical for planning and maintaining contextually appropriate thoughts or actions over time. Adjusting behavior when these predictions are violated is an essential element of behavioral regulation. There is a wealth of behavioral evidence from experimental paradigms in controlled laboratory settings that show a steady improvement in the ability to suppress an inappropriate response in favor of an appropriate one from infancy to adulthood (Case, 1972; Casey, 2005; Casey et al., 2005; Davidson et al., 2006; Flavell et al., 1966; Keating and Bobbitt, 1978; Pascual-Leone, 1970). Classic examples of these paradigms include the “A not B” task in infancy (Diamond, 1985; Piaget, 1954) and Stroop (Tipper et al., 1989), card sorting (Munakata and Yerys, 2001; Zelazo et al., 1996), antisaccade (Luna et al., 2001) and go-nogo tasks (Casey et al., 1997; Luria, 1961) in childhood and adolescence. In all cases, children have a more difficult time overriding habitual or salient actions in favor of the current appropriate action with this ability gradually developing throughout early adolescence (Passler et al., 1985). Thus, behavioral development relies on the process of learning from our environment and adapting behaviors appropriately.

Behavioral adaptation – the flexibility or ability to alter ones actions in order to adapt to new circumstances – improves from infancy to adulthood. However, recent studies have begun to provide elegant demonstrations of how this ability is differentially biased in motivational contexts. These studies suggest a change in sensitivity to environmental cues, particularly to those signaling potential reward, at different points in development, with a unique influence of motivational cues on behavior during adolescence (Casey and Jones, In press; Somerville and Casey, 2010) that may be consistent with experience-expectant demands. For example, using a gambling task in which reward feedback was provided immediately (“hot” trials) or after a delay (“cold” trials), Figner and colleagues (Figner et al., 2009) showed that adolescents made disproportionately more risky gambles compared to adults but only in the “hot” condition. Using a similar gambling task, Cauffman and colleagues (Cauffman et al., 2010) have shown that this sensitivity to rewards and incentives actually peaks during adolescence, as demonstrated by a steady increase from late childhood to adolescence in tendency to play with more advantageous decks of cards, followed by a subsequent decline from late adolescence to adulthood. These findings illustrate a curvilinear function, peaking roughly between 13 and 17, and subsequently declining (Steinberg et al., 2009).

Recently, Somerville et al. (2011) provided evidence for a specific reduction in behavioral regulation in adolescents relative to children and adults when faced with unpredictable cues signaling appetitive value. Using a go-nogo task that contained social appetitive cues (e.g., happy faces) that facilitated approach responses, she showed developmental differences in subjects’ ability to flexibly approach or avoid positive or neutral stimuli. Specifically, adolescents had more difficulty suppressing a response to rare appetitive cues relative to neutral ones, which was not observed in children and adults (see Figure 1a).

What is concerned with the functions and purposes of the mind and behavior in the individuals adaptation to the environment?

Behavioral performance by emotion and development

(A) Gray line represents proportion of correct hits out of total go trials; black line represents proportion of false alarms out of total no-go trials. The y-axis represents the proportion of responses for happy trials adjusted for proportion of responses for calm trials.

(B) Brain regions showing differential activity as a function of age. Activations, threshold p < .05, small volume corrected, are rendered on a representative high-resolution anatomical scan. The left side of image corresponds to the left side of the brain.

(C) Plot of activity in the ventral striatum (circled in panel B) response to happy faces (no-go and go conditions collapsed) relative to rest as a function of age. Adolescents show a significantly larger magnitude of activation relative to both children and adults.

Copyright: MIT Press Journals. Reprinted with permission (Somerville et al, 2011).

In a recent study using a probabilistic learning task, Cohen et al. (2010) examined how the expectation of an event based on prior outcomes and its reward value (e.g. low or high magnitude) impacts behavior. As expected, individuals of all ages were more accurate and quicker to react when responding to predictable stimuli. However, adolescents responded more quickly to stimuli that have been previously associated with a higher reward value. Thus at different ages, predicted outcomes and incentives may drive behavior in different ways. To better understand the behavioral changes observed across this period of development, it is essential to explore the biological changes behind them.

The human brain undergoes significant changes in both its structural architecture and functional organization early in life that reflect on-going progressive and regressive processes (Casey et al., 2005). Even though total brain volume approximates that of the adult by 5 or 6 years of age, many of these developmental processes continue well into young adulthood. These developmental changes include proliferation and migration of cells mostly during fetal development (Jacobson, 1991; Rabinowicz, 1986), followed by regional changes in synaptic density (Bourgeois et al., 1994; Huttenlocher, 1979; Huttenlocher, 1990), and development of myelination (Yakovlev, 1967). The changes appear to be regional in nature in that cortical sensory and subcortical areas undergo dynamic changes like synaptic pruning earlier than higher-order cortical association areas (Huttenlocher, 1997; Rakic et al., 1986). Patterns of regional brain development is consistent with recent human anatomical magnetic resonance imaging (MRI) studies showing protracted development of gray matter in higher-order prefrontal areas that continues into young adulthood (Giedd et al., 1999) relative to subcortical regions that appear to be structurally mature by adolescence (Sowell et al., 2002).

Significant regional neurochemical changes occur within this circuitry that further support nonlinear changes in brain development. Within the dopamine system (Buckley et al., 2009; Cardinal et al., 2001; Gill et al., 2010; Pasupathy and Miller, 2005), a peak in dopamine receptor density occurs in the striatum during early adolescence (Benes et al., 2000; Brenhouse et al., 2008; Galvan et al., 2005), whereas this peak does not emerge until later in the prefrontal cortex (Cunningham et al., 2008; Tseng and O’Donnell, 2007). This differential timeline in the peak receptor density in the striatum and cortex may result in an imbalance between these systems. However, how changes in dopamine systems may relate to motivated behavior is unclear, as controversy remains as to whether behavioral sensitivity to reward stems from less active or hypersensitive dopamine systems (Robinson and Berridge, 2003; Volkow and Swanson, 2003). This controversary is consistent with the mixed adolescent imaging findings of diminished or elevated ventral striatal activity in anticipation of appetitive outcomes (Bjork et al., 2010; Somerville et al., 2011). Nonetheless, neuroanatomical and neurochemical changes in dopamine-rich circuitry during adolescence coincide with differences in motivated behavior that are distinct from pre-adolescence and adulthood (Brenhouse et al., 2008; Spear, 2010).

Evidence for regional neurochemical, structural and functional brain changes with development have led to a theoretical account of adolescence referred to as the imbalance model (Casey et al., 2008; Galvan et al., 2006). Similar “dual systems” models have been described (Dahl, 2004; Steinberg, 2005, 2008). According to our model, reward-related subcortical regions and prefrontal control regions interact differently as a circuit across development. Specifically, subcortical projections develop earlier than those supporting prefrontal control. This developmental imbalance results in relatively greater reliance on subcortical versus prefrontal regions during adolescence (i.e., imbalance in reliance of systems), compared to adulthood, when this circuitry is fully mature and also compared to childhood, when this circuitry is still developing. With age and experience, the connectivity between these regions is strengthened and provides a mechanism for top down modulation of the subcortically-driven reward behavior (Hare et al., 2008).

These regional neuroanatomical changes across development have implications for behavior. Development of the prefrontal cortex is associated with age-related improvement in behavioral regulation (Asato et al., 2010; Astle and Scerif, 2009; Casey et al., 2007; Durston et al., 2006; Forbes and Dahl, 2010; Liston et al., 2006; Luna et al., 2010; Luna et al., 2001; Romeo, 2003), while subcortical regions within this circuitry are sensitive to novelty and reward (Bunge et al., 2002; Liston et al., 2006). Thus, sensitivity to motivational contexts during adolescence has been proposed to result from a tension between these early-emerging “bottom-up” subcortical brain regions that express exaggerated reactivity to incentive-related cues and later-maturing “top-down” cognitive control regions involved in self control. Yet, few empirical studies have examined the interaction between these two functional systems across development.

One of the first studies to examine incentive-related processes across the full spectrum of development from childhood to adulthood was completed by Galvan and colleagues (Galvan et al., 2006). In an experiment modeled upon previously described nonhuman primate studies examining error-driven reinforcement learning (Cromwell and Schultz, 2003; Fiorillo et al., 2003), Galvan and colleagues manipulated the magnitude of reward outcome and examined the effects across development in dopamine-rich subcortical and prefrontal regions. They found that the subcortical region of the ventral striatum was sensitive to varying magnitudes of monetary reward (Galvan et al., 2005) and that this response was exaggerated in adolescents, relative to both children and adults (Galvan et al., 2006). A similar increased sensitivity to rewarding stimuli among adolescents is found when using a paradigm with positive social cues such as happy faces (Somerville et al., 2011; see Figure 1b and c). Differential activity in the ventral striatum to monetary rewards in adolescents relative to children and adults has been observed across a number of labs and experimental tasks (Bjork et al., 2008; Bjork et al., 2010; Ernst et al., 2005; Galvan et al., 2006; Geier et al., 2010; Van Leijenhorst et al., 2010). In contrast to this adolescent specific pattern in the ventral striatum, prefrontal regions showed protracted and more linear changes in brain activation from early childhood to young adulthood (Durston et al., 2006; Galvan et al., 2006; Somerville et al., 2011).

Recently, Somerville and colleagues (2011) examined the interaction of cognitive and motivational neural systems from childhood to adulthood. Using the task described previously that contained rare social appetitive cues (e.g., happy faces) in a go-nogo task, they showed a reduction in the capacity to suppress an approach response toward a positive, appetitive social cues in adolescents. This decrement in performance during adolescence was paralleled by enhanced activity in the ventral striatum (see Figure 1b and 1c). Conversely, activation in the inferior frontal gyrus was associated with overall accuracy and showed a linear pattern of change with age for the no-go versus go trials (see Figure 2). Using a functional connectivity analysis, they show development of this frontostriatal circuitry changes with age with stronger subcortical connections during adolescence and enhanced prefrontal ones in adulthood. It is this maturation of relevant circuitry that is concluded to explain developmental differences in the behavior when suppressing an unexpected incentive-related cue.

What is concerned with the functions and purposes of the mind and behavior in the individuals adaptation to the environment?

Ventrolateral prefrontal cortex is associated with developmental and individual differences in impulse control

(A) Brain regions showing more pronounced activity during “Nogo” relative to “Go” trials. Activations are thresholded at p < .05, whole-brain corrected, and rendered on a representative high-resolution anatomical scan.

(B) Plot of activity in the right IFG (circled in A) to Nogo relative to Go trials as a function of age. IFG is involved in maintaining task demands to adjust behavior and override response when the predicted target fails to occur. As seen here, increasing age predicts a linear decrease in IFG recruitment.

(C) Plot of activity in panel A as a function of performance. Greater recruitment for successful suppression (correct Nogo) trials relative to Go trials tended to predict worse performance (greater false alarm rate).

Copyright: MIT Press Journals. Reprinted with permission (Somerville et al, 2011).

These findings are in part consistent with the earlier reported findings by Cohen and colleagues (Cohen et al., 2010) of adolescents responding more quickly to stimuli previously associated with a higher reward value. In that study, adolescents also showed greater ventral striatal activity to higher, unpredicted rewards compared to adults and children. Subsequent learning studies (van den Bos et al., 2012) suggest that these age differences may not be related to differences in learning signals per se but rather in how these signals can guide behavior and expectations in the immature brain (van den Bos et al., 2012; van den Bos et al., 2009). According to this interpretation, the functional connectivity between reward related regions (ventral striatum) and the prefrontal cortex is what is changing as a function of age, not learning.

It is important to consider these results in the context of the environmental changes that influence the frequency and manner in which these systems are engaged. Adolescence is a period when the individual spends less time with parents and more time with peers. With this increased freedom comes new social and environmental demands. Specifically, during adolescence we must learn to regulate our own behavior rather than relying on parents/guardians to constrain our behavior as when we were children. When placed in contexts in which one must regulate our own behavior, control failures may be a product of a prefrontal regulatory system that is relatively inexperienced and thus not functionally mature. Over time, experience shapes the capacity to regulate these approach behaviors, which with time results in a state of greater balance between dynamic approach and regulatory signaling circuitries and strengthening of the ability to resist temptation.

Speculation for why the brain would be programmed in such a way as to make adolescents more impulsive in motivational contexts leads us back to previously described experience-expectant demands on the organism. Several species, from rodents to primates to birds (Spear, 2000), experience a developmental period of adolescence, which is characterized by increased novelty seeking, seeking out same-age peers and fighting with parents, all of which help the adolescent transition from the home territory and dependence on the parent to relative independence. The fact that traits such as novelty seeking and experimentation were not removed by natural selection suggests that they may serve an important role during the transition from childhood to adult life. This is a time when individuals need to be adaptable and gradually switch from a sheltered life with parental guidance and resources to an independent one. Thus seeking alternative food sources so as not to deplete those at home and seeking future mates requires some degree of pull or tension away from the safety of the home. A system that is more sensitive, more easily pulled by environmental cues signaling incentives may help facilitate this demand in an adaptive way.

The notion of adolescence as an adaptive period of development has received considerable public attention (Dobbs, 2011) in moving the field away from psychopathologizing adolescence to considering ways in which heightened sensitivity to environmental cues may be useful. For example, although we have highlighted how incentives can diminish behavior, they can also enhance behavior. Rewarding individuals for appropriate behavior can make them work harder and perform better than when not rewarded. Our review of adolescent development suggests a change in sensitivity to reward-based cues, suggesting that incentives may have a unique influence on behavior during the adolescent years. Recent work by Ernst and colleagues (Hardin et al., 2009; Jazbec et al., 2006) showed improved performance on an impulse control task (antisaccade task) when promised a financial reward for accurate performance on some trials but not others. The reward facilitated adolescent performance on the task more than it did for adults. Recent parallel imaging studies (Geier et al., 2010) (Teslovich and Casey, in preparation) suggest that enhanced behavioral effects with incentives are associated with increased reward-related modulation of control regions by the ventral striatum. Together, these findings suggest that immediate incentives may be used to positively alter behavior.

Important when considering how adolescence may be adaptive is to highlight misconceptions about this developmental period (Casey and Caudle, in press; Reyna and Farley, 2006; Steinberg, 2008). As Steinberg notes, empirical evidence does not support the following common beliefs: “(a) that adolescents are irrational or deficient in their information processing, or that they reason about risk in fundamentally different ways than adults; (b) that adolescents do not perceive risks where adults do, or are more likely to believe that they are invulnerable; and (c) that adolescents are less risk-averse than adults” (Steinberg, 2008; page 80). In fact, there is evidence to the contrary. Tymula and colleagues (Tymula et al., 2012) show that adolescents are, if anything, more averse to clear risks than adults. Specifically, they showed that adults were more willing than adolescents to gamble when the risk was known to be high. Adolescents, in contrast, were more willing to gamble when the risks were unclear. What appears to distinguish adolescent and adult risky decisions is adolescents’ tolerance for ambiguous risks. While adolescence tolerate unknown outcomes in making risky decisions, adults tolerate this uncertainty less. This tolerance for the unknown may be biologically adaptive in taking advantage of novel experiences and new learning opportunities (Tymula et al., 2012).

Adolescence is clearly a period during which the individual must rapidly adapt to changing environmental demands given the social, sexual, and intellectual challenges of this developmental period that prepare the individual for independence. Yet, even as adults we vary in the ability to control our impulses. Perhaps one of the best examples of individual differences reported in these abilities in the social, cognitive and developmental psychology literatures is the ability to delay of gratification (Mischel et al., 1989). Delay of gratification is typically assessed in 4-year-olds. The child is asked whether she/he would prefer a small reward (one marshmallow) now or a larger reward (two marshmallows) later. Children typically behave in one of two ways. They either ring the bell almost immediately in order to have the one marshmallow now (low delayer), which means they only get one, or they wait several minutes in order to receive the larger reward of two marshmallows (high delayer). This observation suggests that some individuals are better than others in their ability to control impulses in the face of highly salient incentives and that this ability can be detected in early childhood (Mischel et al., 1989).

The ability to wait for reward has been demonstrated to be adaptive and may buffer individuals against the development of a variety of dispositional physical and mental health vulnerabilities, including higher body mass index and illicit substance use (Kubzansky et al., 2009; Mischel and Ayduk, 2004; Mischel et al., 1988; Rodriguez et al., 1989). The relative lifetime stability in the capacity to resist temptation or control impulses has recently been shown in a 40-year longitudinal study. The participants were individuals who were tested at age 4 in the original delay-of-gratification task and whose self-control abilities remained consistent in follow-up assessments, falling roughly in the top and bottom quartiles in delay ability. Two experiments were conducted to investigate the ability of these individuals, now in their 40s, to refrain from responding to appetitive cues. Both tasks examined impulse control - one in the presence of neutral (“cool”) cues and one containing compelling (“hot”) cues. Because marshmallows are unlikely to be as rewarding to individuals in their 40s as in their childhood, appetitive social cues (of happy faces relative to neutral and fearful faces) were used as non-targets in a go-nogo task.

The results from these two tasks showed that individuals who were less able to delay gratification as children, as adults in their 40s, showed less impulse control in suppression of a response to “hot” but not to “cool” cues. Specifically, individuals who, as a group, had more difficulty delaying gratification at 4 years of age continued to show reduced self-control abilities 40 years later. These individuals exhibited more difficulty as adults in suppressing responses to positive social cues during a go-nogo impulse control task (Casey et al., 2011) (Figure 3). These findings suggest fairly robust stable differences in self-control ability even 40 years later.

What is concerned with the functions and purposes of the mind and behavior in the individuals adaptation to the environment?

High and low delayers do not differ in performance on a go/nogo task when cues are “cool” stimuli (neutral facial expressions), but low delayers make more errors when the cues are “hot” (emotional faces). Experiment was conducted outside the MR scanner. Error bars denote SEM.

Copyright: PNAS. Reprinted with permission (Casey et al, 2011).

In the previous study, individuals who could not stop themselves at the age of 4 had similar difficulties 40 years later. These findings raise the question of what the neural basis of this ability may be. Approximately half of the 59 high- and low- delaying individuals were imaged during performance of the “hot” go-nogo task to address this question (Casey et al., 2011). The findings showed that that performance on this task was supported by dopamine-rich ventral frontostriatal circuitry. Specifically, ventral prefrontal activity was involved in accurately withholding a response. Low delayers had diminished recruitment of this region for correct “nogo” relative to “go” trials as compared to high delayers (Figure 4). However, it was the ventral striatum, which demonstrated a significant difference in recruitment between high and low delay groups, that paralleled the behavioral findings of poorer performance when suppressing a response to an appetitive social cue (Figure 5). Thus, the data suggest that stronger recruitment of cognitive control areas (ventral prefrontal cortex) and stronger inhibition of reward-related activity (ventral striatum) may underlie the relative ease with which high delayers can suppress responses to appetitive stimuli, compared to low delayers. Moreover, this finding “highlights the importance of the qualities of the stimulus people have to resist, such as its salience or allure, in modulating cognitive control ability” (Casey et al., 2011). These findings suggest that sensitivity to rewarding cues can influence an individual’s ability to appropriately adapt to changing inputs in order to appropriately suppress inappropriate actions. This adaptive control region of the prefrontal cortex may be “hijacked” by reward learning systems, rendering control systems unable to flexibly modulate behavior. Learning systems such as the striatum provide information about structure in the environment and detecting violations in these predictions, which are fed to the prefrontal cortex for integration with goals represented in working memory. The result is facilitation of top down control of behavior as well as altering of behavior in response to relevant changes in context(Amso et al., 2005; Casey, 2002; Munakata et al., 2011).

What is concerned with the functions and purposes of the mind and behavior in the individuals adaptation to the environment?

Differential prefrontal recruitment for Nogo versus Go trials is more pronounced in high than low delayers. The right inferior frontal cortex was associated with correct inhibition of a response (Nogo) relative to making a correct response (Go).

Left: Activation map of right inferior frontal gyrus (IFG), thresholded at P < 0.05, whole-brain corrected, displayed on a representative high-resolution T1-weighted axial image.

Right: Percentage change in MR signal for Go and Nogo trials in the IFG. High delayers show greater polarization of inferior frontal gyrus response to Nogo relative to Go trials (p = 0.001). Error bars denote SEM.

Copyright: PNAS. Reprinted with permission (Casey et al, 2011).

What is concerned with the functions and purposes of the mind and behavior in the individuals adaptation to the environment?

Low delay ability in early childhood predicts greater recruitment of ventral striatum when inhibiting responses to positive social cues 40 years later

Left: Activation map for the three-way interaction of task, emotion, and delay group depicting ventral striatum activity thresholded at P < 0.05, small volume corrected, displayed on a representative high-resolution T1- weighted axial image.

Right: Ventral striatal response to happy Nogo trials in high and low delayers.

Copyright: PNAS. Reprinted with permission (Casey et al, 2011).

These brain regions are able to alter behavior via afferent and efferent connections within prefrontal cortex, which are fine-tuned with experience over the course of development in childhood. This experiential dependent fine-tuning proceeds more slowly in the less mature system as evidenced by a similar imbalance during adolescence as described earlier (Chein et al., 2011; Galvan et al., 2006; Somerville et al., 2011). Both examples show how cognitive control may be particularly vulnerable in the context of rare reward-related cues and alter behavioral flexibility of the individual.

A common question from the media and lay public when presented with the results of the delay of gratification studies is whether the findings suggest that an individual who cannot wait as a child to gain two treats is sentenced to a life of poor self control and poor outcomes or whether this developmental trajectory can be altered (i.e., is it plastic)? Moreover, is it the case that low delayers can’t adjust their behavior to suppress responses to appetitive cues or is it that they have less flexibility (plasticity) in this ability but ultimately with time can suppress these responses? The latter question may be addressed by examining performance of both delay groups over time to see if the low delayers ever perform similarly to the high delayers. If we examine performance during early, middle and late trials for these participants in the 40 year follow-up study, we see that although low delayers initially perform more poorly on the impulse control task, by the middle of the experiment they appear to be performing similarly to the high delayers (see Figure 6). This flexibility in adjusting behavior to rare or emotional cues is supported by prefrontal circuitry that enables plasticity in behavior. While the sample precludes power to test a group by time interaction, it does appears that low delayers are capable of adjusting their behavior in the face of changing demands, but less flexible requiring additional practice or experience to do so.

What is concerned with the functions and purposes of the mind and behavior in the individuals adaptation to the environment?

High delayers adapt earlier to the demands of the Go/Nogo task than low delayers. High delayers maintain a good performance throughout the task (i.e. low false alarm rate on Nogo trials), while low delayers have a significantly lower performance in early trials (p = 0.02) and progressively improve in later trials. False alarm rates do not differ significantly for middle (p= 0.21) and late (p=0.35) trials.

In terms of the first question, it should be noted that although there is remarkable stability in self-control abilities for many individuals, just under half of the original cohort of children who performed the delay of gratification task 40 years ago show different levels of self-control now as middle-aged adults. Specifically, some children who were below average in self-control in preschool developed into adults with high self-control abilities, and some children who were above average in self-control in preschool have low self-control abilities as adults. Thus plasticity is evidenced by the change in these individual developmental trajectories underscoring the importance of both biological constraints and experiential history (e.g. gene × environment interactions) in shaping our behavior and our flexibility in adjusting behavior in the face of changing environmental demands.

Plasticity is the capacity to adapt to changing environmental demands. This paper provides evidence that this ability varies by age, individual and context. Evolution has shaped the brain to appropriately deal with expected demands of the world to provide the cognitive flexibility to learn from experiences, to monitor the world based on learned predictions, and adjust actions when these predictions are violated. These demands change with developmental transitions from infancy to late adulthood, and require new adjustments in behavior at each developmental phase. By definition, adolescence requires new demands as the individual moves from dependence on parents to relative independence. This transition appears to be facilitated by a biologically driven imbalance between increased novelty- and sensation-seeking in conjunction with immature “self-regulatory competence” (Dahl, 2004; Steinberg, 2004, 2008). This imbalance is not only seen during adolescence but can vary by individuals across development as seen in a sensitivity to rewarding cues that impair an individual’s ability to appropriately suppress inappropriate actions toward them. The neural systems underlying this imbalance include dopamine rich prefrontal and subcortical regions. The prefrontal cortex is involved in flexibly adjusting behavior in response to changing environmental demands such as distracting novel or rewarding events. This region appears to be “hijacked” by reward regions, rendering control systems unable to flexibly modulate behavior. With development and experience this circuitry is fine-tuned providing top-down modulation of subcortical regions by prefrontal ones. The studies presented provide support for not only biological constraints but also experiential history in shaping our behavior and our flexibility in adjusting behavior in the face of changing environmental demands.

Highlights

  • Plasticity is the capacity to adapt to changing environmental demands.

  • Environmental demands change with development, especially during adolescence.

  • The prefrontal cortex is involved in flexibly adjusting behavior to changing demands.

  • Reward regions can render the prefrontal cortex unable to flexibly modulate behavior.

  • Biological constraints and experiential history shape our behavioral flexibility.

This work was supported in part by National Institutes of Health Grants R01 DA018879, R01 HD069178, and by National Science Foundation Grant 06-509 (BJC).

Publisher's Disclaimer: This is a PDF file of an unedited manuscript that has been accepted for publication. As a service to our customers we are providing this early version of the manuscript. The manuscript will undergo copyediting, typesetting, and review of the resulting proof before it is published in its final citable form. Please note that during the production process errors may be discovered which could affect the content, and all legal disclaimers that apply to the journal pertain.

  • Amso D, Davidson MC, Johnson SP, Glover G, Casey BJ. Contributions of the hippocampus and the striatum to simple association and frequency-based learning. Neuroimage. 2005;27:291–298. [PMC free article] [PubMed] [Google Scholar]
  • Arias-Carrion O, Poppel E. Dopamine, learning, and reward-seeking behavior. Acta neurobiologiae experimentalis. 2007;67:481–488. [PubMed] [Google Scholar]
  • Asato MR, Terwilliger R, Woo J, Luna B. White matter development in adolescence: a DTI study. Cereb Cortex. 2010;20:2122–2131. [PMC free article] [PubMed] [Google Scholar]
  • Astle DE, Scerif G. Using developmental cognitive neuroscience to study behavioral and attentional control. Developmental Psychobiology. 2009;51:107–118. [PubMed] [Google Scholar]
  • Belsky J, Steinberg L, Draper P. Childhood experience, interpersonal development, and reproductive strategy: and evolutionary theory of socialization. Child development. 1991;62:647–670. [PubMed] [Google Scholar]
  • Benes FM, Taylor JB, Cunningham MC. Convergence and plasticity of monoaminergic systems in the medial prefrontal cortex during the postnatal period: implications for the development of psychopathology. Cereb Cortex. 2000;10:1014–1027. [PubMed] [Google Scholar]
  • Bixler RH. Why littermates don’t: the avoidance of inbreeding depression. Annual Review of Sex Research. 1992;3:291–328. [Google Scholar]
  • Bjork JM, Knutson B, Hommer DW. Incentive-elicited striatal activation in adolescent children of alcoholics. Addiction. 2008;103:1308–1319. [PubMed] [Google Scholar]
  • Bjork JM, Smith AR, Chen G, Hommer DW. Adolescents, adults and rewards: comparing motivational neurocircuitry recruitment using fMRI. PLoS ONE. 2010;5:e11440. [PMC free article] [PubMed] [Google Scholar]
  • Bornstein MH. Stability in mental development from early life: methods, measures, model meanings and myths. In: Simon F, Butterworth GE, editors. The development of sensory, motor and cognitive capacities in early infancy: from sensation to cognition. Psychological Press; Hover, England: 1998. pp. 299–331. [Google Scholar]
  • Bourgeois JP, Goldman-Rakic PS, Rakic P. Synaptogenesis in the prefrontal cortex of rhesus monkeys. Cereb Cortex. 1994;4:78–96. [PubMed] [Google Scholar]
  • Brenhouse HC, Sonntag KC, Andersen SL. Transient D1 dopamine receptor expression on prefrontal cortex projection neurons: relationship to enhanced motivational salience of drug cues in adolescence. The Journal of neuroscience: the official journal of the Society for Neuroscience. 2008;28:2375–2382. [PMC free article] [PubMed] [Google Scholar]
  • Brown TT, Lugar HM, Coalson RS, Miezin FM, Petersen SE, Schlaggar BL. Developmental changes in human cerebral functional organization for word generation. Cereb Cortex. 2005;15:275–290. [PubMed] [Google Scholar]
  • Buckley MJ, Mansouri FA, Hoda H, Mahboubi M, Browning PG, Kwok SC, Phillips A, Tanaka K. Dissociable components of rule-guided behavior depend on distinct medial and prefrontal regions. Science. 2009;325:52–58. [PubMed] [Google Scholar]
  • Bunge SA, Dudukovic NM, Thomason ME, Vaidya CJ, Gabrieli JD. Immature frontal lobe contributions to cognitive control in children: evidence from fMRI. Neuron. 2002;33:301–311. [PMC free article] [PubMed] [Google Scholar]
  • Cardinal RN, Pennicott DR, Sugathapala CL, Robbins TW, Everitt BJ. Impulsive choice induced in rats by lesions of the nucleus accumbens core. Science. 2001;292:2499–2501. [PubMed] [Google Scholar]
  • Case R. Validation of a neo-Piagetian capacity construct. Journal of experimental child psychology. 1972;14:287–302. [Google Scholar]
  • Casey BJ. Neuroscience. Windows into the human brain. Science. 2002;296:1408–1409. [PubMed] [Google Scholar]
  • Casey BJ. Frotostriatal and frontocerebellar circuitry underlying cognitive control. In: Mayr U, Owh E, Keele SW, editors. Developing individuality in the human brain. APA; Washington DC: 2005. [Google Scholar]
  • Casey BJ, Amso D, Davidson MC. Learning about learning and development with modern imaging technology. In: Munakata Y, Johnson M, editors. Processes of change in brain and cognitive development. Oxford University Press; 2006. pp. 513–533. [Google Scholar]
  • Casey BJ, Caudle K. Current Directions in Psychological Science. Self Control. in press. [PMC free article] [PubMed] [Google Scholar]
  • Casey BJ, Durston S, Fossella JA. Evidence for a mechanistic model of cognitive control. Clin Neurosci Res. 2001;1:267–282. [Google Scholar]
  • Casey BJ, Epstein JN, Buhle J, Liston C, Davidson MC, Tonev ST, Spicer J, Niogi S, Millner AJ, Reiss A, Garrett A, Hinshaw SP, Greenhill LL, Shafritz KM, Vitolo A, Kotler LA, Jarrett MA, Glover G. Frontostriatal connectivity and its role in cognitive control in parent-child dyads with ADHD. Am J Psychiatry. 2007;164:1729–1736. [PubMed] [Google Scholar]
  • Casey BJ, Jones RM. JAACAP. Neurobiology of the adolescent brain and behavior. In press. [PMC free article] [PubMed] [Google Scholar]
  • Casey BJ, Jones RM, Hare TA. The adolescent brain. Ann N Y Acad Sci. 2008;1124:111–126. [PMC free article] [PubMed] [Google Scholar]
  • Casey BJ, Somerville LH, Gotlib IH, Ayduk O, Franklin NT, Askren MK, Jonides J, Berman MG, Wilson NL, Teslovich T, Glover G, Zayas V, Mischel W, Shoda Y. Behavioral and neural correlates of delay of gratification 40 years later. Proceedings of the National Academy of Sciences of the United States of America. 2011;108:14998–15003. [PMC free article] [PubMed] [Google Scholar]
  • Casey BJ, Tottenham N, Liston C, Durston S. Imaging the developing brain: what have we learned about cognitive development? Trends Cogn Sci. 2005;9:104–110. [PubMed] [Google Scholar]
  • Casey BJ, Trainor R, Giedd J, Vauss Y, Vaituzis CK, Hamburger S, Kozuch P, Rapoport JL. The role of the anterior cingulate in automatic and controlled processes: A developmental neuroantomical study. Developmental Psychobiology. 1997;30:61–69. [PubMed] [Google Scholar]
  • Cauffman E, Shulman EP, Steinberg L, Claus E, Banich MT, Graham S, Woolard J. Age differences in affective decision making as indexed by performance on the Iowa Gambling Task. Dev Psychol. 2010;46:193–207. [PubMed] [Google Scholar]
  • Chein J, Albert D, O’Brien L, Uckert K, Steinberg L. Peers increase adolescent risk taking by enhancing activity in the brain’s reward circuitry. Dev Sci. 2011;14:F1–10. [PMC free article] [PubMed] [Google Scholar]
  • Cohen JR, Asarnow RF, Sabb FW, Bilder RM, Bookheimer SY, Knowlton BJ, Poldrack RA. A unique adolescent response to reward prediction errors. Nature Neuroscience. 2010;13:669–671. [PMC free article] [PubMed] [Google Scholar]
  • Crockett CM, Pope TR. Consequences of sex differences in dispersal for juvenile red howler monkeys. In: Pereira ME, Fairbanks LA, editors. Juvenile primates: life history, development and behavior. Oxford University Press; Oxford: 1993. pp. 104–118. [Google Scholar]
  • Cromwell HC, Schultz W. Effects of expectations for different reward magnitudes on neuronal activity in primate striatum. J Neurophysiol. 2003;89:2823–2838. [PubMed] [Google Scholar]
  • Csikszentmihalyi M, Larson R. Validity and reliability of the Experience-Sampling Method. The Journal of nervous and mental disease. 1987;175:526–536. [PubMed] [Google Scholar]
  • Cunningham MG, Bhattacharyya S, Benes FM. Increasing Interaction of amygdalar afferents with GABAergic interneurons between birth and adulthood. Cereb Cortex. 2008;18:1529–1535. [PubMed] [Google Scholar]
  • Dahl RE. Adolescent brain development: A period of vulnerabilities and opportunities. Annals of the New York Academy of Sciences. 2004;1021:1–22. [PubMed] [Google Scholar]
  • Daly M, Wilson M. Evolutionary psychology and family violence. In: Crawford C, Smith M, Krebs D, editors. Sociobiology and psychology. Erlbaum; Hillsdale, NJ: 1987. pp. 293–309. [Google Scholar]
  • Davidson MC, Amso D, Anderson LC, Diamond A. Development of cognitive control and executive functions from 4 to 13 years: evidence from manipulations of memory, inhibition, and task switching. Neuropsychologia. 2006;44:2037–2078. [PMC free article] [PubMed] [Google Scholar]
  • De Haan M, Johnson MH. The Cognitive Neuroscience of Development. Psychology Press; New York, NY: 2003. Mechanisms and theories of brain development; pp. 1–18. [Google Scholar]
  • Delgado MR, Nearing KI, Ledoux JE, Phelps EA. Neural circuitry underlying the regulation of conditioned fear and its relation to extinction. Neuron. 2008;59:829–838. [PMC free article] [PubMed] [Google Scholar]
  • Diamond A. Development of the ability to use recall to guide action, as indicated by infants’ performance on AB. Child Development. 1985;56:868–883. [PubMed] [Google Scholar]
  • Dobbs D. Teenage Brains. National Geographic; 2011. [Google Scholar]
  • Durston S, Davidson MC, Tottenham N, Galvan A, Spicer J, Fossella JA, Casey BJ. A shift from diffuse to focal cortical activity with development. Dev Sci. 2006;9:1–8. [PubMed] [Google Scholar]
  • Ernst M, Nelson EE, Jazbec S, McClure EB, Monk CS, Leibenluft E, Blair J, Pine DS. Amygdala and nucleus accumbens in responses to receipt and omission of gains in adults and adolescents. Neuroimage. 2005;25:1279–1291. [PubMed] [Google Scholar]
  • Fantz RL. Visual Experience in Infants: Decreased Attention to Familiar Patterns Relative to Novel Ones. Science. 1964;146:668–670. [PubMed] [Google Scholar]
  • Feldman DE, Brecht M. Map plasticity in somatosensory cortex. Science. 2005;310:810–815. [PubMed] [Google Scholar]
  • Figner B, Mackinlay RJ, Wilkening F, Weber EU. Affective and deliberative processes in risky choice: age differences in risk taking in the Columbia Card Task. J Exp Psychol Learn Mem Cogn. 2009;35:709–730. [PubMed] [Google Scholar]
  • Fiorillo CD, Tobler PN, Schultz W. Discrete coding of reward probability and uncertainty by dopamine neurons. Science. 2003;299:1898–1902. [PubMed] [Google Scholar]
  • Flavell JH, Feach DR, Chinsky JM. Spontaneous verbal rehearsal in a memory task as a function of age. Child Development. 1966;37:283–299. [PubMed] [Google Scholar]
  • Forbes EE, Dahl RE. Pubertal development and behavior: hormonal activation of social and motivational tendencies. Brain Cogn. 2010;72:66–72. [PMC free article] [PubMed] [Google Scholar]
  • Galvan A. Neural plasticity of development and learning. Human brain mapping. 2010;31:879–890. [PMC free article] [PubMed] [Google Scholar]
  • Galvan A, Hare TA, Davidson M, Spicer J, Glover G, Casey BJ. The role of ventral frontostriatal circuitry in reward-based learning in humans. The Journal of neuroscience: the official journal of the Society for Neuroscience. 2005;25:8650–8656. [PMC free article] [PubMed] [Google Scholar]
  • Galvan A, Hare TA, Parra CE, Penn J, Voss H, Glover G, Casey BJ. Earlier development of the accumbens relative to orbitofrontal cortex might underlie risk-taking behavior in adolescents. The Journal of neuroscience: the official journal of the Society for Neuroscience. 2006;26:6885–6892. [PMC free article] [PubMed] [Google Scholar]
  • Geier CF, Terwilliger R, Teslovich T, Velanova K, Luna B. Immaturities in reward processing and its influence on inhibitory control in adolescence. Cereb Cortex. 2010;20:1613–1629. [PMC free article] [PubMed] [Google Scholar]
  • Giedd JN, Blumenthal J, Jeffries NO, Castellanos FX, Liu H, Zijdenbos A, Paus T, Evans AL, Rapoport J. Brain development during childhood and adolescence: a longitudinal MRI study. Nature Neuroscience. 1999;2:861–863. [PubMed] [Google Scholar]
  • Gill TM, Castaneda PJ, Janak PH. Dissociable roles of the medial prefrontal cortex and nucleus accumbens core in goal-directed actions for differential reward magnitude. Cereb Cortex. 2010;20:2884–2899. [PubMed] [Google Scholar]
  • Greenough WT, Black JE, Wallace CS. Experience and brain development. Child development. 1987;58:539–559. [PubMed] [Google Scholar]
  • Haber SN. The primate basal ganglia: parallel and integrative networks. Journal of chemical neuroanatomy. 2003;26:317–330. [PubMed] [Google Scholar]
  • Hardin MG, Mandell D, Mueller SC, Dahl RE, Pine DS, Ernst M. Inhibitory control in anxious and healthy adolescents is modulated by incentive and incidental affective stimuli. Child Psychology and Psychiatry. 2009;50:1550–1558. [PMC free article] [PubMed] [Google Scholar]
  • Hare TA, Tottenham N, Galvan A, Voss HU, Glover GH, Casey BJ. Biological substrates of emotional reactivity and regulation in adolescence during an emotional go-nogo task. Biological Psychiatry. 2008;63:927–934. [PMC free article] [PubMed] [Google Scholar]
  • Hollerman JR, Schultz W. Dopamine neurons report an error in the temporal prediction of reward during learning. Nat Neurosci. 1998;1:304–309. [PubMed] [Google Scholar]
  • Huttenlocher PR. Synaptic density in human frontal cortex - developmental changes and effects of aging. Brain research. 1979;163:195–205. [PubMed] [Google Scholar]
  • Huttenlocher PR. Morphometric study of human cerebral cortex development. Neuropsychologia. 1990;28:517–527. [PubMed] [Google Scholar]
  • Huttenlocher PR. Regional differences in synaptogenesis in human cerebral cortex. Journal of Comparative Neurology. 1997;387:167–178. [PubMed] [Google Scholar]
  • Irwin CE, Millstein SG. Biopsychological correlates of risk-taking behaviors during adolescence. Journal of Adolescent Health Care. 1986;7:82S–96S. [PubMed] [Google Scholar]
  • Jacobson M. Developmental Neurobiology. Plenum Press; 1991. [Google Scholar]
  • Jazbec S, Hardin MG, Schroth E, McClure E, Pine DS, Ernst M. Age-related influence of contingencies on a saccade task. Exp Brain Res. 2006;174:754–762. [PMC free article] [PubMed] [Google Scholar]
  • Johnson MH, De Haan M. Developmental Cognitive Neuroscience. Wiley-Blackwell; 2011. [Google Scholar]
  • Kahneman D, Tversky A. Prospect theory: an analysis of decision under risk. Econometrica. 1979;47:263–291. [Google Scholar]
  • Karmiloff-Smith A. Beyond modularity: a developmental perspective on cognitive science. MIT Press and Bradford Books; Cambridge, MA: 1992. [Google Scholar]
  • Keating DP, Bobbitt BL. Individual and developmental differences in cognitive processing components of mental ability. Child Development. 1978;49:155–167. [Google Scholar]
  • Knight RT. Decreased response to novel stimuli after prefrontal lesions in man. Electroencephalography and clinical neurophysiology. 1984;59:9–20. [PubMed] [Google Scholar]
  • Knutson B, Fong GW, Adams CM, Varner JL, Hommer D. Dissociation of reward anticipation and outcome with event-related fMRI. Neuroreport. 2001;12:3683–3687. [PubMed] [Google Scholar]
  • Kubzansky LD, Martin LT, Buka SL. Early manifestations of personality and adult health: a life course perspective. Health Psychol. 2009;28:364–372. [PubMed] [Google Scholar]
  • Liston C, Watts R, Tottenham N, Davidson MC, Niogi S, Ulug AM, Casey BJ. Frontostriatal microstructure modulates efficient recruitment of cognitive control. Cerebral Cortex. 2006;16:553–560. [PubMed] [Google Scholar]
  • Luna B, Padmanabhan A, O’Hearn K. What has fMRI told us about the development of cognitive control through adolescence? Brain Cogn. 2010;72:101–113. [PMC free article] [PubMed] [Google Scholar]
  • Luna B, Thulborn KR, Munoz DP, Merriam EP, Garver KE, Minshew NJ, Keshavan MS, Genovese CR, Eddy WF, Sweeney JA. Maturation of widely distributed brain function subserves cognitive development. Neuroimage. 2001;13:786–793. [PubMed] [Google Scholar]
  • Luria DM. The Role of Speech in the Regulation of Normal and Abnormal Behavior. Liveright; New York: 1961. [Google Scholar]
  • Meschke LL, Silbereisen RK. The influence of puberty, family processes, and leisure activities on the timing of first sexual experience. Journal of adolescence. 1997;20:403–418. [PubMed] [Google Scholar]
  • Mirenowicz J, Schultz W. Importance of unpredictability for reward responses in primate dopamine neurons. J Neurophysiol. 1994;72:1024–1027. [PubMed] [Google Scholar]
  • Mischel W, Ayduk O. Willpower in a cognitive-affective processing system: The dynamics of delay of gratificaton. In: Baumeister R, Vohs K, editors. Handbook of Self-Regulation: Research, Theory, and Applications. Guildford; New York: 2004. pp. 99–129. [Google Scholar]
  • Mischel W, Shoda Y, Peake PK. The nature of adolescent competencies predicted by preschool delay of gratification. Journal of Personality and Social Psychology. 1988;54:687–696. [PubMed] [Google Scholar]
  • Mischel W, Shoda Y, Rodriguez MI. Delay of gratification in children. Science. 1989;244:933–938. [PubMed] [Google Scholar]
  • Montague PR, Dayan P, Sejnowski TJ. A framework for mesencephalic dopamine systems based on predictive Hebbian learning. The Journal of Neuroscience. 1996;16:1936–1947. [PMC free article] [PubMed] [Google Scholar]
  • Moore JM. International Journal of Primatology. 1992. Dispersal, nepotism, and primate social behavior; pp. 361–378. [Google Scholar]
  • Munakata Y, Herd SA, Chatham CH, Depue BE, Banich MT, O’Reilly RC. A unified framework for inhibitory control. Trends in cognitive sciences. 2011;15:453–459. [PMC free article] [PubMed] [Google Scholar]
  • Munakata Y, Yerys BE. All together now: when dissociaations between knowledge and action disappear. Pscycho Sci. 2001;12:335–337. [PubMed] [Google Scholar]
  • Nestler EJ. Historical review: Molecular and cellular mechanisms of opiate and cocaine addiction. Trends Pharmacol Sci. 2004;25:210–218. [PubMed] [Google Scholar]
  • O’Doherty JP, Deichmann R, Critchley HD, Dolan RJ. Neural responses during anticipation of a primary taste reward. Neuron. 2002;33:815–826. [PubMed] [Google Scholar]
  • Pagnoni G, Zink CF, Montague PR, Berns GS. Activity in human ventral striatum locked to errors of reward prediction. Nat Neurosci. 2002;5:97–98. [PubMed] [Google Scholar]
  • Pascual-Leone JA. A mathematical model for transition in Piaget’s developmental stages. Acta Psychologica. 1970;32:301–345. [Google Scholar]
  • Passler MA, Isaac W, Hynd GW. Impulsivity: A multidimensional concept with developmental aspects. Journal of Abnormal Child Psychology. 1985;8:269–277. [PubMed] [Google Scholar]
  • Pasupathy A, Miller EK. Different time courses of learning-related activity in the prefrontal cortex and striatum. Nature. 2005;433:873–876. [PubMed] [Google Scholar]
  • Pereira ME, Altmann J. Development of social behavior in free-living nonhuman primates. In: Watts ES, editor. Nonhuman primate models for human growth and development. A. R. Liss; New York: 1985. pp. 217–309. [Google Scholar]
  • Piaget J. The Construction of reality in the child. Basic Books; New York: 1954. [Google Scholar]
  • Rabinowicz T. The differentiated maturation of the cerebral cortex. Plenum Press; 1986. [Google Scholar]
  • Rakic P, Bourgeois JP, Eckenhoff MF, Zecevic N, Goldman-Rakic PS. Concurrent overproduction of synapses in diverse regions of the primate cerebral cortex. Science. 1986;232:232–235. [PubMed] [Google Scholar]
  • Rescorla RA, Wagner AR. A theory of Pavlovian conditioning: Variations in the effectiveness of reinforcement and nonreinforcement. In: Black AH, Prokasy WF, editors. Classical conditioning II: current research and theory. Appleton Century Crofts; New York: 1972. pp. 64–99. [Google Scholar]
  • Reyna VF, Farley F. Risk and rationality in adolescent decision making: implications for theory, practice, and public policy. Psychological Science in the Public Interest. 2006;7:1–44. [PubMed] [Google Scholar]
  • Robinson TE, Berridge KC. Addiction. Annu Rev Psychol. 2003;54:25–53. [PubMed] [Google Scholar]
  • Rodriguez ML, Mischel W, Shoda Y. Cognitive person variables in the delay of gratification of older children at risk. J Pers Soc Psychol. 1989;57:358–367. [PubMed] [Google Scholar]
  • Romeo RD. Puberty: a period of both organizational and activational effects of steroid hormones on neurobehavioural development. Journal of neuroendocrinology. 2003;15:1185–1192. [PubMed] [Google Scholar]
  • Schlegel A, Barry H. Adolescence: an anthropological inquiry. Free Press; New York: 1991. [Google Scholar]
  • Schultz W, Dayan P, Montague PR. A neural substrate of prediction and reward. Science. 1997;275:1593–1599. [PubMed] [Google Scholar]
  • Soliman F, Glatt CE, Bath KG, Levita L, Jones RM, Pattwell SS, Jing D, Tottenham N, Amso D, Somerville LH, Voss HU, Glover G, Ballon DJ, Liston C, Teslovich T, Van Kempen T, Lee FS, Casey BJ. A genetic variant BDNF polymorphism alters extinction learning in both mouse and human. Science. 2010;327:863–866. [PMC free article] [PubMed] [Google Scholar]
  • Somerville LH, Casey BJ. Developmental neurobiology of cognitive control and motivational systems. Current opinion in neurobiology. 2010;20:236–241. [PMC free article] [PubMed] [Google Scholar]
  • Somerville LH, Hare T, Casey BJ. Frontostriatal maturation predicts cognitive control failure to appetitive cues in adolescents. Journal of cognitive neuroscience. 2011;23:2123–2134. [PMC free article] [PubMed] [Google Scholar]
  • Somerville LH, Jones RM, Casey BJ. A time of change: Behavioral and neural correlates of adolescent sensitivity to appetitive and aversive environmental cues. Brain and Cognition. 2010:72. [PMC free article] [PubMed] [Google Scholar]
  • Sowell ER, Trauner DA, Gamst A, Jernigan TL. Development of cortical and subcortical brain areas in childhood and adolescence: A structural MRI study. Developmental Medicine & Child Neurology. 2002;44:4–16. [PubMed] [Google Scholar]
  • Spear L. The behavioral neuroscience of adolescence. W. W. Norton; New York: 2010. [Google Scholar]
  • Spear LP. The adolescent brain and age-related behavioral manifestations. Neuroscience and Biobehavioral Reviews. 2000;24:417–463. [PubMed] [Google Scholar]
  • Steinberg L. Risk taking in adolescence: what changes, and why? Ann N Y Acad Sci. 2004;1021:51–58. [PubMed] [Google Scholar]
  • Steinberg L. Cognitive and affective development in adolescence. Trends in cognitive sciences. 2005;9:69–74. [PubMed] [Google Scholar]
  • Steinberg L. A social neuroscience perspective on adolescent risk-taking. Developmental Review. 2008;28:78–106. [PMC free article] [PubMed] [Google Scholar]
  • Steinberg L, Graham S, O’Brien L, Woolard J, Cauffman E, Banich M. Age differences in future orientation and delay discounting. Child Dev. 2009;80:28–44. [PubMed] [Google Scholar]
  • Teslovich T, Casey BJ. Adolescents Wait Rather than React Impulsively when Incentives Are at Stake. in preparation. [Google Scholar]
  • Thompson RA, Nelson CA. Developmental science and the media. Early brain development. The American psychologist. 2001;56:5–15. [PubMed] [Google Scholar]
  • Tipper SP, Bourque TA, Anderson SH, Brehaut JC. Mechanisms of attention: a developmental study. Journal of Expperimental Child Psychology. 1989;48:353–378. [PubMed] [Google Scholar]
  • Tseng KY, O’Donnell P. Dopamine modulation of prefrontal cortical interneurons changes during adolescence. Cereb Cortex. 2007;17:1235–1240. [PMC free article] [PubMed] [Google Scholar]
  • Tymula A, Rosenberg Belmaker LA, Roy AK, Ruderman L, Manson K, Glimcher PW, Levy I. Adolescents’ risk-taking behavior is driven by tolerance to ambiguity. Proceedings of the National Academy of Sciences of the United States of America. 2012;109:17135–17140. [PMC free article] [PubMed] [Google Scholar]
  • van den Bos W, Cohen MX, Kahnt T, Crone EA. Striatum-medial prefrontal cortex connectivity predicts developmental changes in reinforcement learning. Cereb Cortex. 2012;22:1247–1255. [PMC free article] [PubMed] [Google Scholar]
  • van den Bos W, Guroglu B, van den Bulk BG, Rombouts SA, Crone EA. Better than expected or as bad as you thought? The neurocognitive development of probabilistic feedback processing. Frontiers in human neuroscience. 2009;3:52. [PMC free article] [PubMed] [Google Scholar]
  • Van Leijenhorst L, Moor BG, Op de Macks ZA, Rombouts SA, Westenberg PM, Crone EA. Adolescent risky decision-making: neurocognitive development of reward and control regions. Neuroimage. 2010;51:345–355. [PubMed] [Google Scholar]
  • Volkow ND, Swanson JM. Variables that affect the clinical use and abuse of methylphenidate in the treatment of ADHD. Am J Psychiatry. 2003;160:1909–1918. [PubMed] [Google Scholar]
  • Volkow ND, Wang GJ, Fowler JS, Tomasi D, Telang F. Addiction: beyond dopamine reward circuitry. Proceedings of the National Academy of Sciences of the United States of America. 2011;108:15037–15042. [PMC free article] [PubMed] [Google Scholar]
  • Yakovlev PIaLA. The myelogenetic cycles of regional maturation in the brain. Blackwell; 1967. [Google Scholar]
  • Zelazo PD, Burack JA, Benedetto E, Frye D. Theory of mind and rule use in individuals with Down’s syndrome: a test of the uniqueness and specificity claims. J Child Psychol Psychiatry. 1996;37:479–484. [PubMed] [Google Scholar]
  • Zevin JD, Seidenberg MS. Age-of-acquisition effects in reading aloud: tests of cumulative frequency and frequency trajectory. Memory & cognition. 2004;32:31–38. [PubMed] [Google Scholar]