Theoretical accounts suggest heightened uncertainty about the state of the world underpins aberrant belief updates, which in turn increase the risk of developing a persecutory delusion. However, this raises the question as to how an agent’s uncertainty may relate to the precise phenomenology of paranoia, as opposed to other qualitatively different forms of belief. We tested whether the same population (n=693) responded similarly to non-social and social contingency changes in a probabilistic reversal learning task and a modified repeated reversal Dictator game, and...

The translation of the outcome-devaluation paradigm to study habit in humans has yielded interesting insights but proven to be challenging. We present a novel, outcome-revaluation task with a symmetrical design, in the sense that half of the available outcomes are always valuable and the other half not-valuable. In the present studies, during the instrumental learning phase, participants learned to respond (Go) to certain stimuli to collect valuable outcomes (and points) while refraining to respond (NoGo) to stimuli signaling not-valuable outcomes. Half of the stimuli...

Precisely charting the maturation of core neurocognitive functions such as reinforcement learning (RL) and flexible adaptation to changing action-outcome contingencies is key for developmental neuroscience and adjacent fields like developmental psychiatry. However, research in this area is both sparse and conflicted, especially regarding potentially asymmetric development of learning for different motives (obtain wins vs avoid losses) and learning from valenced feedback (positive vs negative). In the current study, we investigated the development of RL from adolescence...

Overactive performance monitoring, as reflected by enhanced neural responses to errors (the error-related negativity, ERN), is considered a biomarker for obsessive-compulsive disorder (OCD) and may be a promising target for novel treatment approaches. Prior research suggests that non-invasive brain stimulation with transcranial direct current stimulation (tDCS) may reduce the ERN in healthy individuals, yet no study has investigated its efficacy in attenuating the ERN in OCD. In this preregistered, randomized, sham-controlled, crossover study, we investigated effects of...

Individual differences in behaviour, traits and mental-health are partially heritable. Traditionally, studies have focused on quantifying the heritability of high-order characteristics, such as happiness or education attainment. Here, we quantify the degree of heritability of lower-level mental processes that likely contribute to complex traits and behaviour. In particular, we quantify the degree of heritability of cognitive and affective factors that contribute to the generation of beliefs about risk, which drive behavior in domains ranging from finance to health....

Economic inequality is associated with preferences for smaller, immediate gains over larger, delayed ones. Such temporal discounting may feed into rising global inequality, yet it is unclear whether it is a function of choice preferences or norms, or rather the absence of sufficient resources for immediate needs. It is also not clear whether these reflect true differences in choice patterns between income groups. We tested temporal discounting and five intertemporal choice anomalies using local currencies and value standards in 61 countries (N = 13,629). Across a...

Transfer of learning refers to successful application of previously acquired knowledge or skills to novel settings. Although working memory (WM) is thought to play a role in transfer learning, direct evidence of the effect of limitations in WM on transfer learning is lacking. To investigate, we used an acquired equivalence paradigm that included tests of association and transfer learning. The effects of imposing an acute WM limitation on young adults was tested (within-subjects design: N = 27 adults; Mage = 24 years) by conducting learning transfer tests...

Solutions to challenging inference problems are often subject to a fundamental trade-off between: 1) bias (being systematically wrong) that is minimized with complex inference strategies, and 2) variance (being oversensitive to uncertain observations) that is minimized with simple inference strategies. However, this trade-off is based on the assumption that the strategies being considered are optimal for their given complexity and thus has unclear relevance to forms of inference based on suboptimal strategies. We examined inference problems applied to rare,...

To attain goals, people must proactively prevent interferences and react to interferences once they occur. Whereas most research focuses on how people deal with external interferences, here we investigate the use of proactive and reactive control in dealing with unwanted thoughts. To examine this question, we asked people to generate an association to each of several repeating cue words, while forbidding the repetition of associations. Reactively rejecting and replacing unwanted repeated associations after they occur entails slower response times. Conversely, proactive...

Mind wandering is a state in which our mental focus shifts toward task-unrelated thoughts. Although it is known that mind wandering has a detrimental effect on concurrent task performance (e.g., decreased accuracy), its effect on executive functions is poorly studied. Yet the latter question is relevant to many real-world situations, such as rapid stopping during driving. Here, we studied how mind wandering would affect the requirement to subsequently stop an incipient motor response. In healthy adults, we tested whether mind wandering affected stopping and, if so,...

Perceptual confidence is an important internal signal about the certainty of our decisions and there is a substantial debate on how it is computed. We highlight three confidence metric types from the literature: observers either use 1) the full probability distribution to compute probability correct (Probability metrics), 2) point estimates from the perceptual decision process to estimate uncertainty (Evidence-Strength metrics), or 3) heuristic confidence from stimulus-based cues to uncertainty (Heuristic metrics). These metrics are rarely tested against one another, so...

Choices are influenced by gaze allocation during deliberation, so that fixating an alternative longer leads to increased probability of choosing it. Gaze-dependent evidence accumulation provides a parsimonious account of choices, response times and gaze-behaviour in many simple decision scenarios. Here, we test whether this framework can also predict more complex context-dependent patterns of choice in a three-alternative risky choice task, where choices and eye movements were subject to attraction and compromise effects. Choices were best described by a gaze-dependent...

Anxiety disorders are effectively treated with exposure therapy, but relapse remains high. Fear may reinstate after reoccurrence of the negative event because the expectancy of the aversive outcome (unconditioned stimulus [US]) is adjusted but not its evaluation. Imagery rescripting (ImRs) is an intervention that is proposed to work through revaluation of the US. The aim of our preregistered study was to test the effects of ImRs and extinction on US expectancy and US revaluation. Day 1 (n = 106) consisted of acquisition with an aversive film clip as US. The...

We must often decide how much effort to exert or withhold to avoid undesirable outcomes or obtain rewards. In depression and anxiety, levels of avoidance can be excessive and reward-seeking may be reduced. Yet outstanding questions remain about the links between motivated action/inhibition and anxiety and depression levels, and whether they differ between men and women. Here we examined the relationship between anxiety and depression scores, and performance on effortful active and inhibitory avoidance (Study 1) and reward seeking (Study 2) in humans. Undergraduates...

Affective experience has an important role in decision-making with recent theories suggesting a modulatory role of affect in ongoing subjective value computations. However, it is unclear how varying expectations and uncertainty dynamically influence affective experience and how dynamic representation of affect modulates risky choices. Using hierarchical Bayesian modeling on data from a risky choice task (N = 101), we find that the temporal integration of recently encountered choice parameters (expected value, uncertainty, and prediction errors) shapes affective...

As time plays a fundamental role in our social activities, scholars have studied temporal perception since the earliest days of experimental psychology. Since the 1960s, the ubiquity of color has been driving research on the potential effects of the colors red and blue on temporal perception and on its underlying mechanism. However, the results have been inconsistent, which could be attributed to the difficulty of controlling physical properties such as hue and luminance within and between studies. Therefore, we conducted a two-interval duration-discrimination task to...

Deciding whether to engage in strenuous mental activities requires trading-off the potential benefits against the costs of mental effort, but it is unknown which brain rhythms are causally involved in such cost-benefit calculations. We show that brain stimulation targeting midfrontal theta oscillations increases the engagement in goal-directed mental effort. Participants received transcranial alternating current stimulation over dorsomedial prefrontal cortex while deciding whether they are willing to perform a demanding working memory task for monetary rewards....

Value-based decision-making impairment in depression is a complex phenomenon: while some studies did find evidence of blunted reward learning and reward-related signals in the brain, others indicate no effect. Here we test whether such reward sensitivity deficits are dependent on the overall value of the decision problem. We used a two-armed bandit task with two different contexts: one rich, one poor where both options were associated with an overall positive, negative expected value, respectively. We tested patients (N = 30) undergoing a major depressive episode...

Research deployed via the internet and administered via smartphones could have access to more diverse samples than lab-based research. Diverse samples could have relatively high variation in their traits and so yield relatively reliable measurements of individual differences in these traits. Several cognitive tasks that originated from the experimental research tradition have been reported to yield relatively low reliabilities (Hedge et al., 2018) in samples with restricted variance (students). This issue could potentially be addressed by smartphone-mediated...

Two fundamental issues in memory research concern when later experiences strengthen or weaken initial memories and when the two memories become linked or remain independent. A promising candidate for explaining these issues is semantic relatedness. Here, across five paired-associate learning experiments (N=1000), we systematically varied the semantic relatedness between initial and later cues, initial and later targets, or both. We found that learning retroactively benefited long-term memory performance for semantically related words (vs. unshown control words),...

While making plans, people have to decide how far out into the future they want to plan: days, months, years, or even longer. Overly short-sighted planning can harm peoples well-being in important life domains, such as health, finances, and academics. While self-report scales exist to measure peoples planning, peoples answers to such questions may be distorted by their desire to make a good impression and conform to norms and expectations. Here, we introduce a method for objectively quantifying peoples propensity to plan into the future. Our method combines a...

To determine how much cognitive control to invest in a task, people need to consider whether exerting control matters for obtaining rewards. In particular, they need to account for the efficacy of their performance-the degree to which rewards are determined by performance or by independent factors. Yet it remains unclear how people learn about their performance efficacy in an environment. Here we combined computational modeling with measures of task performance and EEG, to provide a mechanistic account of how people (i) learn and update efficacy expectations in a...

Human decision-making is underpinned by distinct systems that differ in flexibility and associated cognitive cost. A widely accepted dichotomy distinguishes between a cheap but rigid model-free system and a flexible but costly model-based system. Typically, humans use a hybrid of both types of decision-making depending on environmental demands. However, childrens use of a model-based system during decision-making has not yet been shown. While prior developmental work has identified simple building blocks of model-based reasoning in young children (1-4 years old), there...

During adolescence, youth venture out, explore the wider world, and are challenged to learn how to navigate novel and uncertain environments. We investigated how performance changes across adolescent development in a stochastic, volatile reversal-learning task that uniquely taxes the balance of persistence and flexibility. In a sample of 291 participants aged 8-30, we found that in the mid-teen years, adolescents outperformed both younger and older participants. We developed two independent cognitive models, based on Reinforcement learning (RL) and Bayesian inference...

When we plan for long-range goals, proximal information cannot be exploited in a blindly myopic way, as relevant future information must also be considered. But when a subgoal must be resolved first, irrelevant future information should not interfere with the processing of more proximal, subgoal-relevant information. We explore the idea that decision making in both situations relies on the flexible modulation of the degree to which different pieces of information under consideration are weighted, rather than explicitly decomposing a problem into smaller parts and...

Accurate assessment of environmental controllability enables individuals to adaptively adjust their behavior-exploiting rewards when desirable outcomes are contingent upon their actions and minimizing costly deliberation when their actions are inconsequential. However, it remains unclear how estimation of environmental controllability changes from childhood to adulthood. Ninety participants (ages 8-25) completed a task that covertly alternated between controllable and uncontrollable conditions, requiring them to explore different actions to discover the current degree...

Internal models capture the regularities of the environment and are central to understanding how humans adapt to environmental statistics. In general, the correct internal model is unknown to observers, instead they rely on an approximate model that is continually adapted throughout learning. However, experimenters assume an ideal observer model, which captures stimulus structure but ignores the diverging hypotheses that humans form during learning. We combine non-parametric Bayesian methods and probabilistic programming to infer rich and dynamic individualised internal...

Our knowledge of the world is populated with categories such as dogs, cups, and chairs. Such categories shape how we perceive, remember, and reason about their members. Much of our exposure to the entities we come to categorize occurs incidentally as we experience and interact with them in our everyday lives, with limited access to explicit teaching. This research investigated whether incidental exposure contributes to building category knowledge by rendering people “ready to learn”-allowing them to rapidly capitalize on brief access to explicit teaching. Across five...

How does the brain prioritize among the contents of working memory (WM) to appropriately guide behavior? Previous work, employing inverted encoding modeling (IEM) of electroencephalography (EEG) and functional magnetic resonance imaging (fMRI) datasets, has shown that unprioritized memory items (UMI) are actively represented in the brain, but in a “flipped”, or opposite, format compared to prioritized memory items (PMI). To acquire independent evidence for such a priority-based representational transformation, and to explore underlying mechanisms, we trained recurrent...

Threatening situations ask for rapid and accurate perceptual decisions to optimize coping. Theoretical models have stated that psychophysiological states, such as bradycardia during threat-anticipatory freezing, may facilitate perception. However, it’s unclear if this occurs via enhanced bottom-up sensory processing or by relying more on prior expectations. To test this, 52 (26 female) participants completed a visual target-detection paradigm under threat-of-shock (15% reinforcement rate) with a manipulation of prior expectations. Participants judged the presence of a...

We must often infer latent properties of the world from noisy and changing observations. Complex, probabilistic approaches to this challenge such as Bayesian inference are accurate but cognitively demanding, relying on extensive working memory and adaptive processing. Simple heuristics are easy to implement but may be less accurate. What is the appropriate balance between complexity and accuracy? Here we model a hierarchy of strategies of variable complexity and find a power law of diminishing returns: increasing complexity gives progressively smaller gains in accuracy....

Although living in social groups provides many benefits for group members, such groups also serve as a setting for social competition over rank and influence. Evolutionary accounts suggest that social anxiety plays a role in regulating in-group conflict, as individuals who are concerned about social threat may choose to defer to others to maintain the hierarchical status quo. Here, we examine how social anxiety levels are related to the advice-giving style an individual adopts: a competitive influence-seeking strategy or a defensive blend-in strategy. We begin by...

Explicit information obtained through instruction profoundly shapes human choice behaviour. However, this has been studied in computationally simple tasks, and it is unknown how model-based and model-free systems, respectively generating goal-directed and habitual actions, are affected by the absence or presence of instructions. We assessed behaviour in a variant of a computationally more complex decision-making task, before and after providing information about task structure, both in healthy volunteers and in individuals suffering from obsessive-compulsive or other...

Deciding between exploring new avenues and exploiting known choices is central to learning, and this exploration-exploitation trade-off changes during development. Exploration is not a unitary concept, and humans deploy multiple distinct mechanisms, but little is known about their specific emergence during development. Using a previously validated task in adults, changes in exploration mechanisms were investigated between childhood (8-9 y/o, N = 26; 16 females), early (12-13 y/o, N = 38; 21 females), and late adolescence (16-17 y/o, N = 33;...

People rely on the choice context to guide their decisions, violating fundamental principles of rational choice theory and exhibiting phenomena called context effects. Recent research has uncovered that dominance relationships can both increase or decrease the choice share of the dominating option, marking the two ends of an attraction-repulsion continuum. However, empirical links between the two opposing effects are scarce and theoretical accounts are missing altogether. The present study (N = 55) used eye tracking alongside a within-subject design that contrasts...

Humans show metacontrol of decision making, that is they adapt their reliance on decision-making strategies toward situational differences such as differences in reward magnitude. Specifically, when higher rewards are at stake, individuals increase reliance on a more accurate but cognitively effortful strategy. We investigated whether the personality trait Need for Cognition (NFC) explains individual differences in metacontrol. Based on findings of cognitive effort expenditure in executive functions, we expected more metacontrol in individuals low in NFC. In two...

Theoretical and empirical accounts suggest that adolescence is associated with heightened reward learning and impulsivity. Experimental tasks and computational models that can dissociate reward learning from the tendency to initiate actions impulsively (action initiation bias) are thus critical to characterise the mechanisms that drive developmental differences. However, existing work has rarely quantified both learning ability and action initiation, or it has tested small samples. Here, using computational modelling of a learning task collected from a large sample...

Computational models of decision making have identified a relationship between obsessive-compulsive symptoms (OCS), both in the general population and in patients, and impairments in perceptual evidence accumulation. Some studies have interpreted these deficits to reflect global disease traits which give rise to clusters of OCS. Such assumptions are not uncommon, even if implicit, in computational psychiatry more broadly. However, it is well established that state- and trait-symptom scores are often correlated (e.g., state and trait anxiety), and the extent to which...

Seeking information when anxious may help reduce the aversive feeling of uncertainty and guide decision-making. If information is negative or confusing, however, this may increase anxiety further. Information gathered under anxiety can thus be beneficial and/or damaging. Here, we examine whether anxiety leads to a general increase in information-seeking, or rather to changes in the type of information and/or situations in which it is sought. In two controlled laboratory studies, we show that both trait anxiety and induced anxiety lead to a selective alteration...

Research suggests that the temporal order in which people receive information about costs and benefits whilst making decisions can influence their choices. But, do people have a preference for seeking information about costs or benefits when making effort-based decisions, and does this impact motivation? Here, participants made choices about whether to exert different levels of physical effort to obtain different magnitudes of reward, or rest for low reward. Prior to each effort-based choice, they also had to decide which information they wanted to see first: how much...

Social interactions influence people’s feelings and behavior. Here, we propose that a person’s well-being is influenced not only by interactions they experience themselves, but also by those they observe. In particular, we test and quantify the influence of observed selfishness and observed inequality on a bystanders’ feelings and non-costly punishment decisions. We developed computational models that relate others’ (un)selfish acts to observers’ emotional reactions and punishment decisions. These characterize the rules by which others’ interactions are transformed into...

Apathy is a debilitating feature of many neuropsychiatric diseases, that is typically described as a reduction of goal-directed behaviour. Despite its prevalence and prognostic importance, the mechanisms underlying apathy remain controversial. Degeneration of the locus coeruleus-noradrenaline system is known to contribute to motivational deficits, including apathy. In healthy people, noradrenaline has been implicated in signalling the uncertainty of expectations about the environment. We proposed that noradrenergic deficits contribute to apathy by modulating the...

A large literature has accumulated suggesting that human and animal decision making is driven by at least two systems, and that important functions of these systems can be captured by reinforcement learning algorithms. The “model-free” system caches and uses stimulus-value or stimulus-response associations, and the “model-based” system implements more flexible planning using a model of the world. However, it is not clear how the two systems interact during deliberation and how a single decision emerges from this process, especially when they disagree. Most previous work...

Data from the NSPN study, a dataset of N=2400 adolescents and young adults (ages 14-24) who completed many self-report, cognitive, and reinforcement learning measures.

The purpose of this pre-registered study was to examine whether asking gamers and non-gamers about their video game playing habits before or after they performed computerized cognitive-motor tasks affects their performance of those tasks. We recruited 187 participants from an online participants’ recruitment platform. Out of those participants, 131 matched our criteria as gamers or non-gamers. They were then divided to two subgroups, and performed a choice-RT task, a Simon task, an alternate task-switching task, and a digit span memory task either before or after...

Simultaneous execution of memory retrieval and cognitively demanding interventions alter the subjective experience of aversive memories. This principle can be used in treatment to target traumatic memories. An often-used interpretation is that cognitive demand interferes with memory reconsolidation. Laboratory models applying this technique often do not meet some important procedural steps thought necessary to trigger reconsolidation. It remains therefore unclear whether cognitively demanding interventions can alter the reconsolidation process of aversive memories....

Conflicts between avoiding feared stimuli versus approaching them for competing rewards are essential for functional behavior and anxious psychopathology. Yet, little is known about the underlying decision process. We examined approach-avoidance decisions and their temporal dynamics when avoiding Pavlovian fear stimuli conflicted with gaining rewards. First, a formerly neutral stimulus (CS+) was repeatedly paired with an aversive stimulus (US) to establish Pavlovian fear. Another stimulus (CS-) was never paired with the US. A control group received neutral tones instead...

When making decisions, we sometimes rely on habit and at other times plan towards goals. Planning requires the construction and use of an internal representation of the environment, a cognitive map. How are these maps constructed, and how do they guide goal-directed decisions? We coupled a sequential decision-making task with a behavioral representational similarity analysis approach to examine how relationships between choice options change when people build a cognitive map of the task structure. We found that participants who encoded stronger higher-order...

Many studies report atypical responses to sensory information in autistic individuals, yet it is not clear which stages of processing are affected, with little consideration given to decision-making processes. We combined diffusion modelling with high-density EEG to identify which processing stages differ between 50 autistic and 50 typically developing children aged 6-14 years during two visual motion tasks. Our pre-registered hypotheses were that autistic children would show task-dependent differences in sensory evidence accumulation, alongside a more cautious...

No one likes to be wrong. Previous research has shown that participants may underweight information incompatible with previous choices, a phenomenon called confirmation bias. In this paper, we argue that a similar bias exists in the way information is actively sought. We investigate how choice influences information gathering using a perceptual choice task and find that participants sample more information from a previously chosen alternative. Furthermore, the higher the confidence in the initial choice, the more biased information sampling becomes. As a consequence,...