check
Publications | Yonatan Loewenstein Lab

Publications

2023
Noda, T., Kienle, E., Eppler, J. - B., Aschauer, D. F., Kaschube, M., Loewenstein, Y., & Rumpel, S. . (2023). Homeostasis of a representational map in the neocortex. bioRxiv, 2023.06.13.544358. Retrieved from Publisher's VersionAbstract
Cortical function and the processing of sensory stimuli is remarkably robust against the continuous loss of neurons during aging, but also accelerated loss during prodromal stages of neurodegeneration. Population activity of neurons in sensory cortices builds a representation of the environment in form of a map that is structured in an informative way for guiding behavior. Here, we used the mouse auditory cortex as a model and probed the robustness of a representational map against the removal functionally characterized neurons. Specifically, we tested in how far the structure of the representational map is safeguarded by homeostatic network mechanisms. We combined longitudinal two-photon calcium imaging of population responses evoked by a diverse set of sound stimuli in the mouse auditory cortex with a targeted microablation of individual, functionally characterized neurons. Unilateral microablation of 30 - 40 selected sound-responsive layer 2/3 neurons led to a temporary collapse of the representational map that showed a subsequent recovery. At the level of individual neurons, we observed that the recovery was predominantly driven by neurons that were unresponsive to the sounds before microablation and gained responsiveness during the time course of several days. The remodeling of the spared network was mediated by a shift of the distribution of tuning curves towards the ablated neurons and was accompanied by a shift in the excitation/inhibition balance. Together, our findings provide a link between the plasticity of individual neurons and the population dynamics of sensory representations mediating robustness of cortical function. The dynamic reconstitution of the structure of activity patterns evoked by sensory stimuli despite a permanent loss of neurons in the network demonstrates a homeostatic maintenance of sensory representations in the neocortex.
pdf
Fox, L., Dan, O., & Loewenstein, Y. . (2023). On the computational principles underlying human exploration. PsyArXiv. Retrieved from Publisher's VersionAbstract
Adapting to new environments is a hallmark of animal and human cognition, and Reinforcement Learning (RL) models provide a powerful and general framework for studying such adaptation. A fundamental learning component identified by RL models is that in the absence of direct supervision, when learning is driven by trial-and-error, exploration is essential. The necessary ingredients of effective exploration have been studied extensively in machine learning. However, the relevance of some of these principles to humans’ exploration is still unknown. An important reason for this gap is the dominance of the Multi-Armed Bandit tasks in human exploration studies. In these tasks, the exploration component per se is simple, because local measures of uncertainty, most notably visit-counters, are sufficient to effectively direct exploration. By contrast, in more complex environments, actions have long-term exploratory consequences that should be accounted for when measuring their associated uncertainties. Here, we use a novel experimental task that goes beyond the bandit task to study human exploration. We show that when local measures of uncertainty are insufficient, humans use exploration strategies that propagate uncertainties over states and actions. Moreover, we show that the long-term exploration consequences are temporally-discounted, similar to the temporal discounting of rewards in standard RL tasks. Additionally, we show that human exploration is largely uncertainty-driven. Finally, we find that humans exhibit signatures of temporally-extended learning, rather than local, 1-step update rules which are commonly assumed in RL models. All these aspects of human exploration are well-captured by a computational model in which agents learn an exploration “value-function”, analogous to the standard (reward-based) value-function in RL.
pdf
Elber-Dorozko, L., & Loewenstein, Y. . (2023). Do Retinal Neurons Also Represent Somatosensory Inputs? On Why Neuronal Responses Are Not Sufficient to Determine What Neurons Do . Cognitive Science, 47(4), e13265. Retrieved from Publisher's VersionAbstract
How does neuronal activity give rise to cognitive capacities? To address this question, neuroscientists hypothesize about what neurons “represent,” “encode,” or “compute,” and test these hypotheses empirically. This process is similar to the assessment of hypotheses in other fields of science and as such is subject to the same limitations and difficulties that have been discussed at length by philosophers of science. In this paper, we highlight an additional difficulty in the process of empirical assessment of hypotheses that is unique to the cognitive sciences. We argue that, unlike in other scientific fields, comparing hypotheses according to the extent to which they explain or predict empirical data can lead to absurd results. Other considerations, which are perhaps more subjective, must be taken into account. We focus on one such consideration, which is the purposeful function of the neurons as part of a biological system. We believe that progress in neuroscience critically depends on properly addressing this difficulty.
pdf
Shulman, D., Dubnov, S., Zorbaz, T., Madrer, N., Paldor, I., Bennett, D. A., Seshadri, S., et al. (2023). Sex-specific declines in cholinergic-targeting tRNA fragments in the nucleus accumbens in Alzheimer's disease. Alzheimer's & Dementia, 19(11), 5159-5172. Retrieved from Publisher's VersionAbstract

Introduction

Females with Alzheimer's disease (AD) suffer accelerated dementia and loss of cholinergic neurons compared to males, but the underlying mechanisms are unknown. Seeking causal contributors to both these phenomena, we pursued changes in transfer RNS (tRNA) fragments (tRFs) targeting cholinergic transcripts (CholinotRFs).

Methods

We analyzed small RNA-sequencing (RNA-Seq) data from the nucleus accumbens (NAc) brain region which is enriched in cholinergic neurons, compared to hypothalamic or cortical tissues from AD brains; and explored small RNA expression in neuronal cell lines undergoing cholinergic differentiation.

Results

NAc CholinotRFs of mitochondrial genome origin showed reduced levels that correlated with elevations in their predicted cholinergic-associated mRNA targets. Single-cell RNA seq from AD temporal cortices showed altered sex-specific levels of cholinergic transcripts in diverse cell types; inversely, human-originated neuroblastoma cells under cholinergic differentiation presented sex-specific CholinotRF elevations.

Discussion

Our findings support CholinotRFs contributions to cholinergic regulation, predicting their involvement in AD sex-specific cholinergic loss and dementia.

pdf
מודלים חישוביים במדעי הקוגניציה
שנטל, נעם, & לוינשטיין, יונתן. (2023). מודלים חישוביים במדעי הקוגניציה (p. 370). רעננה: למדא - ספרי האוניברסיטה הפתוחה. Retrieved from Publisher's Versionתקציר
חוקר אמריקני נהג לטייל עם כלבו על קו המים בחוף אגם מישיגן ולזרוק כדור למרחק רב. הכלב, כך הבחין, חזר שוב ושוב על אותו דפוס פעולה: הוא רץ על החוף עד נקודה מסוימת, ואז קפץ לאגם ושחה עד הכדור. כיצד יודע הכלב לבחור פעם אחר פעם את המסלול היעיל ביותר מבחינתו?
התשובה לשאלה זו ולשאלות נוספות הנוגעות לתהליכי חשיבה טמונה במערך סבוך של רשתות נוירונים שכדי להבין אותם, אנו נדרשים לחישובים מורכבים. הספר מודלים חישוביים במדעי הקוגניציה משתמש בכלים מתמטיים כדי להסביר מהלכים קוגניטיביים, והניסויים והתופעות המתוארים בו מלווים בהסברים בהירים.
 
נעם שנטל הוא פרופסור במחלקה למדעי המחשב באוניברסיטה הפתוחה. מחקריו עוסקים בביולוגיה חישובית.
יונתן לוינשטיין הוא פרופסור במחלקות לנוירוביולוגיה ולמדעי הקוגניציה והמוח, וחבר במרכז אדמונד ולילי ספרא למדעי המוח ובמרכז פדרמן לחקר הרציונליות באוניברסיטה העברית בירושלים. מחקריו עוסקים באספקטים חישוביים במדעי המוח והקוגניציה.
2022
Barak, T., & Loewenstein, Y. . (2022). Zero-Episode Few-Shot Contrastive Predictive Coding: Solving intelligence tests without prior training. arXiv, 2205.01924. Retrieved from Publisher's VersionAbstract
Video prediction models often combine three components: an encoder from pixel space to a small latent space, a latent space prediction model, and a generative model back to pixel space. However, the large and unpredictable pixel space makes training such models difficult, requiring many training examples. We argue that finding a predictive latent variable and using it to evaluate the consistency of a future image enables data-efficient predictions because it precludes the necessity of a generative model training. To demonstrate it, we created sequence completion intelligence tests in which the task is to identify a predictably changing feature in a sequence of images and use this prediction to select the subsequent image. We show that a one-dimensional Markov Contrastive Predictive Coding (M-CPC1D) model solves these tests efficiently, with only five examples. Finally, we demonstrate the usefulness of M-CPC1D in solving two tasks without prior training: anomaly detection and stochastic movement video prediction.
pdf
Barak, T., & Loewenstein, Y. . (2022). Naive Few-Shot Learning: Uncovering the fluid intelligence of machines. arXiv, 2205.12013. Retrieved from Publisher's VersionAbstract
In this paper, we aimed to help bridge the gap between human fluid intelligence - the ability to solve novel tasks without prior training - and the performance of deep neural networks, which typically require extensive prior training. An essential cognitive component for solving intelligence tests, which in humans are used to measure fluid intelligence, is the ability to identify regularities in sequences. This motivated us to construct a benchmark task, which we term sequence consistency evaluation (SCE), whose solution requires the ability to identify regularities in sequences. Given the proven capabilities of deep networks, their ability to solve such tasks after extensive training is expected. Surprisingly, however, we show that naive (randomly initialized) deep learning models that are trained on a single SCE with a single optimization step can still solve non-trivial versions of the task relatively well. We extend our findings to solve, without any prior training, realworld anomaly detection tasks in the visual and auditory modalities. These results demonstrate the fluid-intelligent computational capabilities of deep networks. We discuss the implications of our work for constructing fluid-intelligent machines.
pdf
Seiler, J. P. - H., Dan, O., Tüscher, O., Loewenstein, Y., & Rumpel, S. . (2022). Experienced entropy drives choice behavior in a boring decision-making task . Scientific Reports, 12, 3162. Retrieved from Publisher's VersionAbstract
Boredom has been defined as an aversive mental state that is induced by the disability to engage in satisfying activity, most often experienced in monotonous environments. However, current understanding of the situational factors inducing boredom and driving subsequent behavior remains incomplete. Here, we introduce a two-alternative forced-choice task coupled with sensory stimulation of different degrees of monotony. We find that human subjects develop a bias in decision-making, avoiding the more monotonous alternative that is correlated with self-reported state boredom. This finding was replicated in independent laboratory and online experiments and proved to be specific for the induction of boredom rather than curiosity. Furthermore, using theoretical modeling we show that the entropy in the sequence of individually experienced stimuli, a measure of information gain, serves as a major determinant to predict choice behavior in the task. With this, we underline the relevance of boredom for driving behavioral responses that ensure a lasting stream of information to the brain.
pdf
Agmon, G., Loewenstein, Y., & Grodzinsky, Y. . (2022). Negative sentences exhibit a sustained effect in delayed verification tasks. Journal of Experimental Psychology: Learning, Memory, and Cognition, 48(1), 122-141. Retrieved from Publisher's VersionAbstract
Negated sentences are known to be more cognitively taxing than positive ones (i.e., polarity effect). We present evidence that two factors contribute to the polarity effect in verification tasks: processing the sentence and verifying its truth value. To quantify the relative contribution of each, we used a delayed verification task. The results show that even when participants are given a considerable amount of time for processing the sentence prior to verification, the polarity effect is not entirely eliminated. We suggest that this sustained effect stems from a retained negation-containing representation in working memory.
pdf
2021
Lebovich, L., Yunerman, M., Scaiewicz, V., Loewenstein, Y., & Rokni, D. . (2021). Paradoxical relationship between speed and accuracy in olfactory figure-background segregation. PLOS Computational Biology, 17(12), e1009674. Retrieved from Publisher's VersionAbstract
In natural settings, many stimuli impinge on our sensory organs simultaneously. Parsing these sensory stimuli into perceptual objects is a fundamental task faced by all sensory systems. Similar to other sensory modalities, increased odor backgrounds decrease the detectability of target odors by the olfactory system. The mechanisms by which background odors interfere with the detection and identification of target odors are unknown. Here we utilized the framework of the Drift Diffusion Model (DDM) to consider possible interference mechanisms in an odor detection task. We first considered pure effects of background odors on either signal or noise in the decision-making dynamics and showed that these produce different predictions about decision accuracy and speed. To test these predictions, we trained mice to detect target odors that are embedded in random background mixtures in a two-alternative choice task. In this task, the inter-trial interval was independent of behavioral reaction times to avoid motivating rapid responses. We found that increased backgrounds reduce mouse performance but paradoxically also decrease reaction times, suggesting that noise in the decision making process is increased by backgrounds. We further assessed the contributions of background effects on both noise and signal by fitting the DDM to the behavioral data. The models showed that background odors affect both the signal and the noise, but that the paradoxical relationship between trial difficulty and reaction time is caused by the added noise.
pdf
Refaeli, R., Doron, A., Benmelech‐Chovav, A., Groysman, M., Kreisel, T., Loewenstein, Y., & Goshen, I. . (2021). Features of hippocampal astrocytic domains and their spatial relation to excitatory and inhibitory neurons. Glia, 69(10), 2378-2390. Retrieved from Publisher's VersionAbstract
The mounting evidence for the involvement of astrocytes in neuronal circuits function and behavior stands in stark contrast to the lack of detailed anatomical description of these cells and the neurons in their domains. To fill this void, we imaged >30,000 astrocytes in hippocampi made transparent by CLARITY, and determined the elaborate structure, distribution, and neuronal content of astrocytic domains. First, we characterized the spatial distribution of >19,000 astrocytes across CA1 lamina, and analyzed the morphology of thousands of reconstructed domains. We then determined the excitatory somatic content of CA1 astrocytes, and measured the distance between inhibitory neuronal somata to the nearest astrocyte soma. We find that on average, there are almost 14 pyramidal neurons per domain in the CA1, increasing toward the pyramidal layer midline, compared to only five excitatory neurons per domain in the amygdala. Finally, we discovered that somatostatin neurons are found in close proximity to astrocytes, compared to parvalbumin and VIP inhibitory neurons. This work provides a comprehensive large-scale quantitative foundation for studying neuron-astrocyte interactions.
pdf
Loewenstein, Y., Raviv, O., & Ahissar, M. . (2021). Dissecting the Roles of Supervised and Unsupervised Learning in Perceptual Discrimination Judgments. Journal of Neuroscience JN-RM, 41(4), 757-765. Retrieved from Publisher's VersionAbstract

Our ability to compare sensory stimuli is a fundamental cognitive function, which is known to be affected by two biases: choice bias, which reflects a preference for a given response, and contraction bias, which reflects a tendency to perceive stimuli as similar to previous ones. To test whether both reflect supervised processes, we designed feedback protocols aimed to modify them and tested them in human participants. Choice bias was readily modifiable. However, contraction bias was not. To compare these results to those predicted from an optimal supervised process, we studied a noise-matched optimal linear discriminator (Perceptron). In this model, both biases were substantially modified, indicating that the “resilience” of contraction bias to feedback does not maximize performance. These results suggest that perceptual discrimination is a hierarchical, two-stage process. In the first, stimulus statistics are learned and integrated with representations in an unsupervised process that is impenetrable to external feedback. In the second, a binary judgment, learned in a supervised way, is applied to the combined percept.

SIGNIFICANCE STATEMENT The seemingly effortless process of inferring physical reality from the sensory input is highly influenced by previous knowledge, leading to perceptual biases. Two common ones are contraction bias (the tendency to perceive stimuli as similar to previous ones) and choice bias (the tendency to prefer a specific response). Combining human psychophysical experiments with computational modeling we show that they reflect two different learning processes. Contraction bias reflects unsupervised learning of stimuli statistics, whereas choice bias results from supervised or reinforcement learning. This dissociation reveals a hierarchical, two-stage process. The first, where stimuli statistics are learned and integrated with representations, is unsupervised. The second, where a binary judgment is applied to the combined percept, is learned in a supervised way.

pdf
2020
Castello-Waldow, T. P., Weston, G., Ulivi, A. F., Chenani, A., Loewenstein, Y., Chen, A., & Attardo, A. . (2020). Hippocampal neurons with stable excitatory connectivity become part of neuronal representations. PLOS BIOLOGY, 8(11). Retrieved from Publisher's VersionAbstract
Experiences are represented in the brain by patterns of neuronal activity. Ensembles of neurons representing experience undergo activity-dependent plasticity and are important for learning and recall. They are thus considered cellular engrams of memory. Yet, the cellular events that bias neurons to become part of a neuronal representation are largely unknown. In rodents, turnover of structural connectivity has been proposed to underlie the turnover of neuronal representations and also to be a cellular mechanism defining the time duration for which memories are stored in the hippocampus. If these hypotheses are true, structural dynamics of connectivity should be involved in the formation of neuronal representations and concurrently important for learning and recall. To tackle these questions, we used deep-brain 2-photon (2P) time-lapse imaging in transgenic mice in which neurons expressing the Immediate Early Gene (IEG) Arc (activity-regulated cytoskeleton-associated protein) could be permanently labeled during a specific time window. This enabled us to investigate the dynamics of excitatory synaptic connectivity—using dendritic spines as proxies—of hippocampal CA1 (cornu ammonis 1) pyramidal neurons (PNs) becoming part of neuronal representations exploiting Arc as an indicator of being part of neuronal representations. We discovered that neurons that will prospectively express Arc have slower turnover of synaptic connectivity, thus suggesting that synaptic stability prior to experience can bias neurons to become part of representations or possibly engrams. We also found a negative correlation between stability of structural synaptic connectivity and the ability to recall features of a hippocampal-dependent memory, which suggests that faster structural turnover in hippocampal CA1 might be functional for memory.
pdf
Fox, L., Dan, O., Elber-Dorozko, L., & Loewenstein, Y. . (2020). Exploration: from machines to humans. Current Opinion in Behavioral Sciences, 35, 104-111. Retrieved from Publisher's Version pdf
Saadon-Grosman, N., Arzy, S., & Loewenstein, Y. . (2020). Hierarchical cortical gradients in somatosensory processing. NeuroImage, 222, 117257 . Retrieved from Publisher's VersionAbstract
Sensory information is processed in the visual cortex in distinct streams of different anatomical and functional properties. A comparable organizational principle has also been proposed to underlie auditory processing. This raises the question of whether a similar principle characterize the somatosensory domain. One property of a cortical stream is a hierarchical organization of the neuronal response properties along an anatomically distinct pathway. Indeed, several hierarchies between specific somatosensory cortical regions have been identified, primarily using electrophysiology, in non-human primates. However, it has been unclear how these local hierarchies are organized throughout the cortex. Here we used phase-encoded bilateral full-body light touch stimulation in healthy humans under functional MRI to study the large-scale organization of hierarchies in the somatosensory domain. We quantified two measures of hierarchy of BOLD responses, selectivity and laterality. We measured how selectivity and laterality change as we move away from the central sulcus within four gross anatomically-distinct regions. We found that both selectivity and laterality decrease in three directions: parietal, posteriorly along the parietal lobe, frontal, anteriorly along the frontal lobe and medial, inferiorly-anteriorly along the medial wall. The decline of selectivity and laterality along these directions provides evidence for hierarchical gradients. In view of the anatomical segregation of these three directions, the multiplicity of body representations in each region and the hierarchical gradients in our findings, we propose that as in the visual and auditory domains, these directions are streams of somatosensory information processing.
pdf
Grodzinsky, Y., Jaichenco, V., Deschamps, I., Sanchez, M. E., Fuchs, M., Pieperhoff, P., Loewenstein, Y., et al. (2020). Negation and the brain: Experiments in health and in focal brain disease, and their theoretical implications. In The Oxford Handbook of Negation (Vol. 40). Retrieved from Publisher's Version pdf
Saadon-Grosman, N., Loewenstein, Y., & Arzy, S. . (2020). The ‘creatures’ of the human cortical somatosensory system. Brain Communications, 2(1). Retrieved from Publisher's VersionAbstract
Penfield’s description of the ‘homunculus’, a ‘grotesque creature’ with large lips and hands and small trunk and legs depicting the representation of body-parts within the primary somatosensory cortex (S1), is one of the most prominent contributions to the neurosciences. Since then, numerous studies have identified additional body-parts representations outside of S1. Nevertheless, it has been implicitly assumed that S1’s homunculus is representative of the entire somatosensory cortex. Therefore, the distribution of body-parts representations in other brain regions, the property that gave Penfield’s homunculus its famous ‘grotesque’ appearance, has been overlooked. We used whole-body somatosensory stimulation, functional MRI and a new cortical parcellation to quantify the organization of the cortical somatosensory representation. Our analysis showed first, an extensive somatosensory response over the cortex; and second, that the proportional representation of body parts differs substantially between major neuroanatomical regions and from S1, with, for instance, much larger trunk representation at higher brain regions, potentially in relation to the regions’ functional specialization. These results extend Penfield’s initial findings to the higher level of somatosensory processing and suggest a major role for somatosensation in human cognition.
pdf
2019
Lebovich, L., Darshan, R., Lavi, Y., Hansel, D., & Loewenstein, Y. . (2019). Idiosyncratic choice bias naturally emerges from intrinsic stochasticity in neuronal dynamics . Nature Human Behaviour, 3(11), 1190–1202. Retrieved from Publisher's VersionAbstract
Idiosyncratic tendency to choose one alternative over others in the absence of an identified reason is a common observation in two-alternative forced-choice experiments. Here we quantify idiosyncratic choice biases in a perceptual discrimination task and a motor task. We report substantial and significant biases in both cases that cannot be accounted for by the experimental context. Then, we present theoretical evidence that even in an idealized experiment, in which the settings are symmetric, idiosyncratic choice bias is expected to emerge from the dynamics of competing neuronal networks. We thus argue that idiosyncratic choice bias reflects the microscopic dynamics of choice and therefore is virtually inevitable in any comparison or decision task.
pdf
Grodzinsky, Y., Deschamps, I., Pieperhoff, P., Iannilli, F., Agmon, G., Loewenstein, Y., & Amunts, K. . (2019). Logical negation mapped onto the brain. Brain Structure and Function, 10, 1-13. Retrieved from Publisher's VersionAbstract
High-level cognitive capacities that serve communication, reasoning, and calculation are essential for finding our way in the world. But whether and to what extent these complex behaviors share the same neuronal substrate are still unresolved questions. The present study separated the aspects of logic from language and numerosity—mental faculties whose distinctness has been debated for centuries—and identified a new cytoarchitectonic area as correlate for an operation involving logical negation. A novel experimental paradigm that was implemented here in an RT/fMRI study showed a single cluster of activity that pertains to logical negation. It was distinct from clusters that were activated by numerical comparison and from the traditional language regions. The localization of this cluster was described by a newly identified cytoarchitectonic area in the left anterior insula, ventro-medial to Broca’s region. We provide evidence for the congruence between the histologically and functionally defined regions on multiple measures. Its position in the left anterior insula suggests that it functions as a mediator between language and reasoning areas.
pdf
Gonzales, B. J., Mukherjee, D., Ashwal-Fluss, R., Loewenstein, Y., & Citri, A. . (2019). Subregion-specific rules govern the distribution of neuronal immediate-early gene induction. PNAS, 10, 1913658116. Retrieved from Publisher's VersionAbstract
The induction of immediate-early gene (IEG) expression in brain nuclei in response to an experience is necessary for the formation of long-term memories. Additionally, the rapid dynamics of IEG induction and decay motivates the common use of IEG expression as markers for identification of neuronal assemblies (“ensembles”) encoding recent experience. However, major gaps remain in understanding the rules governing the distribution of IEGs within neuronal assemblies. Thus, the extent of correlation between coexpressed IEGs, the cell specificity of IEG expression, and the spatial distribution of IEG expression have not been comprehensively studied. To address these gaps, we utilized quantitative multiplexed single-molecule fluorescence in situ hybridization (smFISH) and measured the expression of IEGs (Arc, Egr2, and Nr4a1) within spiny projection neurons (SPNs) in the dorsal striatum of mice following acute exposure to cocaine. Exploring the relevance of our observations to other brain structures and stimuli, we also analyzed data from a study of single-cell RNA sequencing of mouse cortical neurons. We found that while IEG expression is graded, the expression of multiple IEGs is tightly correlated at the level of individual neurons. Interestingly, we observed that region-specific rules govern the induction of IEGs in SPN subtypes within striatal subdomains. We further observed that IEG-expressing assemblies form spatially defined clusters within which the extent of IEG expression correlates with cluster size. Together, our results suggest the existence of IEG-expressing neuronal “superensembles,” which are associated in spatial clusters and characterized by coherent and robust expression of multiple IEGs.
pdf