Sitemap

A list of all the posts and pages found on the site. For you robots out there is an XML version available for digesting as well.

Pages

Posts

Future Blog Post

less than 1 minute read

This post will show up by default. To disable scheduling of future posts, edit config.yml and set future: false.

Blog Post number 4

less than 1 minute read

This is a sample blog post. Lorem ipsum I can’t remember the rest of lorem ipsum and don’t have an internet connection right now. Testing testing testing this blog post. Blog posts are cool.

Blog Post number 3

less than 1 minute read

This is a sample blog post. Lorem ipsum I can’t remember the rest of lorem ipsum and don’t have an internet connection right now. Testing testing testing this blog post. Blog posts are cool.

Blog Post number 2

less than 1 minute read

This is a sample blog post. Lorem ipsum I can’t remember the rest of lorem ipsum and don’t have an internet connection right now. Testing testing testing this blog post. Blog posts are cool.

Blog Post number 1

less than 1 minute read

This is a sample blog post. Lorem ipsum I can’t remember the rest of lorem ipsum and don’t have an internet connection right now. Testing testing testing this blog post. Blog posts are cool.

portfolio

publications

Exploring Semantic Relatedness Judgments in the Structure of a Semantic Network

Drawing upon work by De Deyne et al. (2016), I explore a model of spreading activation through a semantic network in regards to how different kinds of semantic relationships are encoded in said network. In particular, I examine the contribution of indirect pathways through the network to explain differences in similarity judgments of sensorimotor and linguistic relationships between pairs of words. I propose that the structure of a semantic network encodes properties that distinguish these two types of semantic relationships that are not revealed by measures of association strength that only examine direct connections within the network. A cosine similarity measure extracted from a spreading activation model is compared to a measure of association strength in accounting for observed similarity judgments, and a model for examining the differential contributions of various random walk pathways through a semantic network in the encoding of sensorimotor and linguistic semantic relationships is presented.

Recommended citation: Bruna, P. J. (2021). Exploring Semantic Relatedness Judgments in the Structure of a Semantic Network [Unpublished manuscript]. Department of Cognitive Science, Vassar College. https://osf.io/sj7tg/

Words May Jump-Start Meaning More Than Vision: A Non-Replication of Early ERP Effects in Boutonnet and Lupyan (2015)

We report a replication of Boutonnet and Lupyan’s (2015) study of the effects of linguistic labelling on perceptual performance. In addition to a response time advantage of linguistic labels over non-linguistic auditory cues in judging visual objects, Boutonnet and Lupyan found that the two types of cues produced different patterns in the early perceptual ERP components P1 and P2 but not the later, semantics-relevant N4. This study thus adds an important piece of evidence supporting the claim of genuine top-down effects on perception. Given the controversy over this claim and the need for replication of key findings, we attempted to replicate Boutonnet and Lupyan (2015). We replicated their behavioral findings that response times to indicate whether an auditory cue matches a visual image of an object were faster for match than mismatch trials and faster for linguistic than non-linguistic cues. We did not replicate the main ERP effects supporting a positive effect of linguistic labels on the early perceptual ERP components P1 and P2, though we did find a congruence by cue type interaction effect on those components. Unlike Boutonnet and Lupyan, we found a main effect of cue type on the N4 in which non-linguistic cues produced more negative amplitudes. Exploratory analyses of the unpredicted N4 effect suggest that the response time advantage of linguistic labels occurred during semantic rather than early visual processing. This experiment was pre-registered at https://osf.io/cq8g4/ and conducted as part of an undergraduate cognitive science research methods class at Vassar College.

Recommended citation: de Leeuw, J. R., Andrews, J., Barney, L., Bigler, M., Bruna, P. J., Chen, Y., Cherry, R., Dowie, D. R., Forbes, E., Haffey, B., Hu, X., Jaklitsch, M., Leopold, N., Lewis, C., MacDonald, D., McShaffrey, C., Nakayama, K., Olstad, W., Peng, R., … Zhang, L. (2021). Words May Jump-Start Meaning More Than Vision: A Non-Replication of Early ERP Effects in Boutonnet and Lupyan (2015). Collabra: Psychology, 7(1). https://doi.org/10.1525/collabra.29763

What Next? : Leveraging Surprise in a Recurrent Neural Network to (de)Construct Morphological Complexity in Japanese

The question of how we as cognitive agents and biological creatures acting within a world describe, understand, and communicate about this shared world and our motivations within it has long existed at the center of cognitive science. The ability to utilize language has even been hailed as a hallmark of what it is to have a mind. Language is an action that involves transforming complex, non-linear information about the world and ourselves into linear expressions and communicating them in real time, and yet it seems every language accomplishes this in its own way. Formal language modeling exhibits a bias towards the linguistic features observed in English and related languages, namely the ability to describe language in terms of word-based units. This bias has caused language models to be ill-equipped for success in languages exhibiting a high degree of morphological complexity, such as the agglutinative morphology found in Japanese, and indicates a shortcoming in our understanding of the underlying cognitive processes that allow us to be thinkers, speakers, and listeners. This study embarks on an effort to challenge the traditional scales at which we conceptualize information processing in language. I employ a recurrent neural network (RNN) to explore character-by-character predictability in samples of contemporary Japanese text. I address what properties of agglutinative morphology are salient to neural networks and offer a comparison between meaning construction in Japanese and English. This study further investigates the unique morpho-syntactic role played by orthography in Japanese. I find success in extracting certain key features of the structure of Japanese sentences using an RNN and offer a path for deepening our understanding of the differences in information encoding and processing that we observe across languages and how these differences arise.

Recommended citation: Bruna, P. J. (2022). What Next? : Leveraging Surprise in a Recurrent Neural Network to (de)Construct Morphological Complexity in Japanese [Unpublished manuscript]. Department of Cognitive Science, Vassar College.

Probing the Methodology and Interpretation of Learned Categorical Perception Research

Learned categorical perception (CP) is a phenomenon where learning to place objects in categories influences how similar they appear, with objects in different categories becoming easier to tell apart and/or objects in the same category becoming harder to tell apart. Despite these effects being widely demonstrated, past studies exhibit low statistical power and the literature lacks a unifying theoretical framework. We seek to rectify these issues by conducting a systematic methodological investigation of learned CP, starting with replicating the effect under the conditions with which it has traditionally been reported, then exploring how successive methodological changes impact the presence of the effect. Our replication failed to show a pattern indicative of learned CP from comparing discrimination performance between a group that had learned a category distinction and a control group that had not. Through exploring our data to scrutinize possible key differences between our study and previous demonstrations of learned CP, we hypothesized that a combination of our stimuli being too easy to discriminate and the memorization of individual stimuli along each dimension obstructed the influence of category membership on discrimination behavior and was responsible for the absence of CP effects. We addressed this issue by lowering the discriminability of stimulus pairs and by increasing the number of stimuli in each category. Preliminary results suggest a possible learned CP effect and we plan to collect additional data to clarify the nature of the pattern

Recommended citation: Andrews, J. & Bruna, P. J. (2023). Probing the Methodology and Interpretation of Learned Categorical Perception Research [Manuscript in preparation]. Department of Cognitive Science, Vassar College.

Psychophysical Adaptive Procedure: Developing a New, Generalizable Method

“Staircasing” is a classic experimental procedure used in psychophysics wherein when a subject successfully discriminates between two stimuli that differ on one perceptual dimension, the stimuli become more similar to each other on that dimension, and when the subject fails, the stimuli become more different. The purpose of this procedure is to find the size of the difference that produces a specific level of discrimination success. Traditional staircase procedures require subjects to be run individually for many trials. Our goal was to develop a procedure for crowd-sourced online data collection in which subjects can be tested simultaneously using only a few trials each with every new piece of data altering the stimulus pair shown on the next trial. We do this by continually fitting subject responses to a plausible function that is used to predict the difference that should produce the desired accuracy level. Only presenting differences predicted to yield the desired performance allows us to find the difference corresponding to this accuracy level faster than sampling the whole range of stimulus differences. The stimulus values we determined with this method were used for research on the phenomenon of learned categorical perception. We present this new technique as an efficient way of determining psychophysical values more generally for purposes of controlling stimulus discriminability in experimental research.

Recommended citation: Bruna, P. J., Andrews, J., & de Leeuw, J. R. (2023). Psychophysical Adaptive Procedure: Developing a New, Generalizable Method [Manuscript in preparation]. Department of Cognitive Science, Vassar College.

Concept Alignment

Discussion of AI alignment (alignment between humans and AI systems) has focused on value alignment, broadly referring to creating AI systems that share human values. We argue that before we can even attempt to align values, it is imperative that AI systems and humans align the concepts they use to understand the world. We integrate ideas from philosophy, cognitive science, and deep learning to explain the need for concept alignment, not just value alignment, between humans and machines. We summarize existing accounts of how humans and machines currently learn concepts, and we outline opportunities and challenges in the path towards shared concepts. Finally, we explain how we can leverage the tools already being developed in cognitive science and AI research to accelerate progress towards concept alignment.

Recommended citation: Rane, S., Bruna, P. J., Sucholutsky, I., Kello, C., & Griffiths, T. (2023). Concept alignment. 1st NeurIPS Workshop on AI meets Moral Philosophy and Moral Psychology (MP2).

talks

Psychophysical Adaptive Procedure: Developing a New, Generalizable Method

“Staircasing” is a classic experimental procedure used in psychophysics wherein when a subject successfully discriminates between two stimuli that differ on one perceptual dimension, the stimuli become more similar to each other on that dimension, and when the subject fails, the stimuli become more different. The purpose of this procedure is to find the size of the difference that produces a specific level of discrimination success. Traditional staircase procedures require subjects to be run individually for many trials. Our goal was to develop a procedure for crowd-sourced online data collection in which subjects can be tested simultaneously using only a few trials each with every new piece of data altering the stimulus pair shown on the next trial. We do this by continually fitting subject responses to a plausible function that is used to predict the difference that should produce the desired accuracy level. Only presenting differences predicted to yield the desired performance allows us to find the difference corresponding to this accuracy level faster than sampling the whole range of stimulus differences. The stimulus values we determined with this method were used for research on the phenomenon of learned categorical perception. We present this new technique as an efficient way of determining psychophysical values more generally for purposes of controlling stimulus discriminability in experimental research.

Hearing That It Is Silent: How to Hallucinate a Non-Perception

What do we perceive when we experience silence? The traditional position denies that experiences of silence are perceptions because to perceive is to perceive something. If this is the case, then it does not seem possible to hallucinate silence because there would be no object of the hallucinatory perceptual experience. Yet our ability to hallucinate silence is intuitively plausible. In this paper, I develop an account of the traditional view on which the hallucination of perceptual absences is possible. Utilizing a disjunctivist notion of hallucination, I emphasize one’s epistemic access to the relevant perceptual information rather than their perceptual object to account for the experience of silence for a hearing person in both veridical and hallucinatory cases. (Conference canceled due to COVID-19)

Probing the Methodology and Interpretation of Learned Categorical Perception Research

Learned categorical perception (CP) is a phenomenon where learning to place objects in categories influences how similar they appear, with objects in different categories becoming easier to tell apart and/or objects in the same category becoming harder to tell apart. Despite these effects being widely demonstrated, past studies exhibit low statistical power and the literature lacks a unifying theoretical framework. We seek to rectify these issues by conducting a systematic methodological investigation of learned CP, starting with replicating the effect under the conditions with which it has traditionally been reported, then exploring how successive methodological changes impact the presence of the effect. Our replication failed to show a pattern indicative of learned CP from comparing discrimination performance between a group that had learned a category distinction and a control group that had not. Through exploring our data to scrutinize possible key differences between our study and previous demonstrations of learned CP, we hypothesized that a combination of our stimuli being too easy to discriminate and the memorization of individual stimuli along each dimension obstructed the influence of category membership on discrimination behavior and was responsible for the absence of CP effects. We addressed this issue by lowering the discriminability of stimulus pairs and by increasing the number of stimuli in each category. Preliminary results suggest a possible learned CP effect and we plan to collect additional data to clarify the nature of the pattern.

Semantics and Syntax Co-emerge in Adaptive Reservoir Network Dynamics

It is well known that a word can carry different meanings in different contexts, but how exactly do lexical semantics interact with a broader syntactic context? On the one hand, meaning at the lexical level may influence how one syntactically parses the sentence within which it is embedded. Snedeker & Trueswell (2004) found behavioral evidence that the interpretation of syntactically ambiguous verb-argument structures is influenced by a verb’s bias towards one of these structures or another, and more recent evidence from Ryskin et al. (2017) indicates that these verb biases can be manipulated through experience. This constitutes behavioral evidence that semantics can influence syntax in language use. On the other hand, in neural network simulations, changes in lexico-syntactic context have been shown to subtly modulate the population encoding of lexical inputs, or, in other words, induce shifts in semantics. (Elman, 2009). These findings suggest that the distinction between semantics and syntax may be more conceptual than it is indicative of two natural kinds. Building on the findings of Falandays et al. (2021), we test if an unsupervised, adaptive reservoir computing network is able to learn long-distance dependencies in a simple linguistic environment of sentences containing verbs which have differential biases toward possible arguments. The future goal of this work is to use this model to explore if changes in the statistical patterns of verb bias result in semantic shifts. This work uses computational modeling to explore how semantics and syntax can co-emerge as linguistic properties from simple adaptive behaviors of a cognitive agent entraining with its environment.

Concept Alignment

Discussion of AI alignment (alignment between humans and AI systems) has focused on value alignment, broadly referring to creating AI systems that share human values. We argue that before we can even attempt to align values, it is imperative that AI systems and humans align the concepts they use to understand the world. We integrate ideas from philosophy, cognitive science, and deep learning to explain the need for concept alignment, not just value alignment, between humans and machines. We summarize existing accounts of how humans and machines currently learn concepts, and we outline opportunities and challenges in the path towards shared concepts. Finally, we explain how we can leverage the tools already being developed in cognitive science and AI research to accelerate progress towards concept alignment.

teaching

Introduction to Cognitive Science

Undergraduate course, Vassar College, Department of Cognitive Science, 2021

Cognitive science is a multidisciplinary exploration of the nature of mind and intelligence in whatever forms they may take, from animal (including especially humans) to machine. This course explores the modern history of our efforts to understand the nature of mind, asking such questions as how a purely physical entity could have a mind, whether a computer or robot could have genuine mental states, and what it really means to be intelligent or to have a mind. In the process of seeking answers to these questions, the course explores such phenomena as perception, memory, prediction, decision-making, action, language, and consciousness by integrating methods and concepts from a number of disciplines, including philosophy, psychology, computer science, neuroscience, biology, linguistics, and anthropology. Material from economics, education, mathematics, engineering, and the arts is increasingly integrated into the field as well. No background in any of these disciplines is assumed, and this course is intended to serve as an introduction, for both majors and non-majors, to the unique multidisciplinary approach to studying problems of mind that Cognitive Science represents.