Alona Fyshe is a computer scientist by training, but her research straddles multiple areas including neuroscience, machine learning and computational linguistics.
Her lab explores how the human brain processes and represents language meaning (semantics) and how it combines words to make complex meaning (semantic composition). Traditionally, models of semantics have been based on large text datasets. These are useful to a point, but to build complete semantic models we need to incorporate experiential knowledge. One way to do this is to study semantics ‘in vivo,’ using brain imaging technology such as fMRI and EEG.
Currently, brain image datasets are very small, representing about an hour of acquisition time per participant. Fyshe proposes moving brain imaging to ‘the field’ – having people record their own brain images, using consumer-grade EEG systems deployed in the home. This will produce much larger datasets, allowing her to more fully explore the complexities of language. Furthermore, developing techniques to collect quality EEG data in the home could change how we detect and diagnose neurological disorders, and how we monitor therapeutic interventions for mental illness.
Xu, Haoyan, Brian Murphy, and Alona Fyshe. "BrainBench: A Brain-Image Test Suite for Distributional Semantic Models." SIGDAT Conference on Empirical Methods for Natural Language Processing, Austin, Texas, 2016.
Fyshe, A. et al. "Interpretable Semantic Vectors from a Joint Model of Brain- and Text-Based Meaning." Annual meeting of the Association for Computational Linguistics, Baltimore, Maryland, 2014.
Wehbe, L. et al. "Simultaneously uncovering the patterns of brain regions involved in different story reading subprocesses." PLoS ONE 9, no 11(2014): e112575.
Fyshe, A. et al. "Documents and Dependencies: an Exploration of Vector Space Models for Semantic Composition." International Conference on Computational Natural Language Learning, Sofia, Bulgaria, 2013.
Sudre, G. et al. "Tracking Neural Coding of Perceptual and Semantic Features of Concrete Nouns." Neuroimage 62, no. 1 (2012): 451–63.
Fyshe, A. et al. "Hierarchical Latent Dictionaries for Models of Brain Activation." International Conference on Artificial Intelligence and Statistics, 2012.