Timezone: »

 
Workshop
MLINI 2014 - 4th NIPS Workshop on Machine Learning and Interpretation in Neuroimaging: Beyond the Scanner
Irina Rish · Georg Langs · Brian Murphy · Guillermo Cecchi · Kai-min K Chang · Leila Wehbe

Sat Dec 13 05:30 AM -- 03:30 PM (PST) @ Level 5, room 513 e, f
Event URL: https://sites.google.com/site/mlininips2014/ »
  1. Aim

    MLINI workshop focuses on machine learning approaches in neuroscience, neuroimaging, with a specific extension to behavioral experiments and psychology. The special topic of this year is "Going Beyond the Scanner", which includes making inference about the subject's mental states from ''cheap'' data such as subject's speech and/or text, audio, video, EEG and other wearable devices.

    We believe that machine learning has a prominent role in shaping how questions in neuroscience are framed, and that the machine-learning mind set is now entering modern psychology and behavioral studies. It is also equally important that practical applications in these fields motivate a rapidly evolving line or research in the machine learning community. In parallel, there is an intense interest in learning more about brain function in the context of rich naturalistic environments and scenes. Efforts to go beyond highly specific paradigms that pinpoint a single function, towards schemes for measuring the interaction with natural and more varied scene are made. In this context, many controversies and open questions exist.

    The goal of the workshop is to pinpoint the most pressing issues and common challenges across the fields, and to sketch future directions and open questions in the light of novel methodology. The proposed workshop is aimed at offering a forum that joins machine learning, neuroscience, and psychology community, and should facilitate formulating and discussing the issues at their interface.

    Motivated by the previous workshops in this series, MLINI ‘11, MLINI’12, and MLINI’13, we will center this workshop around invited talks, and two panel discussions. Triggered by these discussions, this year we plan to adapt the workshop topics to a less traditional scope neuroimaging scope and investigate the role of behavioral models and psychology, including topics such as psycholinguistics.

    Besides interpretation, and the shift of paradigms, many open questions remain at the intersection of machine learning, neuroimaging and psychology. Among them:


    - How can we move towards more naturalistic stimuli, tasks and paradigms in neuroimaging and neuro-signal analysis?

    - What kind of mental states can be inferred from cheaper and easier to collect data sources (as an alternative to fMRI scanner) such as text, speech, audio, video, EEG, and wearable devices?

    - How can we leave the lab when acquiring neuroimaging data, towards exploiting mobile acquisition (EEG and NIRS)?

    - What type of features should be extracted from naturalistic stimuli such as text, voice, etc., to detect specific mental states and/or mental disorders?

    - How can we combine traditional neuroimaging with naturalistic data collected from a subject or group of subjects?

    - In general, can we characterize situations when multivariate predictive analysis (MVPA) and inference methods are better suited for brain imaging analysis than more traditional techniques?

    - Given recent advances of deep learning in image analysis and other applications, a natural question to ask is whether neuroimaging analysis can benefit from such approaches?

    - How well can functional networks and dynamical models capture the brain activity, and when using network and dynamics information is superior to standard task-based brain activations?


    2. Overview

    Modern multivariate statistical methods have been increasingly applied to various problems in neuroimaging, including “mind reading”, “brain mapping”, clinical diagnosis and prognosis. Multivariate pattern analysis (MVPA) methods are designed to examine complex relationships between large-dimensional signals, such as brain MRI images, and an outcome of interest, such as the category of a stimulus, with a limited amount of data. The MVPA approach is in contrast with the classical mass-univariate (MUV) approach that treats each individual imaging measurement in isolation.

    Recent multivariate methods give researchers more latitude in their choice of intricate models of behaviour and psychological state, beyond traditional cognitive and clinical neuroscience studies often limited to binary classification (e.g., healthy vs schizophrenic, etc), and traditionally driven by staitisical tools such as SPM oriented towards contrastive analysis. For example ‘zero-shot-learning’ methods (Mitchell 2008) managed to generalize predictions of brain activity beyond training data, by using a modelled descriptive latent space (in this case a vector space of word meaning). Work by John Anderson predicts variations in local processing load with a general model of cognitive function, instantiated with very specific operations, such as mental arithmetic.


    Finally, an important and rapidly growing area of brain imaging is the study of brain’s functional connectivity, i.e. focusing on brain as a network of functionally dependent areas, as well as brain’s dynamical models (Granger causality, etc). It was demonstrated that functional networks can be very informative about particular mental states and/or diseases even when standard activation-based MUV approaches fail. Modern machine-learning approaches to network analysis, including large-scale (sparse) probabilistic graphical models, such as Gaussian MRFs, that go beyond standard correlation-based functional network, can advance our understanding of brain activity even further (e.g., see Honorio et al, and other work). Finally, dynamical models (from differential equations to dynamic graphical models) should provide even more accurate tools for capturing the activity of the brain, perhaps the most complicated dynamical system, and relating it to mental states and behavior.

    In this workshop, we intend to investigate the implications that follow from adopting multivariate machine-learning methods for studying brain function. In particular, this concerns the question how these methods may be used to represent cognitive states, and what ramifications this has for consequent theories of cognition. Besides providing a rationale for the use of machine-learning methods in studying brain function, a further goal of this workshop is to identify shortcomings of state-of-the-art approaches and initiate research efforts that increase the impact of machine learning on cognitive neuroscience. Open questions and possible topics for contribution will be structured around the
    following 4 main topics: I) machine learning and pattern recognition methodology in brain research, II) functional connectivity and dynamical models of brain activity, III) multi-modal analysis including mental state inference from behavioral data, and IV) linking machine learning, neuroimaging and neuroscience.


    3. New topic this year: Beyond the scanner - capturing behavior, cognition and psychology

    This year, we propose to shift the focus of the workshop towards mental state detection and prediction ‘’beyond the scanner”, and focus on making inferences not only from imaging data, but also from relatively cheap data sources such as text of interviews with the patients, as well as voice and other behavioral data. Recent results on applying multivariate statistical techniques to behavioral data, such as text/voice data from interviews with the psychiatric patients, open new exciting opportunities on objectively quantifying mental states from subject’s behavior, i.e. extending the traditional, and rather subjective, diagnostic approaches to the ones based on objective measures computed from behavioral data (i.e., ``computational psychiatry’’). For example, recent exciting directions along these lines include mental state classification using behavioral data such as voice and/or text from interviews with subjects; e.g., several recent papers that demonstrated the possibility of accurate classification of various mental conditions, including schizophrenia, mania, as well as drug influence (ecstasy, meth), based on syntactic graph features as well as semantic features extracted from interviews with subject; moreover, acoustic features of speech were shown to allow for an accurate discrimination of Altzheimer’s patients from MCI and from controls.

    Our aim this year is to explore scientific and practical applications of computational linguistics and other approaches to mental state inference from relatively cheap behavioral data that can be collected on everyday basis, from multiple sources such as smartphones, emails, blogs etc, as well as the data collectible from wearable devices such as inexpensive EEG devices (e.g., NeuroSky), and other wearables (e.g., smart watches etc), in order to analyze, track and potentially improve people's mental state via ''smart personal assistants'' (less seriously, we refer to this approach as to "Freud in a box").

Author Information

Irina Rish (IBM Research AI)
Georg Langs (Medical University of Vienna)
Brian Murphy (BrainWaveBank)
Guillermo Cecchi (IBM Research)
Kai-min K Chang (CMU)
Leila Wehbe (UC Berkeley)

More from the Same Authors

  • 2021 : Pseudo-domains in imaging data improve prediction of future disease status in multi-center studies »
    Matthias Perkonigg · Ahmed Ba-Ssalamah · Georg Langs
  • 2019 : Poster Session »
    Pravish Sainath · Mohamed Akrout · Charles Delahunt · Nathan Kutz · Guangyu Robert Yang · Joseph Marino · L F Abbott · Nicolas Vecoven · Damien Ernst · andrew warrington · Michael Kagan · Kyunghyun Cho · Kameron Harris · Leopold Grinberg · John J. Hopfield · Dmitry Krotov · Taliah Muhammad · Erick Cobos · Edgar Walker · Jacob Reimer · Andreas Tolias · Alexander Ecker · Janaki Sheth · Yu Zhang · Maciej Wołczyk · Jacek Tabor · Szymon Maszke · Roman Pogodin · Dane Corneil · Wulfram Gerstner · Baihan Lin · Guillermo Cecchi · Jenna M Reinen · Irina Rish · Guillaume Bellec · Darjan Salaj · Anand Subramoney · Wolfgang Maass · Yueqi Wang · Ari Pakman · Jin Hyung Lee · Liam Paninski · Bryan Tripp · Colin Graber · Alex Schwing · Luke Prince · Gabriel Ocker · Michael Buice · Benjamin Lansdell · Konrad Kording · Jack Lindsey · Terrence Sejnowski · Matthew Farrell · Eric Shea-Brown · Nicolas Farrugia · Victor Nepveu · Jiwoong Im · Kristin Branson · Brian Hu · Ramakrishnan Iyer · Stefan Mihalas · Sneha Aenugu · Hananel Hazan · Sihui Dai · Tan Nguyen · Doris Tsao · Richard Baraniuk · Anima Anandkumar · Hidenori Tanaka · Aran Nayebi · Stephen Baccus · Surya Ganguli · Dean Pospisil · Eilif Muller · Jeffrey S Cheng · Gaël Varoquaux · Kamalaker Dadi · Dimitrios C Gklezakos · Rajesh PN Rao · Anand Louis · Christos Papadimitriou · Santosh Vempala · Naganand Yadati · Daniel Zdeblick · Daniela M Witten · Nicholas Roberts · Vinay Prabhu · Pierre Bellec · Poornima Ramesh · Jakob H Macke · Santiago Cadena · Guillaume Bellec · Franz Scherr · Owen Marschall · Robert Kim · Hannes Rapp · Marcio Fonseca · Oliver Armitage · Jiwoong Im · Thomas Hardcastle · Abhishek Sharma · Wyeth Bair · Adrian Valente · Shane Shang · Merav Stern · Rutuja Patil · Peter Wang · Sruthi Gorantla · Peter Stratton · Tristan Edwards · Jialin Lu · Martin Ester · Yurii Vlasov · Siavash Golkar
  • 2019 Workshop: Context and Compositionality in Biological and Artificial Neural Systems »
    Javier Turek · Shailee Jain · Alexander Huth · Leila Wehbe · Emma Strubell · Alan Yuille · Tal Linzen · Christopher Honey · Kyunghyun Cho
  • 2019 : Coffee Break & Poster Session »
    Samia Mohinta · Andrea Agostinelli · Alexandra Moringen · Jee Hang Lee · Yat Long Lo · Wolfgang Maass · Blue Sheffer · Colin Bredenberg · Benjamin Eysenbach · Liyu Xia · Efstratios Markou · Jan Lichtenberg · Pierre Richemond · Tony Zhang · JB Lanier · Baihan Lin · William Fedus · Glen Berseth · Marta Sarrico · Matthew Crosby · Stephen McAleer · Sina Ghiassian · Franz Scherr · Guillaume Bellec · Darjan Salaj · Arinbjörn Kolbeinsson · Matthew Rosenberg · Jaehoon Shin · Sang Wan Lee · Guillermo Cecchi · Irina Rish · Elias Hajek
  • 2016 Workshop: Representation Learning in Artificial and Biological Neural Networks »
    Leila Wehbe · Marcel Van Gerven · Moritz Grosse-Wentrup · Irina Rish · Brian Murphy · Georg Langs · Guillermo Cecchi · Anwar O Nunez-Elizalde
  • 2016 Invited Talk: Learning About the Brain: Neuroimaging and Beyond »
    Irina Rish
  • 2016 Demonstration: Automated simulation and replication of fMRI experiments »
    Leila Wehbe · Alexander G Huth · Fatma Deniz · Marie-Luise Kieseler · Jack Gallant
  • 2015 Workshop: Machine Learning and Interpretation in Neuroimaging (day 1) »
    Irina Rish · Leila Wehbe · Brian Murphy · Georg Langs · Guillermo Cecchi · Moritz Grosse-Wentrup
  • 2013 Workshop: MLINI-13: Machine Learning and Interpretation in Neuroimaging (Day 2) »
    Georg Langs · Brian Murphy · Kai-min K Chang · Paolo Avesani · James Haxby · Nikolaus Kriegeskorte · Susan Whitfield-Gabrieli · Irina Rish · Guillermo Cecchi · Raif Rustamov · Marius Kloft · Jonathan Young · Sina Ghiassian · Michael Coen
  • 2013 Workshop: MLINI-13: Machine Learning and Interpretation in Neuroimaging (Day 1) »
    Georg Langs · Brian Murphy · Kai-min K Chang · Paolo Avesani · James Haxby · Nikolaus Kriegeskorte · Susan Whitfield-Gabrieli · Irina Rish · Guillermo Cecchi · Raif Rustamov · Marius Kloft · Jonathan Young · Sina Ghiassian · Michael Coen
  • 2012 Workshop: MLINI - 2nd NIPS Workshop on Machine Learning and Interpretation in Neuroimaging (2 day) »
    Georg Langs · Irina Rish · Guillermo Cecchi · Brian Murphy · Bjoern Menze · Kai-min K Chang · Moritz Grosse-Wentrup
  • 2012 Workshop: MLINI - 2nd NIPS Workshop on Machine Learning and Interpretation in Neuroimaging (2 day) »
    Georg Langs · Irina Rish · Guillermo Cecchi · Brian Murphy · Bjoern Menze · Kai-min K Chang · Moritz Grosse-Wentrup
  • 2011 Workshop: Machine Learning and Interpretation in Neuroimaging (MLINI-2011) »
    Melissa K Carroll · Guillermo Cecchi · Kai-min K Chang · Moritz Grosse-Wentrup · James Haxby · Georg Langs · Anna Korhonen · Bjoern Menze · Brian Murphy · Janaina Mourao-Miranda · Vittorio Murino · Francisco Pereira · Irina Rish · Mert Sabuncu · Irina Simanova · Bertrand Thirion
  • 2010 Workshop: Practical Application of Sparse Modeling: Open Issues and New Directions »
    Irina Rish · Alexandru Niculescu-Mizil · Guillermo Cecchi · Aurelie Lozano
  • 2010 Session: Spotlights Session 12 »
    Irina Rish
  • 2010 Session: Oral Session 15 »
    Irina Rish
  • 2009 Poster: Discriminative Network Models of Schizophrenia »
    Guillermo Cecchi · Irina Rish · Benjamin Thyreau · Bertrand Thirion · Marion Plaze · Jean-Luc Martinot · Marie Laure Paillere-Martinot · Jean-Baptiste Poline
  • 2009 Oral: Discriminative Network Models of Schizophrenia »
    Guillermo Cecchi · Irina Rish · Benjamin Thyreau · Bertrand Thirion · Marion Plaze · Jean-Luc Martinot · Marie Laure Paillere-Martinot · Jean-Baptiste Poline
  • 2008 Workshop: New Directions in Statistical Learning for Meaningful and Reproducible fMRI Analysis »
    Melissa K Carroll · Irina Rish · Francisco Pereira · Guillermo Cecchi
  • 2006 Workshop: Novel Applications of Dimensionality Reduction »
    John Blitzer · Rajarshi Das · Irina Rish · Kilian Q Weinberger