Timezone: »
Intracortical brain-computer interfaces (iBCIs) have allowed people with tetraplegia to control a computer cursor by imagining the movement of their paralyzed arm or hand. State-of-the-art decoders deployed in human iBCIs are derived from a Kalman filter that assumes Markov dynamics on the angle of intended movement, and a unimodal dependence on intended angle for each channel of neural activity. Due to errors made in the decoding of noisy neural data, as a user attempts to move the cursor to a goal, the angle between cursor and goal positions may change rapidly. We propose a dynamic Bayesian network that includes the on-screen goal position as part of its latent state, and thus allows the person’s intended angle of movement to be aggregated over a much longer history of neural activity. This multiscale model explicitly captures the relationship between instantaneous angles of motion and long-term goals, and incorporates semi-Markov dynamics for motion trajectories. We also introduce a multimodal likelihood model for recordings of neural populations which can be rapidly calibrated for clinical applications. In offline experiments with recorded neural data, we demonstrate significantly improved prediction of motion directions compared to the Kalman filter. We derive an efficient online inference algorithm, enabling a clinical trial participant with tetraplegia to control a computer cursor with neural activity in real time. The observed kinematics of cursor movement are objectively straighter and smoother than prior iBCI decoding models without loss of responsiveness.
Author Information
Daniel Milstein (Brown University)
Jason Pacheco (Brown University)
Leigh Hochberg (Brown, MGH, VA, Harvard)
John D Simeral (Brown University)
Dr. Simeral is a Assistant Professor of Engineering (Research) at Brown University, a Research Biomedical Engineer with the Department of Veterans Affairs Rehabilitation R&D Service, and leader of the focus area Restoring Communication and Mobility in the VA Center for Neurorestoration and Neurotechnology. His research is dedicated to integrating neuroscience and engineering disciplines to create unprecedented neural prosthetic technologies to enable communication and control of assistive devices by individuals with paralysis or locked-in syndrome resulting from spinal cord injury, ALS (Lou Gehrig's disease), stoke and other neurological disorders. He directs development of the system architecture, hardware and software for the BrainGate Neural Interface System (in clinical trial, IDE) that decodes intracortical brain signals into commands to control computer cursors, dexterous prosthetic robotic arms and hands, and other assistive technologies. In addition to research expertise in the neurophysiological basis of movement, Dr. Simeral has a decade of industry engineering experience including the design of massively parallel computer systems and high performance microelectronic VLSI microprocessors.
Beata Jarosiewicz (Stanford University)
Erik Sudderth (University of California, Irvine)
More from the Same Authors
-
2021 Poster: Scalable and Stable Surrogates for Flexible Classifiers with Fairness Constraints »
Henry C Bendekgey · Erik Sudderth -
2015 Poster: Scalable Adaptation of State Complexity for Nonparametric Hidden Markov Models »
Michael Hughes · William Stephenson · Erik Sudderth -
2013 Poster: Efficient Online Inference for Bayesian Nonparametric Relational Models »
Dae Il Kim · Prem Gopalan · David Blei · Erik Sudderth -
2013 Poster: Memoized Online Variational Inference for Dirichlet Process Mixture Models »
Michael Hughes · Erik Sudderth -
2012 Poster: Effective Split-Merge Monte Carlo Methods for Nonparametric Models of Sequential Data »
Michael Hughes · Emily Fox · Erik Sudderth -
2012 Poster: Truly Nonparametric Online Variational Inference for Hierarchical Dirichlet Processes »
Michael Bryant · Erik Sudderth -
2012 Poster: Minimization of Continuous Bethe Approximations: A Positive Variation »
Jason Pacheco · Erik Sudderth -
2012 Poster: From Deformations to Parts: Motion-based Segmentation of 3D Objects »
Soumya Ghosh · Erik Sudderth · Matthew Loper · Michael J Black -
2011 Poster: The Doubly Correlated Nonparametric Topic Model »
Dae Il Kim · Erik Sudderth -
2011 Poster: Spatial distance dependent Chinese Restaurant Process for image segmentation »
Soumya Ghosh · Andrei B Ungureanu · Erik Sudderth · David Blei -
2010 Poster: Global seismic monitoring as probabilistic inference »
Nimar Arora · Stuart J Russell · Paul Kidwell · Erik Sudderth -
2010 Spotlight: Layered image motion with explicit occlusions, temporal consistency, and depth ordering »
Deqing Sun · Erik Sudderth · Michael J Black -
2010 Poster: Layered image motion with explicit occlusions, temporal consistency, and depth ordering »
Deqing Sun · Erik Sudderth · Michael J Black -
2009 Session: Oral session 9: Bayesian Analysis »
Erik Sudderth -
2009 Poster: Sharing Features among Dynamical Systems with Beta Processes »
Emily Fox · Erik Sudderth · Michael Jordan · Alan S Willsky -
2009 Oral: Sharing Features among Dynamical Systems with Beta Processes »
Emily Fox · Erik Sudderth · Michael Jordan · Alan S Willsky -
2008 Oral: Shared Segmentation of Natural Scenes Using Dependent Pitman-Yor Processes »
Erik Sudderth · Michael Jordan -
2008 Poster: Nonparametric Bayesian Learning of Switching Linear Dynamical Systems »
Emily Fox · Erik Sudderth · Michael Jordan · Alan S Willsky -
2008 Poster: Shared Segmentation of Natural Scenes Using Dependent Pitman-Yor Processes »
Erik Sudderth · Michael Jordan -
2008 Spotlight: Nonparametric Bayesian Learning of Switching Linear Dynamical Systems »
Emily Fox · Erik Sudderth · Michael Jordan · Alan S Willsky -
2008 Session: Oral session 4: Combinatorial Approximation »
Erik Sudderth -
2007 Poster: Loop Series and Bethe Variational Bounds in Attractive Graphical Models »
Erik Sudderth · Martin J Wainwright · Alan S Willsky