Demo: Eleuto : A non invasive computer interface for paralyzed users
in
Workshop: Foundation Models for the Brain and Body Workshop
Abstract
Eleuto is a device that has a smart glasses that can do real-time eye tracking, it is designed for paralyzed users to communicate using interaction with a computer, on the computer is state of the art Text-to-speech and LLMs that give a voice to a the paralyzed user. The care-taker takes a survey regarding the paralyzed patients daily routine, this gives the LLM sufficient context to act as a proxy on behalf of the paralyzed user. Now, when the caretaker asks a question, the speech to text model transcribes it and the LLM generates 4 options with an option to regenerate 4 new options, then the paralyzed user looks at the option of choice and the TTS speaks it out in the voice of the paralyzed user (done via voice cloning) We have demos live on ; https://eleuto.vercel.app/