Timezone: »
Demonstration
One-on-one fitness training with an AI avatar
Roland Memisevic · Guillaume Berger · Tippi Puar · David Greenberg
In this demo, we will showcase “Millie” our live digital fitness trainer. She is an on-screen avatar that interacts in real-time to observe and grade the user’s movements for speed, accuracy and form. Millie is powered by an audio-visual neural network that processes the video and voice input using 3D convolutions to power the avatar’s responses. The neural network is trained on several million sample videos showing crowd-workers performing actions that they recorded using consumer grade RGB cameras and microphones. This allows the digital fitness trainer to run on a wide range of hardware devices, such as iPhone, iPad and in the cloud.
Author Information
Roland Memisevic (Twenty Billion Neurons Inc.)
Guillaume Berger (Twenty Billion Neurons)
Tippi Puar (Twenty Billion Neurons Inc.)
David Greenberg (Twenty Billion Neurons)
More from the Same Authors
-
2016 Poster: Architectural Complexity Measures of Recurrent Neural Networks »
Saizheng Zhang · Yuhuai Wu · Tong Che · Zhouhan Lin · Roland Memisevic · Russ Salakhutdinov · Yoshua Bengio -
2014 Workshop: Deep Learning and Representation Learning »
Andrew Y Ng · Yoshua Bengio · Adam Coates · Roland Memisevic · Sharanyan Chetlur · Geoffrey E Hinton · Shamim Nemati · Bryan Catanzaro · Surya Ganguli · Herbert Jaeger · Phil Blunsom · Leon Bottou · Volodymyr Mnih · Chen-Yu Lee · Rich M Schwartz -
2014 Poster: Modeling Deep Temporal Dependencies with Recurrent "Grammar Cells" »
Vincent Michalski · Roland Memisevic · Kishore Konda -
2010 Poster: Gated Softmax Classification »
Roland Memisevic · Christopher Zach · Geoffrey E Hinton · Marc Pollefeys