Program Highlights »
Fri Dec 9th 08:00 AM -- 06:30 PM @ Hilton Diag. Mar, Blrm. C
Intuitive Physics
Adam Lerer · Jiajun Wu · Josh Tenenbaum · Emmanuel Dupoux · Rob Fergus

Workshop Home Page

Despite recent progress, AI is still far away from achieving common sense reasoning. One area that is gathering a lot of interest is that of intuitive or naive physics. It concerns the ability that humans and, to a certain extent, infants and animals have to predict outcomes of physical interactions involving macroscopic objects. There is extensive experimental evidence that infants can predict the outcome of events based on physical concepts such as gravity, solidity, object permanence and conservation of shape and number, at an early stage of development, although there is also evidence that this capacity develops through time and experience. Recent work has attempted to build neural models that can make predictions about stability, collisions, forces and velocities from images or videos, or interactions with an environment. Such models could be both used to understand the cognitive and neural underpinning of naive physics in humans, but also to provide with AI applications more better inference and reasoning abilities.

This workshop will bring together researchers in machine learning, computer vision, robotics, computational neuroscience, and cognitive development to discuss artificial systems that capture or model intuitive physics by learning from footage of, or interactions with a real or simulated environment. There will be invited talks from world leaders in the fields, presentations and poster sessions based on contributed papers, and a panel discussion.

Topics of discussion will include:
- Learning models of Newtonian physics (deep networks, structured probabilistic generative models, physics engines)
- How to combine model-based and bottom-up approaches to intuitive physics
- Application of intuitive physics models to higher-level tasks such as navigation, video prediction, robotics, etc.
- How cognitive science and computational neuroscience literature may inform the design of artificial systems for physical prediction
- Methodology for comparing models of infant learning with clinical studies
- Development of new datasets or platforms for intuitive physics and visual commonsense

08:40 AM Opening Remarks (Talk)
Josh Tenenbaum
09:00 AM Naive Physics 101: A Tutorial (Talk)
Emmanuel Dupoux, Josh Tenenbaum
09:30 AM Poster Spotlights (Spotlight)
10:00 AM Ali Farhadi (Talk)
Ali Farhadi
10:30 AM Coffee Break / Posters 1 (Poster Session)
11:00 AM Peter Battaglia (Talk)
peter battaglia
11:30 AM Jitendra Malik and Pulkit Agrawal (Talk)
Jitendra Malik, Pulkit Agrawal
12:00 PM Lunch Break (Break)
02:00 PM Abhinav Gupta (Talk)
Abhinav Gupta
02:30 PM Bill Freeman (Talk)
Bill Freeman
03:00 PM Coffee Break / Posters 2 (Poster Session)
03:30 PM Imagination-Based Decision Making with Physical Models in Deep Neural Networks (Talk)
Jessica B Hamrick
03:50 PM Visual Stability Prediction and Its Application to Manipulation (Talk)
Wenbin Li
04:10 PM Deep Visual Foresight for Planning Robot Motion (Talk)
Chelsea Finn
04:30 PM Datasets, Methodology, and Challenges in Intuitive Physics (Talk)
Emmanuel Dupoux, Josh Tenenbaum
05:30 PM Panel Discussion