Workshop
Learning by Instruction
Shashank Srivastava · Igor Labutov · Bishan Yang · Amos Azaria · Tom Mitchell
Today machine learning is largely about pattern discovery and function approximation. But as computing devices that interact with us in natural language become ubiquitous (e.g., Siri, Alexa, Google Now), and as computer perceptual abilities become more accurate, they open an exciting possibility of enabling end-users to teach machines similar to the way in which humans teach one another. Natural language conversation, gesturing, demonstrating, teleoperating and other modes of communication offer a new paradigm for machine learning through instruction from humans. This builds on several existing machine learning paradigms (e.g., active learning, supervised learning, reinforcement learning), but also brings a new set of advantages and research challenges that lie at the intersection of several fields including machine learning, natural language understanding, computer perception, and HCI.
The aim of this workshop is to engage researchers from these diverse fields to explore fundamental research questions in this new area, such as:
How do people interact with machines when teaching them new learning tasks and knowledge?
What novel machine learning models and algorithms are needed to learn from human instruction?
What are the practical considerations towards building practical systems that can learn from instruction?
Schedule
|
Sat 5:30 a.m. - 5:35 a.m.
|
Introduction
(
Welcome
)
>
|
🔗 |
|
Sat 5:35 a.m. - 6:00 a.m.
|
Teaching Machines like we Teach People
(
Talk from Organizers
)
>
|
🔗 |
|
Sat 6:00 a.m. - 6:30 a.m.
|
Mapping Navigation Instructions to Continuous Control
(
Invited Talk
)
>
|
Yoav Artzi 🔗 |
|
Sat 6:30 a.m. - 7:00 a.m.
|
An Cognitive Architecture Approach to Interactive Task Learning
(
Invited Talk
)
>
|
John Laird 🔗 |
|
Sat 7:00 a.m. - 7:15 a.m.
|
Compositional Imitation Learning: Explaining and executing one task at a time
(
Contributed Talk
)
>
|
Thomas Kipf 🔗 |
|
Sat 7:15 a.m. - 7:30 a.m.
|
Learning to Learn from Imperfect Demonstrations
(
Contributed Talk
)
>
|
Ge Yang · Chelsea Finn 🔗 |
|
Sat 8:00 a.m. - 8:30 a.m.
|
Natural Language Supervision
(
Invited Talk
)
>
|
Percy Liang 🔗 |
|
Sat 8:30 a.m. - 9:00 a.m.
|
Control Algorithms for Imitation Learning from Observation
(
Invited Talk
)
>
|
Peter Stone 🔗 |
|
Sat 9:00 a.m. - 9:15 a.m.
|
From Language to Goals: Inverse Reinforcement Learning for Vision-Based Instruction Following
(
Contributed talk
)
>
|
Justin Fu 🔗 |
|
Sat 9:15 a.m. - 9:30 a.m.
|
Teaching Multiple Tasks to an RL Agent using LTL
(
Contributed Talk
)
>
|
Rodrigo Toro Icarte · Sheila McIlraith 🔗 |
|
Sat 10:30 a.m. - 11:00 a.m.
|
Meta-Learning to Follow Instructions, Examples, and Demonstrations
(
Invited Talk
)
>
|
Sergey Levine 🔗 |
|
Sat 11:00 a.m. - 11:30 a.m.
|
Learning to Understand Natural Language Instructions through Human-Robot Dialog
(
Invited Talk
)
>
|
Raymond Mooney 🔗 |
|
Sat 11:30 a.m. - 11:45 a.m.
|
The Implicit Preference Information in an Initial State
(
Contributed Talk
)
>
|
Rohin Shah 🔗 |
|
Sat 11:45 a.m. - 12:00 p.m.
|
Modelling User's Theory of AI's Mind in Interactive Intelligent Systems
(
Contributed Talk
)
>
|
Tomi Peltola 🔗 |
|
Sat 12:30 p.m. - 1:15 p.m.
|
Poster Session
(
Poster Session
)
>
|
12 presentersCarl Trimbach · Mennatullah Siam · Rodrigo Toro Icarte · Zhongtian Dai · Sheila McIlraith · Matthew Rahtz · Robert Sheline · Christopher MacLellan · Carolin Lawrence · Stefan Riezler · Dylan Hadfield-Menell · Fang-I Hsiao |
|
Sat 1:15 p.m. - 1:30 p.m.
|
Assisted Inverse Reinforcement Learning
(
Contributed Talk
)
>
|
Adish Singla · Rati Devidze 🔗 |
|
Sat 1:30 p.m. - 2:00 p.m.
|
Teaching through Dialogue and Games
(
Invited Talk
)
>
|
Jason E Weston 🔗 |
|
Sat 2:00 p.m. - 2:45 p.m.
|
Panel Discussion
(
Discussion Panel
)
>
|
🔗 |