Timezone: »

 
Poster
Scalable End-to-End Autonomous Vehicle Testing via Rare-event Simulation
Matthew O'Kelly · Aman Sinha · Hongseok Namkoong · Russ Tedrake · John Duchi

Tue Dec 04 02:00 PM -- 04:00 PM (PST) @ Room 210 #18
in Tue Poster Session B »

While recent developments in autonomous vehicle (AV) technology highlight substantial progress, we lack tools for rigorous and scalable testing. Real-world testing, the de facto evaluation environment, places the public in danger, and, due to the rare nature of accidents, will require billions of miles in order to statistically validate performance claims. We implement a simulation framework that can test an entire modern autonomous driving system, including, in particular, systems that employ deep-learning perception and control algorithms. Using adaptive importance-sampling methods to accelerate rare-event probability evaluation, we estimate the probability of an accident under a base distribution governing standard traffic behavior. We demonstrate our framework on a highway scenario, accelerating system evaluation by 2-20 times over naive Monte Carlo sampling methods and 10-300P times (where P is the number of processors) over real-world testing.

Keywords: Software Toolkits · Data, Competitions, Implementations, and Software · Benchmarks
[ Paper] 

Author Information

Matthew O'Kelly (University of Pennsylvania)
Aman Sinha (Stanford University)
Hongseok Namkoong (Stanford University)
Russ Tedrake (MIT)
John Duchi (Stanford)

More from the Same Authors