Due to the ongoing coronavirus pandemic, the Mcity Test Facility and Office Building will be closed until further notice. Although our facilities will be closed, the Mcity staff will still be working from home during normal business hours. Please feel free to contact us with any questions or concerns you may have during this time.

Development of Evaluation Approaches and the Certificate System for AVs Based on Accelerated Evaluation

Status: Complete

Lead Researcher(s)

David LeBlanc
Associate Research Scientist, Engineering Systems, University of Michigan Transportation Research Institute

Henry Lam
Adjunct Associate Professor of Industrial and Operations Engineering, College of Engineering

Ding Zhao

Project Team

Project Abstract

This project examined approaches to evaluate the safety of automated vehicles (AVs) that reduce the test duration from a few months to a few days without sacrificing accuracy, and identified possible failure modes on perception errors and mis-operations. Tests were developed in two layers: scenarios and variations. Test scenarios were extracted from naturalistic driving data, crash data, and expert knowledge. For each scenario, test variations were developed based on naturalistic driving data collected in the Ann Arbor Connected project (Pillar 1). Statistical tools were developed, based on the importance sampling approach, to measure safety impacts efficiently by reducing the safe and boring events and emphasized the safety-critical conditions.

Project Outcome

(1) Test scenarios and variations to evaluate the safety of AVs, and (2) estimates of safety benefit/risk to society after AVs are released and deployed in Ann Arbor.


BUDGET YEAR: 2016-05-01
IMPACT: EFFICIENCY
RESEARCH CATEGORY: SIMULATION & TESTING