The Effects of Measurement Uncertainty and Error on Operational Safety Assessment (OSA) Metrics
2022-01-0985
03/29/2022
- Event
- Content
- As the deployment of automated vehicles (AVs) on public roadways expands, there is a growing need to establish metrics that can be used to evaluate vehicle operational safety. The set of Operational Safety Assessment (OSA) metrics previously proposed by the Institute of Automated Mobility (IAM) are a step towards achieving this goal. The safety envelope OSA metrics can be computed using kinematics derived from video data captured by infrastructure-based cameras and thus do not require vehicle-to-infrastructure (V2I) connectivity, though connectivity could enhance kinematic data accuracy. However, the calculation of some metrics includes certain vehicle-specific parameters that must be assumed or estimated if they are not communicated directly by the vehicle. Uncertainty and errors in kinematic measurements and assumed parameters can affect the accuracy and ultimately the utility of the safety envelope OSA metrics. This paper investigates how uncertainties and errors in measured and assumed variables affect safety envelope OSA metrics. Scenarios are implemented in the CARLA simulation environment to elucidate the effects of uncertainties and errors. Systematic sensitivity analyses reveal the most crucial variables in metrics calculations and that uncertainties and errors are especially important when vehicles are operating close to safety envelope thresholds. This motivates an assessment of how uncertainties and errors affect false positive and false negative rates for threshold violations. The outcomes of this research can help to understand the effects of measurement uncertainty on OSA metrics calculation and inform the selection of suitable sensors and hardware for the accurate and reliable assessment of vehicle operational safety.
- Citation
- Kidambi, N., Wishart, J., Elli, M., and Como, S., "The Effects of Measurement Uncertainty and Error on Operational Safety Assessment (OSA) Metrics," SAE Technical Paper 2022-01-0985, 2022, .