| CARVIEW |
Select Language
HTTP/2 200
server: GitHub.com
content-type: text/html; charset=utf-8
last-modified: Tue, 19 Sep 2023 20:39:31 GMT
access-control-allow-origin: *
strict-transport-security: max-age=31556952
etag: W/"650a0703-23a7"
expires: Sun, 28 Dec 2025 14:02:52 GMT
cache-control: max-age=600
content-encoding: gzip
x-proxy-cache: MISS
x-github-request-id: FEB2:3A7A40:7A8680:896430:69513632
accept-ranges: bytes
age: 0
date: Sun, 28 Dec 2025 13:52:52 GMT
via: 1.1 varnish
x-served-by: cache-bom-vanm7210066-BOM
x-cache: MISS
x-cache-hits: 0
x-timer: S1766929972.938041,VS0,VE206
vary: Accept-Encoding
x-fastly-request-id: de220ea8e7c4ffdf9db9d4f595d53af332e0ff41
content-length: 2804
SafeBench
A Benchmark for Evaluating Autonomous Vehicles in Safety-critical Scenarios
The goal of SafeBench is to systematically evaluate the safety and security of autonomous driving (AD) algorithms based on diverse testing scenarios and comprehensive evaluation metrics. Safebench is based on Carla, a high-fidelity and open-sourced AD Simulator. There are three main features that distinguish Safebench from other scenario-based benchmarks:
- Parallel Running. Safebench supports the parallel running of multiple scenarios in one map, which dramatically increases the efficiency of collecting training data and evaluation.
- Comprehensive Scenario. Safebench integrates lots of scenario-generation algorithms, including data-driven generation, rule-based design, and adversarial examples.
- Usage Coverage. Safebench supports three running modes, including training ego policy, training scenario policy, and evaluating ego in scenarios.
Overview Video
Safebench provides scenarios for both perception module and control module of AD system. This overview video illustrates the scenarios in Safebench for both modules.
News
- We are hosting a challenge in CVPR 2023 using Safebench platform. Please check our website for more details.
- The new version of Safebench is avaliable now.
- The paper introducing Safebench is published on NeurIPS2022.
Safebench Team
 |
 |
 |
 |
 |
||
 |
 |
 |
 |
 |
||