| CARVIEW |
Select Language
HTTP/2 200
server: GitHub.com
content-type: text/html; charset=utf-8
last-modified: Tue, 19 Sep 2023 20:39:31 GMT
access-control-allow-origin: *
strict-transport-security: max-age=31556952
etag: W/"650a0703-23a7"
expires: Sun, 28 Dec 2025 16:10:20 GMT
cache-control: max-age=600
content-encoding: gzip
x-proxy-cache: MISS
x-github-request-id: 7E86:2118F1:7B9B3A:8AB071:69515413
accept-ranges: bytes
age: 0
date: Sun, 28 Dec 2025 16:00:20 GMT
via: 1.1 varnish
x-served-by: cache-bom-vanm7210077-BOM
x-cache: MISS
x-cache-hits: 0
x-timer: S1766937620.202337,VS0,VE210
vary: Accept-Encoding
x-fastly-request-id: a7c9f5aefc498181dab4322ecc1ed668def0dca1
content-length: 2804
SafeBench
A Benchmark for Evaluating Autonomous Vehicles in Safety-critical Scenarios
The goal of SafeBench is to systematically evaluate the safety and security of autonomous driving (AD) algorithms based on diverse testing scenarios and comprehensive evaluation metrics. Safebench is based on Carla, a high-fidelity and open-sourced AD Simulator. There are three main features that distinguish Safebench from other scenario-based benchmarks:
- Parallel Running. Safebench supports the parallel running of multiple scenarios in one map, which dramatically increases the efficiency of collecting training data and evaluation.
- Comprehensive Scenario. Safebench integrates lots of scenario-generation algorithms, including data-driven generation, rule-based design, and adversarial examples.
- Usage Coverage. Safebench supports three running modes, including training ego policy, training scenario policy, and evaluating ego in scenarios.
Overview Video
Safebench provides scenarios for both perception module and control module of AD system. This overview video illustrates the scenarios in Safebench for both modules.
News
- We are hosting a challenge in CVPR 2023 using Safebench platform. Please check our website for more details.
- The new version of Safebench is avaliable now.
- The paper introducing Safebench is published on NeurIPS2022.
Safebench Team
 |
 |
 |
 |
 |
||
 |
 |
 |
 |
 |
||