| CARVIEW |
Select Language
HTTP/2 200
server: GitHub.com
content-type: text/html; charset=utf-8
last-modified: Fri, 26 Dec 2025 23:18:15 GMT
access-control-allow-origin: *
strict-transport-security: max-age=31556952
etag: W/"694f17b7-8e53"
expires: Mon, 29 Dec 2025 15:47:26 GMT
cache-control: max-age=600
content-encoding: gzip
x-proxy-cache: MISS
x-github-request-id: BFFC:123DE:9039ED:A1CFE9:6952A035
accept-ranges: bytes
age: 0
date: Mon, 29 Dec 2025 15:37:26 GMT
via: 1.1 varnish
x-served-by: cache-bom-vanm7210072-BOM
x-cache: MISS
x-cache-hits: 0
x-timer: S1767022646.381427,VS0,VE206
vary: Accept-Encoding
x-fastly-request-id: d0798dcfb3edeb872a1672b07bf9a016fbfa3bed
content-length: 4432
Home | RealTime QA
Welcome to RealTime QA
Check the latest results Make a new submission
Check out the GitHub Check out the paper
Latest results
Multiple Choice Track
| Model | Submission Time (GMT) | Original | NOTA |
|---|---|---|---|
| GPT-4o + Google Custom Search | 2025-12-27 03:00:00 | 90.0 | 85.0 |
| Claude-3.5 Haiku + Google Custom Search | 2025-12-27 03:00:00 | 90.0 | 85.0 |
| GPT-4.1 + Google Custom Search | 2025-12-27 03:00:00 | 90.0 | 80.0 |
| Claude-3.7 Sonnet + Google Custom Search | 2025-12-27 03:00:00 | 85.0 | 90.0 |
| Claude-3.5 Haiku | 2025-12-27 03:00:00 | 55.0 | 40.0 |
| Claude-3.7 Sonnet | 2025-12-27 03:00:00 | 45.0 | 40.0 |
| GPT-4o | 2025-12-27 03:00:00 | 35.0 | 35.0 |
| GPT-4.1 | 2025-12-27 03:00:00 | 35.0 | 20.0 |
| Gemini 2.0 Flash + Google Custom Search | 2025-12-27 03:00:00 | 0.0 | 0.0 |
| Gemini 2.0 Flash | 2025-12-27 03:00:00 | 0.0 | 0.0 |
Generation Track
| Model | Submission Time (GMT) | EM | F1 |
|---|---|---|---|
| GPT-4o + Google Custom Search | 2025-12-27 03:00:00 | 15.0 | 36.6 |
| Gemini 2.0 Flash + Google Custom Search | 2025-12-27 03:00:00 | 15.0 | 34.6 |
| Gemini 2.0 Flash | 2025-12-27 03:00:00 | 15.0 | 15.0 |
| GPT-4.1 + Google Custom Search | 2025-12-27 03:00:00 | 10.0 | 29.8 |
| GPT-4o | 2025-12-27 03:00:00 | 10.0 | 14.9 |
| GPT-4.1 | 2025-12-27 03:00:00 | 10.0 | 14.7 |
| Claude-3.5 Haiku + Google Custom Search | 2025-12-27 03:00:00 | 5.0 | 17.4 |
| Claude-3.7 Sonnet + Google Custom Search | 2025-12-27 03:00:00 | 0.0 | 24.8 |
| Claude-3.5 Haiku | 2025-12-27 03:00:00 | 0.0 | 7.2 |
| Claude-3.7 Sonnet | 2025-12-27 03:00:00 | 0.0 | 5.0 |
Make a new submission
Download the latest set of RealTime QA (link)
Submit your model predictions. (submission form)
Submission examples (
.jsonl file) are available here