Update performance numbers (100-clip RTX 6000 benchmark)
Browse files
README.md
CHANGED
|
@@ -28,7 +28,7 @@ tags:
|
|
| 28 |
[](https://z-lab.ai/projects/flashdrive/)
|
| 29 |
[](https://huggingface.co/collections/z-lab/flashdrive)
|
| 30 |
|
| 31 |
-
[FlashDrive](https://github.com/z-lab/flashdrive) accelerates [Alpamayo 1 (R1)](https://huggingface.co/nvidia/Alpamayo-R1-10B) — one of NVIDIA's 10B-parameter vision-language-action models for autonomous driving — by **4.
|
| 32 |
|
| 33 |
This repository mirrors the weights of [nvidia/Alpamayo-R1-10B](https://huggingface.co/nvidia/Alpamayo-R1-10B) and is the **base checkpoint** of the FlashDrive stack. Loading it pulls the derived companions automatically:
|
| 34 |
|
|
@@ -57,7 +57,7 @@ python scripts/infer.py --model-path z-lab/Alpamayo-R1-10B
|
|
| 57 |
|
| 58 |
## Performance
|
| 59 |
|
| 60 |
-
On a single RTX PRO 6000, averaged over 100 PhysicalAI-AV clips, FlashDrive runs Alpamayo 1 (R1) at **4.
|
| 61 |
|
| 62 |
## License
|
| 63 |
|
|
|
|
| 28 |
[](https://z-lab.ai/projects/flashdrive/)
|
| 29 |
[](https://huggingface.co/collections/z-lab/flashdrive)
|
| 30 |
|
| 31 |
+
[FlashDrive](https://github.com/z-lab/flashdrive) accelerates [Alpamayo 1 (R1)](https://huggingface.co/nvidia/Alpamayo-R1-10B) — one of NVIDIA's 10B-parameter vision-language-action models for autonomous driving — by **4.5× with no loss in accuracy**, through streaming inference, [DFlash](https://github.com/z-lab/dflash) speculative reasoning, [ParoQuant](https://github.com/z-lab/paroquant) W4A8 quantization, adaptive action caching, and `torch.compile`.
|
| 32 |
|
| 33 |
This repository mirrors the weights of [nvidia/Alpamayo-R1-10B](https://huggingface.co/nvidia/Alpamayo-R1-10B) and is the **base checkpoint** of the FlashDrive stack. Loading it pulls the derived companions automatically:
|
| 34 |
|
|
|
|
| 57 |
|
| 58 |
## Performance
|
| 59 |
|
| 60 |
+
On a single RTX PRO 6000, averaged over 100 PhysicalAI-AV clips, FlashDrive runs Alpamayo 1 (R1) at **4.5× lower latency** (704 → 155 ms per window) while minADE improves from 1.869 to 1.662. See the [repository](https://github.com/z-lab/flashdrive#performance) for the full benchmark.
|
| 61 |
|
| 62 |
## License
|
| 63 |
|