V100-PCIE-32GB · 32 GB
faster-whisper-tiny
Open a report for complete measurements.
- Task
- Speech recognition · Audio → Text
- Workload
- Audio → Text · asr_prompts · Test duration 5 s
- Batch size
- Batch 4
- Format · Engine
- fp16 · faster-whisper · PyTorch 2.12.1+cu126
- Unit
- audio-sec/sec
- Mean throughput
- 132audio-sec/sec
- Observed GPU occupancy
- 0.5 GiB
- P95 latency
- Not recorded
- Reports combined
- 10
Launch this model
This engine does not yet have an executable serving recipe.
Individual tests
Audio → Text · Speech recognition · fp16 · faster-whisper · asr · audio-sec/sec
Sortable table
| Test date | Throughput | Concurrency / batch | P95 (s) | TTFT (ms) | Observed occupancy (GiB) | GPU power (W) | Decode (tok/s) | Uncached prefill (tok/s) | Parameters | View report |
|---|---|---|---|---|---|---|---|---|---|---|
| 10/8/2026, 3:55:44 AM | 132.8 audio-sec/sec | 4 | — | — | 0.52 | 49.8 | — | Uncached prefill unavailableView report | Parameters ↗ | dc99d88a ↗ |
| 10/8/2026, 4:00:10 AM | 123.89 audio-sec/sec | 4 | — | — | 0.53 | 50.5 | — | Uncached prefill unavailableView report | Parameters ↗ | ba1fe3d1 ↗ |
| 10/8/2026, 4:04:55 AM | 133.95 audio-sec/sec | 4 | — | — | 0.52 | 51.2 | — | Uncached prefill unavailableView report | Parameters ↗ | ea78d535 ↗ |
| 10/8/2026, 4:08:57 AM | 131.32 audio-sec/sec | 4 | — | — | 0.52 | 52.3 | — | Uncached prefill unavailableView report | Parameters ↗ | fb88853c ↗ |
| 10/8/2026, 4:13:38 AM | 128.27 audio-sec/sec | 4 | — | — | 0.53 | 51.1 | — | Uncached prefill unavailableView report | Parameters ↗ | b8ec2990 ↗ |
| 10/8/2026, 4:18:18 AM | 135.25 audio-sec/sec | 4 | — | — | 0.53 | 50.8 | — | Uncached prefill unavailableView report | Parameters ↗ | 402df0fc ↗ |
| 10/8/2026, 4:22:56 AM | 132.06 audio-sec/sec | 4 | — | — | 0.53 | 55.3 | — | Uncached prefill unavailableView report | Parameters ↗ | 45f2e454 ↗ |
| 10/8/2026, 4:27:05 AM | 132.12 audio-sec/sec | 4 | — | — | 0.52 | 51.3 | — | Uncached prefill unavailableView report | Parameters ↗ | 7c55639b ↗ |
| 10/8/2026, 4:32:10 AM | 133.39 audio-sec/sec | 4 | — | — | 0.52 | 49.9 | — | Uncached prefill unavailableView report | Parameters ↗ | 3a086cd9 ↗ |
| 10/8/2026, 4:37:16 AM | 138.53 audio-sec/sec | 4 | — | — | 0.52 | 50.1 | — | Uncached prefill unavailableView report | Parameters ↗ | e4ef00c1 ↗ |
Recorded test parameters
Configuration 1 · Parameters
- model
- Systran/faster-whisper-tiny
- engine
- faster-whisper
- quant
- fp16
- method
- audio-native-v1
- task
- asr
- dataset
- asr_prompts
- context
- asr
- input_tokens
- 0
- output_tokens
- 0
- duration
- 5
- concurrency
- 4
- unit
- audio-sec/sec
- software
- { "torch": "2.12.1+cu126", "transformers": "4.57.6", "ctranslate2": "4.8.2", "faster-whisper": "1.2.1", "OMP_NUM_THREADS": "6", "MKL_NUM_THREADS": "6", "OPENBLAS_NUM_THREADS": "1", "NUMEXPR_NUM_THREADS": "4" }
- engine_provenance
- —
- kernel_settings
- —
- precision
- —
- resolution
- —
- performance_task
- —
- performance_scope
- —
- batch_size
- —
- dimensions
- —
- weight_quantization
- —
- max_sequence_length
- —
- model_scope
- —
- performance_dataset
- —
- workload_mode
- —
- graph_mode
- —
- model_revision
- —
- client_version
- python-native-bench-1.1.3