Update model card with MetalRT benchmarks and usage

74e2dc7 verified 5 months ago

886 Bytes

license: mit
tags:
  - mlx
  - 4bit
  - whisper
  - stt
  - metalrt
  - apple-silicon

Whisper Small — MLX 4-bit Quantized

Custom MLX 4-bit quantization of OpenAI Whisper Small optimized for MetalRT GPU inference on Apple Silicon.

Usage

Used by RCLI with the MetalRT engine for speech-to-text:

rcli setup          # select MetalRT or Both engines

Note: Whisper Small is in GPU beta. Whisper Tiny is recommended for production use.

Model weights: MIT (OpenAI) MetalRT engine: Proprietary (RunAnywhere, Inc.)