Feature Extraction
MLX
Safetensors
qwen3
embeddings
sentence-similarity
quantization
omlx
q8
8-bit precision
Instructions to use TiGa-RCE/Qwen3-Embedding-8B-MLX-Q8 with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- MLX
How to use TiGa-RCE/Qwen3-Embedding-8B-MLX-Q8 with MLX:
# Download the model from the Hub pip install huggingface_hub[hf_xet] hf download TiGa-RCE/Qwen3-Embedding-8B-MLX-Q8 --local-dir Qwen3-Embedding-8B-MLX-Q8
- Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- LM Studio
- Atomic Chat
Download tokenizer_config.json from TiGa-RCE/Qwen3-Embedding-8B-MLX-Q8: direct link, hf CLI and curl.
- Browser
- Download file 413 Bytes
-
https://huggingface.co/TiGa-RCE/Qwen3-Embedding-8B-MLX-Q8/resolve/e2bc8c95d0285bbb32c4725c895464711463db26/tokenizer_config.json
- Command line
-
hf download hf://TiGa-RCE/Qwen3-Embedding-8B-MLX-Q8@e2bc8c95d0285bbb32c4725c895464711463db26/tokenizer_config.json
-
curl -L -o tokenizer_config.json https://huggingface.co/TiGa-RCE/Qwen3-Embedding-8B-MLX-Q8/resolve/e2bc8c95d0285bbb32c4725c895464711463db26/tokenizer_config.json
413 Bytes
| { | |
| "add_prefix_space": false, | |
| "backend": "tokenizers", | |
| "bos_token": null, | |
| "clean_up_tokenization_spaces": false, | |
| "eos_token": "<|im_end|>", | |
| "errors": "replace", | |
| "is_local": true, | |
| "local_files_only": false, | |
| "model_max_length": 131072, | |
| "pad_token": "<|endoftext|>", | |
| "split_special_tokens": false, | |
| "tokenizer_class": "Qwen2Tokenizer", | |
| "tool_parser_type": "json_tools", | |
| "unk_token": null | |
| } | |