How to use from
vLLM
Install from pip and serve model
# Install vLLM from pip:
pip install vllm
# Start the vLLM server:
vllm serve "mlx-community/UI-TARS-7B-DPO-6bit"
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:8000/v1/chat/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "mlx-community/UI-TARS-7B-DPO-6bit",
		"messages": [
			{
				"role": "user",
				"content": [
					{
						"type": "text",
						"text": "Describe this image in one sentence."
					},
					{
						"type": "image_url",
						"image_url": {
							"url": "https://cdn.britannica.com/61/93061-050-99147DCE/Statue-of-Liberty-Island-New-York-Bay.jpg"
						}
					}
				]
			}
		]
	}'
Use Docker
docker model run hf.co/mlx-community/UI-TARS-7B-DPO-6bit
Quick Links

mlx-community/UI-TARS-7B-DPO-6bit

This model was converted to MLX format from bytedance-research/UI-TARS-7B-DPO using mlx-vlm version 0.1.14. Refer to the original model card for more details on the model.

Use with mlx

pip install -U mlx-vlm
python -m mlx_vlm.generate --model mlx-community/UI-TARS-7B-DPO-6bit --max-tokens 100 --temp 0.0 --prompt "Describe this image." --image <path_to_image>
Downloads last month
21
Safetensors
Model size
8B params
Tensor type
U32
ยท
F16
ยท
MLX
Hardware compatibility
Log In to add your hardware

Quantized

Inference Providers NEW
This model isn't deployed by any Inference Provider. ๐Ÿ™‹ Ask for provider support

Collection including mlx-community/UI-TARS-7B-DPO-6bit