MLX Model Test Report

Generated 2026-02-25 21:45 · AFM MLX Backend · v0.9.5

mlx-model-test.sh --prompts Scripts/test-vlm-media.txt

Test Runs
7
Passed
7
Failed
0
Best tok/s
84.8
Fastest
mlx-community/Qwen3.5-35B-A3B-4bit @ image-system-prompt

Performance Ranking (by tokens/sec)

Click a row to jump to its full response below.

# Model / Config Status Temp Load (s) Tokens Gen (s) Tokens/sec Prompt
1 mlx-community/Qwen3.5-35B-A3B-4bit @ image-system-prompt image-system-prompt
--vlm		 OK 0.7 1.0 1645 19.41
84.8
 Describe the animal in this image. What breed might it be?
2 mlx-community/Qwen3.5-35B-A3B-4bit @ image-stop image-stop
--vlm		 OK 0.7 1.0 931 11.27
82.6
 Describe this image in detail
3 mlx-community/Qwen3.5-35B-A3B-4bit @ image-describe image-describe
--vlm		 OK 0.7 1.0 986 12.14
81.2
 Describe this image in detail.
4 mlx-community/Qwen3.5-35B-A3B-4bit @ image-guided-json image-guided-json
--vlm		 OK 0.7 1.0 553 7.17
77.1
 Analyze this image and return a JSON object with the followi...
5 mlx-community/Qwen3.5-35B-A3B-4bit @ image-greedy image-greedy
--vlm		 OK 0.0 1.0 467 6.16
75.8
 What is in this image? Reply in one sentence.
6 mlx-community/Qwen3.5-35B-A3B-4bit @ image-question image-question
--vlm		 OK 0.7 1.0 351 4.89
71.7
 What animal is in this image? Answer in one word.
7 mlx-community/Qwen3.5-35B-A3B-4bit @ video-describe video-describe
--vlm		 OK 0.7 1.0 651 14.21
45.8
 Describe what happens in this video.

Full Responses

▶ mlx-community/Qwen3.5-35B-A3B-4bit @ image-system-prompt 1645 tokens · 84.8 tok/s

▶ mlx-community/Qwen3.5-35B-A3B-4bit @ image-stop 931 tokens · 82.6 tok/s

▶ mlx-community/Qwen3.5-35B-A3B-4bit @ image-describe 986 tokens · 81.2 tok/s

▶ mlx-community/Qwen3.5-35B-A3B-4bit @ image-guided-json 553 tokens · 77.1 tok/s

▶ mlx-community/Qwen3.5-35B-A3B-4bit @ image-greedy 467 tokens · 75.8 tok/s

▶ mlx-community/Qwen3.5-35B-A3B-4bit @ image-question 351 tokens · 71.7 tok/s

▶ mlx-community/Qwen3.5-35B-A3B-4bit @ video-describe 651 tokens · 45.8 tok/s