MLX Model Test Report

Generated 2026-03-06 10:02 · AFM MLX Backend · v0.9.6

mlx-model-test.sh --model mlx-community/Qwen3.5-35B-A3B-4bit --prompts Scripts/test-llm-comprehensive.txt --smart claude

Test Runs
95
Passed
95
Failed
0
Best tok/s
148.6
Fastest
mlx-community/Qwen3.5-35B-A3B-4bit @ stop-long-phrase

Performance Ranking (by tokens/sec)

Click a row to jump to its full response below.

# Model / Config Status Temp Load (s) Tokens Gen (s) Tokens/sec Prompt
1 mlx-community/Qwen3.5-35B-A3B-4bit @ stop-long-phrase stop-long-phrase OK 0.0 1.0 1143 7.69
148.6
Write a 3-paragraph essay about renewable energy. Start the ...
2 mlx-community/Qwen3.5-35B-A3B-4bit @ tool-call-multi tool-call-multi OK 0.0 1.0 1169 9.47
123.4
What is the weather in London and what time is it in Tokyo?
3 mlx-community/Qwen3.5-35B-A3B-4bit @ tool-call-auto tool-call-auto OK 0.0 1.0 502 4.13
121.6
What is the weather in Tokyo?
4 mlx-community/Qwen3.5-35B-A3B-4bit @ tool-call-complex tool-call-complex OK 0.0 1.0 458 3.77
121.6
Search recursively for all Swift files under Sources/ with a...
5 mlx-community/Qwen3.5-35B-A3B-4bit @ max-completion-tokens max-completion-tokens OK 0.0 1.0 2300 19.01
121.0
Explain the causes and consequences of the French Revolution...
6 mlx-community/Qwen3.5-35B-A3B-4bit @ tool-call-xml tool-call-xml
--tool-call-parser xmlFunction
OK 0.0 1.0 4096 33.86
121.0
What is the weather in Paris in celsius?
7 mlx-community/Qwen3.5-35B-A3B-4bit @ developer-role developer-role OK 0.0 1.0 437 3.62
120.9
Write a Python function that reverses a string.
8 mlx-community/Qwen3.5-35B-A3B-4bit @ developer-role developer-role OK 0.0 1.0 4096 34.27
119.5
developer: You are a helpful coding assistant. Only respond ...
9 mlx-community/Qwen3.5-35B-A3B-4bit @ special-chars special-chars OK 0.0 1.0 4028 33.83
119.0
Repeat these characters exactly: <tag> "quotes" 'apostrophes...
10 mlx-community/Qwen3.5-35B-A3B-4bit @ stop-four-max stop-four-max OK 0.0 1.0 4096 34.49
118.8
List 10 facts about numbers, alternating between digit forma...
11 mlx-community/Qwen3.5-35B-A3B-4bit @ response-format-schema response-format-schema OK 0.0 1.0 1478 12.48
118.5
Generate a fictional person profile.
12 mlx-community/Qwen3.5-35B-A3B-4bit @ response-format-json response-format-json OK 0.0 1.0 1303 11.03
118.1
Return a JSON object with keys "language", "year_created", a...
13 mlx-community/Qwen3.5-35B-A3B-4bit @ stop-non-streaming stop-non-streaming
--no-streaming
OK 0.0 1.0 4096 34.7
118.0
List 10 planets or celestial objects, numbered 1 through 10,...
14 mlx-community/Qwen3.5-35B-A3B-4bit @ streaming-seeded streaming-seeded
--seed 123
OK 0.7 1.0 2469 20.93
118.0
Write a 4-line poem about the ocean.
15 mlx-community/Qwen3.5-35B-A3B-4bit @ stop-json-object-key stop-json-object-key OK 0.0 1.0 4096 34.79
117.7
Generate a JSON object with keys "name", "age", and "city" f...
16 mlx-community/Qwen3.5-35B-A3B-4bit @ seed-42-run2 seed-42-run2
--seed 42
OK 0.7 1.0 4096 34.81
117.7
Write a limerick about a cat.
17 mlx-community/Qwen3.5-35B-A3B-4bit @ math math OK 0.0 1.0 1830 15.58
117.4
A store sells notebooks for $3.50 each. If you buy 5 or more...
18 mlx-community/Qwen3.5-35B-A3B-4bit @ multilingual multilingual OK 0.3 1.0 1010 8.6
117.4
Translate "Hello, how are you?" into French, Spanish, Japane...
19 mlx-community/Qwen3.5-35B-A3B-4bit @ long-form long-form OK 0.7 1.0 3743 31.91
117.3
Write a detailed technical blog post explaining how Mixture-...
20 mlx-community/Qwen3.5-35B-A3B-4bit @ stop-immediate stop-immediate OK 0.0 1.0 767 6.54
117.3
Explain what gravity is.
21 mlx-community/Qwen3.5-35B-A3B-4bit @ non-streaming-seeded non-streaming-seeded
--no-streaming --seed 123
OK 0.7 1.0 2469 21.06
117.2
Write a 4-line poem about the ocean.
22 mlx-community/Qwen3.5-35B-A3B-4bit @ prefill-small-256 prefill-small-256
--prefill-step-size 256
OK 0.0 1.0 3652 31.16
117.2
Given this architecture, what are the top 3 performance bott...
23 mlx-community/Qwen3.5-35B-A3B-4bit @ no-penalty no-penalty
--presence-penalty 0.0
OK 0.8 1.0 4096 34.99
117.1
Write a long essay about the history of bread making across ...
24 mlx-community/Qwen3.5-35B-A3B-4bit @ max-completion-tokens max-completion-tokens OK 0.0 1.0 1174 10.04
116.9
max_completion_tokens: 100
25 mlx-community/Qwen3.5-35B-A3B-4bit @ seed-42-run1 seed-42-run1
--seed 42
OK 0.7 1.0 4096 35.05
116.9
Write a limerick about a cat.
26 mlx-community/Qwen3.5-35B-A3B-4bit @ prefill-large-4096 prefill-large-4096
--prefill-step-size 4096
OK 0.0 1.0 3652 31.28
116.8
Given this architecture, what are the top 3 performance bott...
27 mlx-community/Qwen3.5-35B-A3B-4bit @ scientist scientist OK 0.3 2.0 2040 17.5
116.5
Tell me about quantum computing.
28 mlx-community/Qwen3.5-35B-A3B-4bit @ prefill-default prefill-default OK 0.0 1.0 3652 31.34
116.5
Given this architecture, what are the top 3 performance bott...
29 mlx-community/Qwen3.5-35B-A3B-4bit @ long-prompt long-prompt OK 0.0 1.0 831 7.13
116.5
Repeat after me exactly: The quick brown fox jumps over the ...
30 mlx-community/Qwen3.5-35B-A3B-4bit @ long-output long-output OK 0.7 1.0 1992 17.17
116.0
Write a detailed recipe for chocolate chip cookies with ingr...
31 mlx-community/Qwen3.5-35B-A3B-4bit @ guided-json-simple guided-json-simple
--guided-json '{"type":"object","properties":{"name":{"type":"string"},"age":{"type":"integer"}},"required":["name","age"]}'
OK 0.0 1.0 1373 11.85
115.9
Generate a person record.
32 mlx-community/Qwen3.5-35B-A3B-4bit @ no-streaming no-streaming
--no-streaming
OK 0.7 1.0 1747 15.14
115.4
Write a short poem about the moon.
33 mlx-community/Qwen3.5-35B-A3B-4bit @ stop-guided-json-brace stop-guided-json-brace
--guided-json '{"type":"object","properties":{"color":{"type":"string"},"hex":{"type":"string"}},"required":["color","hex"]}'
OK 0.0 1.0 1063 9.22
115.3
Describe the color blue with its hex code.
34 mlx-community/Qwen3.5-35B-A3B-4bit @ eli5 eli5 OK 0.7 1.0 1260 10.99
114.6
Tell me about quantum computing.
35 mlx-community/Qwen3.5-35B-A3B-4bit @ think-normal think-normal OK 0.0 1.0 833 7.28
114.5
Solve step by step: If a train travels at 60 mph for 2.5 hou...
36 mlx-community/Qwen3.5-35B-A3B-4bit @ think-raw think-raw
--raw
OK 0.0 1.0 833 7.28
114.5
Solve step by step: If a train travels at 60 mph for 2.5 hou...
37 mlx-community/Qwen3.5-35B-A3B-4bit @ high-temp high-temp OK 1.5 1.0 1428 12.52
114.0
Explain why the sky is blue in exactly 3 bullet points.
38 mlx-community/Qwen3.5-35B-A3B-4bit @ raw-mode raw-mode
--raw
OK 0.7 1.0 1210 10.61
114.0
Think step by step: what is 17 * 23?
39 mlx-community/Qwen3.5-35B-A3B-4bit @ small-kv small-kv
--max-kv-size 2048
OK 0.7 1.0 1127 9.88
114.0
Summarize the key ideas of machine learning in a few paragra...
40 mlx-community/Qwen3.5-35B-A3B-4bit @ guided-json-nested guided-json-nested
--guided-json '{"type":"object","properties":{"city":{"type":"string"},"population":{"type":"integer"},"landmarks":{"type":"array","items":{"type":"string"}}},"required":["city","population","landmarks"]}'
OK 0.0 1.0 937 8.26
113.4
Describe Tokyo as a structured record with at least 3 landma...
41 mlx-community/Qwen3.5-35B-A3B-4bit @ kv-quantized kv-quantized
--kv-bits 4
OK 0.7 1.0 1105 9.74
113.4
Summarize the key ideas of machine learning in a few paragra...
42 mlx-community/Qwen3.5-35B-A3B-4bit @ pirate pirate OK 0.7 1.0 1369 12.08
113.4
Tell me about quantum computing.
43 mlx-community/Qwen3.5-35B-A3B-4bit @ stop-double-newline stop-double-newline OK 0.0 1.0 742 6.55
113.3
Write a short paragraph about the ocean. Then write a second...
44 mlx-community/Qwen3.5-35B-A3B-4bit @ stop-period stop-period OK 0.0 1.0 692 6.13
113.0
Tell me about the sun in three sentences.
45 mlx-community/Qwen3.5-35B-A3B-4bit @ stop-system-numbered stop-system-numbered OK 0.0 1.0 874 7.74
112.9
What are the main benefits of exercise?
46 mlx-community/Qwen3.5-35B-A3B-4bit @ tool-call-none tool-call-none OK 0.0 1.0 475 4.22
112.5
What is the current temperature in Berlin?
47 mlx-community/Qwen3.5-35B-A3B-4bit @ top-k top-k
--top-k 30
OK 0.8 1.0 1120 10.03
111.6
Explain why the sky is blue in exactly 3 bullet points.
48 mlx-community/Qwen3.5-35B-A3B-4bit @ stop-guided-json-comma stop-guided-json-comma
--guided-json '{"type":"object","properties":{"name":{"type":"string"},"age":{"type":"integer"},"city":{"type":"string"}},"required":["name","age","city"]}'
OK 0.0 1.0 763 6.86
111.2
Generate a person profile for someone named Alice who is 30 ...
49 mlx-community/Qwen3.5-35B-A3B-4bit @ numbered-list numbered-list OK 0.0 1.0 489 4.47
109.4
List exactly 5 animals, one per line, numbered 1-5. No other...
50 mlx-community/Qwen3.5-35B-A3B-4bit @ very-verbose very-verbose
--very-verbose
OK 0.7 1.0 480 4.41
108.9
Hello, how are you?
51 mlx-community/Qwen3.5-35B-A3B-4bit @ stop-word stop-word OK 0.0 1.0 1214 11.29
107.5
Name 5 programming languages and briefly describe each one.
52 mlx-community/Qwen3.5-35B-A3B-4bit @ combined-samplers combined-samplers
--top-k 50 --min-p 0.03 --top-p 0.95
OK 0.8 1.0 716 6.69
107.1
Explain why the sky is blue in exactly 3 bullet points.
53 mlx-community/Qwen3.5-35B-A3B-4bit @ response-format-text response-format-text OK 0.0 1.0 370 3.47
106.6
Tell me the language Python, what year it was created, and w...
54 mlx-community/Qwen3.5-35B-A3B-4bit @ tool-call-complex tool-call-complex OK 0.0 1.0 338 3.17
106.5
tools: [{"type":"function","function":{"name":"search_files"...
55 mlx-community/Qwen3.5-35B-A3B-4bit @ minimal-prompt minimal-prompt OK 0.7 2.0 322 3.03
106.2
Hi
56 mlx-community/Qwen3.5-35B-A3B-4bit @ min-p min-p
--min-p 0.05
OK 0.8 1.0 601 5.67
106.0
Explain why the sky is blue in exactly 3 bullet points.
57 mlx-community/Qwen3.5-35B-A3B-4bit @ json-output json-output OK 0.0 1.0 384 3.65
105.1
Respond with a valid JSON object containing keys "name", "ag...
58 mlx-community/Qwen3.5-35B-A3B-4bit @ verbose verbose
--verbose
OK 0.7 1.0 352 3.36
104.9
Hello, how are you?
59 mlx-community/Qwen3.5-35B-A3B-4bit @ strict-format strict-format OK 0.0 1.0 334 3.22
103.8
Output EXACTLY 3 lines. Each line must contain exactly one w...
60 mlx-community/Qwen3.5-35B-A3B-4bit @ default default OK 0.7 1.0 652 6.29
103.7
Explain why the sky is blue in exactly 3 bullet points.
61 mlx-community/Qwen3.5-35B-A3B-4bit @ code-python code-python OK 0.0 1.0 267 2.58
103.4
Write a function that finds all prime numbers up to n using ...
62 mlx-community/Qwen3.5-35B-A3B-4bit @ tool-call-xml tool-call-xml
--tool-call-parser xmlFunction
OK 0.0 1.0 330 3.21
102.8
tools: [{"type":"function","function":{"name":"get_weather",...
63 mlx-community/Qwen3.5-35B-A3B-4bit @ tool-call-multi tool-call-multi OK 0.0 1.0 287 2.81
102.3
tools: [{"type":"function","function":{"name":"get_weather",...
64 mlx-community/Qwen3.5-35B-A3B-4bit @ top-p top-p
--top-p 0.9
OK 0.8 1.0 562 5.5
102.1
Explain why the sky is blue in exactly 3 bullet points.
65 mlx-community/Qwen3.5-35B-A3B-4bit @ tool-call-auto tool-call-auto OK 0.0 1.0 330 3.28
100.7
tools: [{"type":"function","function":{"name":"get_weather",...
66 mlx-community/Qwen3.5-35B-A3B-4bit @ stop-no-match stop-no-match OK 0.0 1.0 256 2.56
100.0
Explain the difference between TCP and UDP in a few sentence...
67 mlx-community/Qwen3.5-35B-A3B-4bit @ stop-special-chars stop-special-chars OK 0.0 1.0 558 5.64
98.9
List 3 facts about the moon. Use **bold** markdown for empha...
68 mlx-community/Qwen3.5-35B-A3B-4bit @ stop-system-pirate stop-system-pirate OK 0.0 2.0 685 7.0
97.8
Tell me about treasure hunting on the high seas.
69 mlx-community/Qwen3.5-35B-A3B-4bit @ stop-unicode stop-unicode OK 0.0 1.0 341 3.52
96.8
List 5 items about space using bullet points (•).
70 mlx-community/Qwen3.5-35B-A3B-4bit @ code-swift code-swift OK 0.0 1.0 32768 340.44
96.2
Write a Swift async function that fetches JSON from a URL us...
71 mlx-community/Qwen3.5-35B-A3B-4bit @ repetition-penalty repetition-penalty
--repetition-penalty 1.2
OK 0.8 1.0 3954 42.36
93.3
Write a long essay about the history of bread making across ...
72 mlx-community/Qwen3.5-35B-A3B-4bit @ with-penalty with-penalty
--presence-penalty 1.5
OK 0.8 1.0 4096 44.04
93.0
Write a long essay about the history of bread making across ...
73 mlx-community/Qwen3.5-35B-A3B-4bit @ stop-multi-word stop-multi-word OK 0.0 1.0 374 4.21
88.9
Write a 5-step recipe for making tea. Label each step as "St...
74 mlx-community/Qwen3.5-35B-A3B-4bit @ stop-multi stop-multi OK 0.0 1.0 253 2.91
86.9
Write a Python hello world program in a code block, then wri...
75 mlx-community/Qwen3.5-35B-A3B-4bit @ logprobs logprobs
--max-logprobs 5
OK 0.0 1.0 144 1.69
85.0
What is 1+1?
76 mlx-community/Qwen3.5-35B-A3B-4bit @ stop-seed-run1 stop-seed-run1 OK 0.7 1.0 329 4.1
80.3
List 10 flowers, numbered 1 through 10, one per line.
77 mlx-community/Qwen3.5-35B-A3B-4bit @ stop-seed-run2 stop-seed-run2 OK 0.7 1.0 329 4.1
80.2
List 10 flowers, numbered 1 through 10, one per line.
78 mlx-community/Qwen3.5-35B-A3B-4bit @ stop-newline stop-newline OK 0.0 1.0 173 2.18
79.2
What is the capital of France? Answer in one sentence.
79 mlx-community/Qwen3.5-35B-A3B-4bit @ greedy greedy OK 0.0 1.0 546 6.91
79.0
Explain why the sky is blue in exactly 3 bullet points.
80 mlx-community/Qwen3.5-35B-A3B-4bit @ agent-no-cache-turn3 agent-no-cache-turn3 OK 0.0 1.0 149 1.9
78.2
Write a unit test for the timeout feature you just described...
81 mlx-community/Qwen3.5-35B-A3B-4bit @ agent-cached-turn3 agent-cached-turn3
--enable-prefix-caching
OK 0.0 1.0 149 1.91
77.9
Write a unit test for the timeout feature you just described...
82 mlx-community/Qwen3.5-35B-A3B-4bit @ stop-high-temp stop-high-temp OK 1.0 1.0 274 3.55
77.3
List 10 random words, numbered 1 through 10, one per line.
83 mlx-community/Qwen3.5-35B-A3B-4bit @ stop-html-tag stop-html-tag OK 0.0 1.0 239 3.1
77.0
Write an HTML unordered list of 5 fruits using <ul> and <li>...
84 mlx-community/Qwen3.5-35B-A3B-4bit @ stop-guided-json-value stop-guided-json-value
--guided-json '{"type":"object","properties":{"cities":{"type":"array","items":{"type":"string"}}},"required":["cities"]}'
OK 0.0 1.0 209 2.72
76.8
List 5 major world cities as a JSON array. Include Tokyo.
85 mlx-community/Qwen3.5-35B-A3B-4bit @ stop-low-max-tokens stop-low-max-tokens OK 0.0 1.0 100 1.31
76.4
List 10 mountains, numbered 1 through 10, one per line.
86 mlx-community/Qwen3.5-35B-A3B-4bit @ stop-cli-api-dedup stop-cli-api-dedup
--stop "3."
OK 0.0 1.0 234 3.09
75.8
List 10 cities, numbered 1 through 10, one per line.
87 mlx-community/Qwen3.5-35B-A3B-4bit @ stop-cli-api-merge stop-cli-api-merge
--stop "5."
OK 0.0 1.0 245 3.29
74.5
List 10 countries, numbered 1 through 10, one per line.
88 mlx-community/Qwen3.5-35B-A3B-4bit @ stop-cli-only stop-cli-only
--stop "3."
OK 0.0 1.0 209 3.04
68.9
List 10 types of cheese, numbered 1 through 10, one per line...
89 mlx-community/Qwen3.5-35B-A3B-4bit @ stop-single stop-single OK 0.0 1.0 199 2.93
68.0
List 10 fruits, numbered 1-10, one per line.
90 mlx-community/Qwen3.5-35B-A3B-4bit @ agent-cached-turn2 agent-cached-turn2
--enable-prefix-caching
OK 0.0 1.0 103 1.54
66.7
Now add a --timeout flag to the CLI that sets a request time...
91 mlx-community/Qwen3.5-35B-A3B-4bit @ stop-cli-multi stop-cli-multi
--stop "```,DONE"
OK 0.0 1.0 83 1.26
66.0
Write a bash script that prints the current date inside a co...
92 mlx-community/Qwen3.5-35B-A3B-4bit @ agent-no-cache-turn2 agent-no-cache-turn2 OK 0.0 1.0 103 1.58
65.3
Now add a --timeout flag to the CLI that sets a request time...
93 mlx-community/Qwen3.5-35B-A3B-4bit @ agent-cached-turn1 agent-cached-turn1
--enable-prefix-caching
OK 0.0 2.0 67 1.22
54.7
Read the file Sources/MacLocalAPI/main.swift and explain wha...
94 mlx-community/Qwen3.5-35B-A3B-4bit @ short-output short-output OK 0.7 1.0 50 0.99
50.3
Describe the entire history of Rome.
95 mlx-community/Qwen3.5-35B-A3B-4bit @ agent-no-cache-turn1 agent-no-cache-turn1 OK 0.0 1.0 67 1.48
45.3
Read the file Sources/MacLocalAPI/main.swift and explain wha...

AI Analysis (--smart)

Quality, Anomalies & Recommendations

Full Responses

mlx-community/Qwen3.5-35B-A3B-4bit @ stop-long-phrase 1143 tokens · 148.6 tok/s

mlx-community/Qwen3.5-35B-A3B-4bit @ tool-call-multi 1169 tokens · 123.4 tok/s

mlx-community/Qwen3.5-35B-A3B-4bit @ tool-call-auto 502 tokens · 121.6 tok/s

mlx-community/Qwen3.5-35B-A3B-4bit @ tool-call-complex 458 tokens · 121.6 tok/s

mlx-community/Qwen3.5-35B-A3B-4bit @ max-completion-tokens 2300 tokens · 121.0 tok/s

mlx-community/Qwen3.5-35B-A3B-4bit @ tool-call-xml 4096 tokens · 121.0 tok/s

mlx-community/Qwen3.5-35B-A3B-4bit @ developer-role 437 tokens · 120.9 tok/s

mlx-community/Qwen3.5-35B-A3B-4bit @ developer-role 4096 tokens · 119.5 tok/s

mlx-community/Qwen3.5-35B-A3B-4bit @ special-chars 4028 tokens · 119.0 tok/s

mlx-community/Qwen3.5-35B-A3B-4bit @ stop-four-max 4096 tokens · 118.8 tok/s

mlx-community/Qwen3.5-35B-A3B-4bit @ response-format-schema 1478 tokens · 118.5 tok/s

mlx-community/Qwen3.5-35B-A3B-4bit @ response-format-json 1303 tokens · 118.1 tok/s

mlx-community/Qwen3.5-35B-A3B-4bit @ stop-non-streaming 4096 tokens · 118.0 tok/s

mlx-community/Qwen3.5-35B-A3B-4bit @ streaming-seeded 2469 tokens · 118.0 tok/s

mlx-community/Qwen3.5-35B-A3B-4bit @ stop-json-object-key 4096 tokens · 117.7 tok/s

mlx-community/Qwen3.5-35B-A3B-4bit @ seed-42-run2 4096 tokens · 117.7 tok/s

mlx-community/Qwen3.5-35B-A3B-4bit @ math 1830 tokens · 117.4 tok/s

mlx-community/Qwen3.5-35B-A3B-4bit @ multilingual 1010 tokens · 117.4 tok/s

mlx-community/Qwen3.5-35B-A3B-4bit @ long-form 3743 tokens · 117.3 tok/s

mlx-community/Qwen3.5-35B-A3B-4bit @ stop-immediate 767 tokens · 117.3 tok/s

mlx-community/Qwen3.5-35B-A3B-4bit @ non-streaming-seeded 2469 tokens · 117.2 tok/s

mlx-community/Qwen3.5-35B-A3B-4bit @ prefill-small-256 3652 tokens · 117.2 tok/s

mlx-community/Qwen3.5-35B-A3B-4bit @ no-penalty 4096 tokens · 117.1 tok/s

mlx-community/Qwen3.5-35B-A3B-4bit @ max-completion-tokens 1174 tokens · 116.9 tok/s

mlx-community/Qwen3.5-35B-A3B-4bit @ seed-42-run1 4096 tokens · 116.9 tok/s

mlx-community/Qwen3.5-35B-A3B-4bit @ prefill-large-4096 3652 tokens · 116.8 tok/s

mlx-community/Qwen3.5-35B-A3B-4bit @ scientist 2040 tokens · 116.5 tok/s

mlx-community/Qwen3.5-35B-A3B-4bit @ prefill-default 3652 tokens · 116.5 tok/s

mlx-community/Qwen3.5-35B-A3B-4bit @ long-prompt 831 tokens · 116.5 tok/s

mlx-community/Qwen3.5-35B-A3B-4bit @ long-output 1992 tokens · 116.0 tok/s

mlx-community/Qwen3.5-35B-A3B-4bit @ guided-json-simple 1373 tokens · 115.9 tok/s

mlx-community/Qwen3.5-35B-A3B-4bit @ no-streaming 1747 tokens · 115.4 tok/s

mlx-community/Qwen3.5-35B-A3B-4bit @ stop-guided-json-brace 1063 tokens · 115.3 tok/s

mlx-community/Qwen3.5-35B-A3B-4bit @ eli5 1260 tokens · 114.6 tok/s

mlx-community/Qwen3.5-35B-A3B-4bit @ think-normal 833 tokens · 114.5 tok/s

mlx-community/Qwen3.5-35B-A3B-4bit @ think-raw 833 tokens · 114.5 tok/s

mlx-community/Qwen3.5-35B-A3B-4bit @ high-temp 1428 tokens · 114.0 tok/s

mlx-community/Qwen3.5-35B-A3B-4bit @ raw-mode 1210 tokens · 114.0 tok/s

mlx-community/Qwen3.5-35B-A3B-4bit @ small-kv 1127 tokens · 114.0 tok/s

mlx-community/Qwen3.5-35B-A3B-4bit @ guided-json-nested 937 tokens · 113.4 tok/s

mlx-community/Qwen3.5-35B-A3B-4bit @ kv-quantized 1105 tokens · 113.4 tok/s

mlx-community/Qwen3.5-35B-A3B-4bit @ pirate 1369 tokens · 113.4 tok/s

mlx-community/Qwen3.5-35B-A3B-4bit @ stop-double-newline 742 tokens · 113.3 tok/s

mlx-community/Qwen3.5-35B-A3B-4bit @ stop-period 692 tokens · 113.0 tok/s

mlx-community/Qwen3.5-35B-A3B-4bit @ stop-system-numbered 874 tokens · 112.9 tok/s

mlx-community/Qwen3.5-35B-A3B-4bit @ tool-call-none 475 tokens · 112.5 tok/s

mlx-community/Qwen3.5-35B-A3B-4bit @ top-k 1120 tokens · 111.6 tok/s

mlx-community/Qwen3.5-35B-A3B-4bit @ stop-guided-json-comma 763 tokens · 111.2 tok/s

mlx-community/Qwen3.5-35B-A3B-4bit @ numbered-list 489 tokens · 109.4 tok/s

mlx-community/Qwen3.5-35B-A3B-4bit @ very-verbose 480 tokens · 108.9 tok/s

mlx-community/Qwen3.5-35B-A3B-4bit @ stop-word 1214 tokens · 107.5 tok/s

mlx-community/Qwen3.5-35B-A3B-4bit @ combined-samplers 716 tokens · 107.1 tok/s

mlx-community/Qwen3.5-35B-A3B-4bit @ response-format-text 370 tokens · 106.6 tok/s

mlx-community/Qwen3.5-35B-A3B-4bit @ tool-call-complex 338 tokens · 106.5 tok/s

mlx-community/Qwen3.5-35B-A3B-4bit @ minimal-prompt 322 tokens · 106.2 tok/s

mlx-community/Qwen3.5-35B-A3B-4bit @ min-p 601 tokens · 106.0 tok/s

mlx-community/Qwen3.5-35B-A3B-4bit @ json-output 384 tokens · 105.1 tok/s

mlx-community/Qwen3.5-35B-A3B-4bit @ verbose 352 tokens · 104.9 tok/s

mlx-community/Qwen3.5-35B-A3B-4bit @ strict-format 334 tokens · 103.8 tok/s

mlx-community/Qwen3.5-35B-A3B-4bit @ default 652 tokens · 103.7 tok/s

mlx-community/Qwen3.5-35B-A3B-4bit @ code-python 267 tokens · 103.4 tok/s

mlx-community/Qwen3.5-35B-A3B-4bit @ tool-call-xml 330 tokens · 102.8 tok/s

mlx-community/Qwen3.5-35B-A3B-4bit @ tool-call-multi 287 tokens · 102.3 tok/s

mlx-community/Qwen3.5-35B-A3B-4bit @ top-p 562 tokens · 102.1 tok/s

mlx-community/Qwen3.5-35B-A3B-4bit @ tool-call-auto 330 tokens · 100.7 tok/s

mlx-community/Qwen3.5-35B-A3B-4bit @ stop-no-match 256 tokens · 100.0 tok/s

mlx-community/Qwen3.5-35B-A3B-4bit @ stop-special-chars 558 tokens · 98.9 tok/s

mlx-community/Qwen3.5-35B-A3B-4bit @ stop-system-pirate 685 tokens · 97.8 tok/s

mlx-community/Qwen3.5-35B-A3B-4bit @ stop-unicode 341 tokens · 96.8 tok/s

mlx-community/Qwen3.5-35B-A3B-4bit @ code-swift 32768 tokens · 96.2 tok/s

mlx-community/Qwen3.5-35B-A3B-4bit @ repetition-penalty 3954 tokens · 93.3 tok/s

mlx-community/Qwen3.5-35B-A3B-4bit @ with-penalty 4096 tokens · 93.0 tok/s

mlx-community/Qwen3.5-35B-A3B-4bit @ stop-multi-word 374 tokens · 88.9 tok/s

mlx-community/Qwen3.5-35B-A3B-4bit @ stop-multi 253 tokens · 86.9 tok/s

mlx-community/Qwen3.5-35B-A3B-4bit @ logprobs 144 tokens · 85.0 tok/s

mlx-community/Qwen3.5-35B-A3B-4bit @ stop-seed-run1 329 tokens · 80.3 tok/s

mlx-community/Qwen3.5-35B-A3B-4bit @ stop-seed-run2 329 tokens · 80.2 tok/s

mlx-community/Qwen3.5-35B-A3B-4bit @ stop-newline 173 tokens · 79.2 tok/s

mlx-community/Qwen3.5-35B-A3B-4bit @ greedy 546 tokens · 79.0 tok/s

mlx-community/Qwen3.5-35B-A3B-4bit @ agent-no-cache-turn3 149 tokens · 78.2 tok/s

mlx-community/Qwen3.5-35B-A3B-4bit @ agent-cached-turn3 149 tokens · 77.9 tok/s

mlx-community/Qwen3.5-35B-A3B-4bit @ stop-high-temp 274 tokens · 77.3 tok/s

mlx-community/Qwen3.5-35B-A3B-4bit @ stop-html-tag 239 tokens · 77.0 tok/s

mlx-community/Qwen3.5-35B-A3B-4bit @ stop-guided-json-value 209 tokens · 76.8 tok/s

mlx-community/Qwen3.5-35B-A3B-4bit @ stop-low-max-tokens 100 tokens · 76.4 tok/s

mlx-community/Qwen3.5-35B-A3B-4bit @ stop-cli-api-dedup 234 tokens · 75.8 tok/s

mlx-community/Qwen3.5-35B-A3B-4bit @ stop-cli-api-merge 245 tokens · 74.5 tok/s

mlx-community/Qwen3.5-35B-A3B-4bit @ stop-cli-only 209 tokens · 68.9 tok/s

mlx-community/Qwen3.5-35B-A3B-4bit @ stop-single 199 tokens · 68.0 tok/s

mlx-community/Qwen3.5-35B-A3B-4bit @ agent-cached-turn2 103 tokens · 66.7 tok/s

mlx-community/Qwen3.5-35B-A3B-4bit @ stop-cli-multi 83 tokens · 66.0 tok/s

mlx-community/Qwen3.5-35B-A3B-4bit @ agent-no-cache-turn2 103 tokens · 65.3 tok/s

mlx-community/Qwen3.5-35B-A3B-4bit @ agent-cached-turn1 67 tokens · 54.7 tok/s

mlx-community/Qwen3.5-35B-A3B-4bit @ short-output 50 tokens · 50.3 tok/s

mlx-community/Qwen3.5-35B-A3B-4bit @ agent-no-cache-turn1 67 tokens · 45.3 tok/s