MLX Model Test Report

Generated 2026-02-27 10:54 · AFM MLX Backend · v0.9.5-4d58e3f

mlx-model-test.sh --model mlx-community/Qwen3.5-35B-A3B-4bit --prompts /Volumes/edata/dev/git/NIGHTLY/maclocal-api/Scripts/test-llm-comprehensive.txt --smart 1:codex

Test Runs
95
Passed
95
Failed
0
Best tok/s
149.6
Fastest
mlx-community/Qwen3.5-35B-A3B-4bit @ stop-long-phrase

Performance Ranking (by tokens/sec)

Click a row to jump to its full response below.

# Model / Config Status claude Temp Load (s) Tokens Gen (s) Tokens/sec Prompt
1 mlx-community/Qwen3.5-35B-A3B-4bit @ stop-long-phrase stop-long-phrase OK 3 0.0 1.0 1143 7.64
149.6
Write a 3-paragraph essay about renewable energy. Start the ...
2 mlx-community/Qwen3.5-35B-A3B-4bit @ stop-json-object-key stop-json-object-key OK 3 0.0 1.0 4096 33.55
122.1
Generate a JSON object with keys "name", "age", and "city" f...
3 mlx-community/Qwen3.5-35B-A3B-4bit @ stop-non-streaming stop-non-streaming
--no-streaming
OK 3 0.0 1.0 4096 33.61
121.9
List 10 planets or celestial objects, numbered 1 through 10,...
4 mlx-community/Qwen3.5-35B-A3B-4bit @ prefill-large-4096 prefill-large-4096
--prefill-step-size 4096
OK 3 0.0 1.0 3652 30.0
121.7
Given this architecture, what are the top 3 performance bott...
5 mlx-community/Qwen3.5-35B-A3B-4bit @ prefill-small-256 prefill-small-256
--prefill-step-size 256
OK 3 0.0 1.0 3652 30.05
121.5
Given this architecture, what are the top 3 performance bott...
6 mlx-community/Qwen3.5-35B-A3B-4bit @ prefill-default prefill-default OK 3 0.0 1.0 3652 30.1
121.3
Given this architecture, what are the top 3 performance bott...
7 mlx-community/Qwen3.5-35B-A3B-4bit @ stop-four-max stop-four-max OK 3 0.0 1.0 4096 33.76
121.3
List 10 facts about numbers, alternating between digit forma...
8 mlx-community/Qwen3.5-35B-A3B-4bit @ no-streaming no-streaming
--no-streaming
OK 3 0.7 1.0 3820 31.69
120.5
Write a short poem about the moon.
9 mlx-community/Qwen3.5-35B-A3B-4bit @ stop-double-newline stop-double-newline OK 3 0.0 1.0 742 6.19
119.9
Write a short paragraph about the ocean. Then write a second...
10 mlx-community/Qwen3.5-35B-A3B-4bit @ tool-call-multi tool-call-multi OK 3 0.0 1.0 1169 9.8
119.3
What is the weather in London and what time is it in Tokyo?
11 mlx-community/Qwen3.5-35B-A3B-4bit @ kv-quantized kv-quantized
--kv-bits 4
OK 3 0.7 1.0 1450 12.22
118.7
Summarize the key ideas of machine learning in a few paragra...
12 mlx-community/Qwen3.5-35B-A3B-4bit @ tool-call-auto tool-call-auto OK 3 0.0 2.0 502 4.24
118.5
What is the weather in Tokyo?
13 mlx-community/Qwen3.5-35B-A3B-4bit @ code-swift code-swift OK 3 0.0 1.0 4096 34.63
118.3
Write a Swift async function that fetches JSON from a URL us...
14 mlx-community/Qwen3.5-35B-A3B-4bit @ scientist scientist OK 3 0.3 1.0 2168 18.36
118.1
Tell me about quantum computing.
15 mlx-community/Qwen3.5-35B-A3B-4bit @ math math OK 3 0.0 1.0 1830 15.51
118.0
A store sells notebooks for $3.50 each. If you buy 5 or more...
16 mlx-community/Qwen3.5-35B-A3B-4bit @ tool-call-complex tool-call-complex OK 3 0.0 1.0 458 3.9
117.6
Search recursively for all Swift files under Sources/ with a...
17 mlx-community/Qwen3.5-35B-A3B-4bit @ stop-guided-json-brace stop-guided-json-brace
--guided-json '{"type":"object","properties":{"color":{"type":"string"},"hex":{"type":"string"}},"required":["color","hex"]}'
OK 3 0.0 1.0 1063 9.04
117.5
Describe the color blue with its hex code.
18 mlx-community/Qwen3.5-35B-A3B-4bit @ tool-call-xml tool-call-xml
--tool-call-parser xmlFunction
OK 3 0.0 1.0 4096 34.92
117.3
What is the weather in Paris in celsius?
19 mlx-community/Qwen3.5-35B-A3B-4bit @ developer-role developer-role OK 3 0.0 1.0 437 3.73
117.2
Write a Python function that reverses a string.
20 mlx-community/Qwen3.5-35B-A3B-4bit @ long-form long-form OK 3 0.7 1.0 3354 28.61
117.2
Write a detailed technical blog post explaining how Mixture-...
21 mlx-community/Qwen3.5-35B-A3B-4bit @ pirate pirate OK 3 0.7 1.0 1358 11.6
117.1
Tell me about quantum computing.
22 mlx-community/Qwen3.5-35B-A3B-4bit @ guided-json-simple guided-json-simple
--guided-json '{"type":"object","properties":{"name":{"type":"string"},"age":{"type":"integer"}},"required":["name","age"]}'
OK 3 0.0 1.0 1373 11.75
116.8
Generate a person record.
23 mlx-community/Qwen3.5-35B-A3B-4bit @ stop-period stop-period OK 3 0.0 1.0 692 5.93
116.8
Tell me about the sun in three sentences.
24 mlx-community/Qwen3.5-35B-A3B-4bit @ special-chars special-chars OK 3 0.0 2.0 4028 34.58
116.5
Repeat these characters exactly: <tag> "quotes" 'apostrophes...
25 mlx-community/Qwen3.5-35B-A3B-4bit @ guided-json-nested guided-json-nested
--guided-json '{"type":"object","properties":{"city":{"type":"string"},"population":{"type":"integer"},"landmarks":{"type":"array","items":{"type":"string"}}},"required":["city","population","landmarks"]}'
OK 3 0.0 1.0 937 8.09
115.8
Describe Tokyo as a structured record with at least 3 landma...
26 mlx-community/Qwen3.5-35B-A3B-4bit @ raw-mode raw-mode
--raw
OK 3 0.7 2.0 827 7.15
115.7
Think step by step: what is 17 * 23?
27 mlx-community/Qwen3.5-35B-A3B-4bit @ small-kv small-kv
--max-kv-size 2048
OK 3 0.7 1.0 1241 10.75
115.4
Summarize the key ideas of machine learning in a few paragra...
28 mlx-community/Qwen3.5-35B-A3B-4bit @ long-output long-output OK 3 0.7 2.0 1993 17.31
115.2
Write a detailed recipe for chocolate chip cookies with ingr...
29 mlx-community/Qwen3.5-35B-A3B-4bit @ non-streaming-seeded non-streaming-seeded
--no-streaming --seed 123
OK 3 0.7 1.0 2469 21.58
114.4
Write a 4-line poem about the ocean.
30 mlx-community/Qwen3.5-35B-A3B-4bit @ high-temp high-temp OK 3 1.5 1.0 1202 10.51
114.3
Explain why the sky is blue in exactly 3 bullet points.
31 mlx-community/Qwen3.5-35B-A3B-4bit @ max-completion-tokens max-completion-tokens OK 3 0.0 2.0 2300 20.15
114.2
Explain the causes and consequences of the French Revolution...
32 mlx-community/Qwen3.5-35B-A3B-4bit @ streaming-seeded streaming-seeded
--seed 123
OK 3 0.7 1.0 2469 21.65
114.0
Write a 4-line poem about the ocean.
33 mlx-community/Qwen3.5-35B-A3B-4bit @ stop-immediate stop-immediate OK 3 0.0 1.0 767 6.75
113.6
Explain what gravity is.
34 mlx-community/Qwen3.5-35B-A3B-4bit @ developer-role developer-role OK 3 0.0 1.0 4096 36.09
113.5
developer: You are a helpful coding assistant. Only respond ...
35 mlx-community/Qwen3.5-35B-A3B-4bit @ seed-42-run2 seed-42-run2
--seed 42
OK 3 0.7 1.0 4096 36.18
113.2
Write a limerick about a cat.
36 mlx-community/Qwen3.5-35B-A3B-4bit @ stop-guided-json-comma stop-guided-json-comma
--guided-json '{"type":"object","properties":{"name":{"type":"string"},"age":{"type":"integer"},"city":{"type":"string"}},"required":["name","age","city"]}'
OK 3 0.0 1.0 763 6.75
113.0
Generate a person profile for someone named Alice who is 30 ...
37 mlx-community/Qwen3.5-35B-A3B-4bit @ response-format-schema response-format-schema OK 3 0.0 1.0 1478 13.08
113.0
Generate a fictional person profile.
38 mlx-community/Qwen3.5-35B-A3B-4bit @ top-p top-p
--top-p 0.9
OK 3 0.8 1.0 1173 10.39
112.9
Explain why the sky is blue in exactly 3 bullet points.
39 mlx-community/Qwen3.5-35B-A3B-4bit @ long-prompt long-prompt OK 3 0.0 1.0 831 7.36
112.9
Repeat after me exactly: The quick brown fox jumps over the ...
40 mlx-community/Qwen3.5-35B-A3B-4bit @ stop-word stop-word OK 3 0.0 1.0 1214 10.83
112.1
Name 5 programming languages and briefly describe each one.
41 mlx-community/Qwen3.5-35B-A3B-4bit @ eli5 eli5 OK 3 0.7 1.0 1066 9.53
111.8
Tell me about quantum computing.
42 mlx-community/Qwen3.5-35B-A3B-4bit @ multilingual multilingual OK 3 0.3 1.0 795 7.11
111.8
Translate "Hello, how are you?" into French, Spanish, Japane...
43 mlx-community/Qwen3.5-35B-A3B-4bit @ combined-samplers combined-samplers
--top-k 50 --min-p 0.03 --top-p 0.95
OK 3 0.8 1.0 1051 9.51
110.5
Explain why the sky is blue in exactly 3 bullet points.
44 mlx-community/Qwen3.5-35B-A3B-4bit @ default default OK 3 0.7 1.0 569 5.16
110.3
Explain why the sky is blue in exactly 3 bullet points.
45 mlx-community/Qwen3.5-35B-A3B-4bit @ greedy greedy OK 4 0.0 2.0 546 5.01
109.0
Explain why the sky is blue in exactly 3 bullet points.
46 mlx-community/Qwen3.5-35B-A3B-4bit @ min-p min-p
--min-p 0.05
OK 3 0.8 1.0 621 5.71
108.8
Explain why the sky is blue in exactly 3 bullet points.
47 mlx-community/Qwen3.5-35B-A3B-4bit @ top-k top-k
--top-k 30
OK 3 0.8 1.0 578 5.33
108.5
Explain why the sky is blue in exactly 3 bullet points.
48 mlx-community/Qwen3.5-35B-A3B-4bit @ tool-call-none tool-call-none OK 3 0.0 1.0 475 4.42
107.5
What is the current temperature in Berlin?
49 mlx-community/Qwen3.5-35B-A3B-4bit @ think-normal think-normal OK 3 0.0 2.0 833 7.79
106.9
Solve step by step: If a train travels at 60 mph for 2.5 hou...
50 mlx-community/Qwen3.5-35B-A3B-4bit @ response-format-json response-format-json OK 3 0.0 2.0 1303 12.2
106.8
Return a JSON object with keys "language", "year_created", a...
51 mlx-community/Qwen3.5-35B-A3B-4bit @ numbered-list numbered-list OK 3 0.0 1.0 489 4.59
106.4
List exactly 5 animals, one per line, numbered 1-5. No other...
52 mlx-community/Qwen3.5-35B-A3B-4bit @ max-completion-tokens max-completion-tokens OK 3 0.0 2.0 1174 11.12
105.6
max_completion_tokens: 100
53 mlx-community/Qwen3.5-35B-A3B-4bit @ json-output json-output OK 3 0.0 1.0 384 3.68
104.5
Respond with a valid JSON object containing keys "name", "ag...
54 mlx-community/Qwen3.5-35B-A3B-4bit @ think-raw think-raw
--raw
OK 3 0.0 2.0 833 7.99
104.3
Solve step by step: If a train travels at 60 mph for 2.5 hou...
55 mlx-community/Qwen3.5-35B-A3B-4bit @ seed-42-run1 seed-42-run1
--seed 42
OK 3 0.7 1.0 4096 39.68
103.2
Write a limerick about a cat.
56 mlx-community/Qwen3.5-35B-A3B-4bit @ verbose verbose
--verbose
OK 3 0.7 1.0 368 3.6
102.2
Hello, how are you?
57 mlx-community/Qwen3.5-35B-A3B-4bit @ strict-format strict-format OK 3 0.0 1.0 334 3.29
101.5
Output EXACTLY 3 lines. Each line must contain exactly one w...
58 mlx-community/Qwen3.5-35B-A3B-4bit @ stop-no-match stop-no-match OK 3 0.0 1.0 256 2.53
101.3
Explain the difference between TCP and UDP in a few sentence...
59 mlx-community/Qwen3.5-35B-A3B-4bit @ stop-special-chars stop-special-chars OK 3 0.0 1.0 558 5.54
100.8
List 3 facts about the moon. Use **bold** markdown for empha...
60 mlx-community/Qwen3.5-35B-A3B-4bit @ tool-call-complex tool-call-complex OK 3 0.0 1.0 338 3.4
99.5
tools: [{"type":"function","function":{"name":"search_files"...
61 mlx-community/Qwen3.5-35B-A3B-4bit @ tool-call-xml tool-call-xml
--tool-call-parser xmlFunction
OK 3 0.0 1.0 330 3.32
99.5
tools: [{"type":"function","function":{"name":"get_weather",...
62 mlx-community/Qwen3.5-35B-A3B-4bit @ very-verbose very-verbose
--very-verbose
OK 3 0.7 1.0 277 2.81
98.4
Hello, how are you?
63 mlx-community/Qwen3.5-35B-A3B-4bit @ stop-unicode stop-unicode OK 3 0.0 1.0 341 3.48
97.9
List 5 items about space using bullet points (•).
64 mlx-community/Qwen3.5-35B-A3B-4bit @ tool-call-multi tool-call-multi OK 3 0.0 1.0 287 2.95
97.3
tools: [{"type":"function","function":{"name":"get_weather",...
65 mlx-community/Qwen3.5-35B-A3B-4bit @ tool-call-auto tool-call-auto OK 3 0.0 2.0 330 3.39
97.2
tools: [{"type":"function","function":{"name":"get_weather",...
66 mlx-community/Qwen3.5-35B-A3B-4bit @ response-format-text response-format-text OK 3 0.0 2.0 370 3.81
97.0
Tell me the language Python, what year it was created, and w...
67 mlx-community/Qwen3.5-35B-A3B-4bit @ repetition-penalty repetition-penalty
--repetition-penalty 1.2
OK 3 0.8 1.0 4096 42.55
96.3
Write a long essay about the history of bread making across ...
68 mlx-community/Qwen3.5-35B-A3B-4bit @ minimal-prompt minimal-prompt OK 3 0.7 1.0 236 2.48
95.3
Hi
69 mlx-community/Qwen3.5-35B-A3B-4bit @ stop-multi stop-multi OK 3 0.0 1.0 253 2.72
92.9
Write a Python hello world program in a code block, then wri...
70 mlx-community/Qwen3.5-35B-A3B-4bit @ code-python code-python OK 3 0.0 2.0 267 2.91
91.7
Write a function that finds all prime numbers up to n using ...
71 mlx-community/Qwen3.5-35B-A3B-4bit @ with-penalty with-penalty
--presence-penalty 1.5
OK 3 0.8 2.0 3577 39.58
90.4
Write a long essay about the history of bread making across ...
72 mlx-community/Qwen3.5-35B-A3B-4bit @ stop-multi-word stop-multi-word OK 3 0.0 1.0 374 4.15
90.2
Write a 5-step recipe for making tea. Label each step as "St...
73 mlx-community/Qwen3.5-35B-A3B-4bit @ stop-system-numbered stop-system-numbered OK 3 0.0 2.0 874 9.79
89.3
What are the main benefits of exercise?
74 mlx-community/Qwen3.5-35B-A3B-4bit @ logprobs logprobs
--max-logprobs 5
OK 3 0.0 1.0 144 1.68
85.7
What is 1+1?
75 mlx-community/Qwen3.5-35B-A3B-4bit @ stop-newline stop-newline OK 3 0.0 1.0 173 2.08
83.3
What is the capital of France? Answer in one sentence.
76 mlx-community/Qwen3.5-35B-A3B-4bit @ agent-no-cache-turn3 agent-no-cache-turn3 OK 3 0.0 1.0 149 1.8
82.8
Write a unit test for the timeout feature you just described...
77 mlx-community/Qwen3.5-35B-A3B-4bit @ stop-cli-api-dedup stop-cli-api-dedup
--stop "3."
OK 3 0.0 1.0 234 2.93
79.7
List 10 cities, numbered 1 through 10, one per line.
78 mlx-community/Qwen3.5-35B-A3B-4bit @ no-penalty no-penalty
--presence-penalty 0.0
OK 3 0.8 2.0 4096 51.45
79.6
Write a long essay about the history of bread making across ...
79 mlx-community/Qwen3.5-35B-A3B-4bit @ stop-cli-api-merge stop-cli-api-merge
--stop "5."
OK 3 0.0 2.0 245 3.17
77.3
List 10 countries, numbered 1 through 10, one per line.
80 mlx-community/Qwen3.5-35B-A3B-4bit @ stop-guided-json-value stop-guided-json-value
--guided-json '{"type":"object","properties":{"cities":{"type":"array","items":{"type":"string"}}},"required":["cities"]}'
OK 3 0.0 2.0 209 2.72
77.0
List 5 major world cities as a JSON array. Include Tokyo.
81 mlx-community/Qwen3.5-35B-A3B-4bit @ agent-cached-turn3 agent-cached-turn3
--enable-prefix-caching
OK 3 0.0 2.0 149 1.95
76.5
Write a unit test for the timeout feature you just described...
82 mlx-community/Qwen3.5-35B-A3B-4bit @ stop-html-tag stop-html-tag OK 3 0.0 1.0 232 3.11
74.7
Write an HTML unordered list of 5 fruits using <ul> and <li>...
83 mlx-community/Qwen3.5-35B-A3B-4bit @ stop-single stop-single OK 3 0.0 1.0 199 2.73
73.0
List 10 fruits, numbered 1-10, one per line.
84 mlx-community/Qwen3.5-35B-A3B-4bit @ stop-cli-only stop-cli-only
--stop "3."
OK 3 0.0 1.0 209 2.98
70.2
List 10 types of cheese, numbered 1 through 10, one per line...
85 mlx-community/Qwen3.5-35B-A3B-4bit @ stop-seed-run1 stop-seed-run1 OK 3 0.7 2.0 329 4.7
70.0
List 10 flowers, numbered 1 through 10, one per line.
86 mlx-community/Qwen3.5-35B-A3B-4bit @ stop-seed-run2 stop-seed-run2 OK 3 0.7 2.0 329 4.74
69.5
List 10 flowers, numbered 1 through 10, one per line.
87 mlx-community/Qwen3.5-35B-A3B-4bit @ stop-cli-multi stop-cli-multi
--stop "```,DONE"
OK 3 0.0 1.0 83 1.2
69.3
Write a bash script that prints the current date inside a co...
88 mlx-community/Qwen3.5-35B-A3B-4bit @ agent-no-cache-turn2 agent-no-cache-turn2 OK 3 0.0 1.0 103 1.5
68.6
Now add a --timeout flag to the CLI that sets a request time...
89 mlx-community/Qwen3.5-35B-A3B-4bit @ stop-high-temp stop-high-temp OK 3 1.0 2.0 245 3.73
65.7
List 10 random words, numbered 1 through 10, one per line.
90 mlx-community/Qwen3.5-35B-A3B-4bit @ agent-cached-turn2 agent-cached-turn2
--enable-prefix-caching
OK 3 0.0 1.0 103 1.58
65.2
Now add a --timeout flag to the CLI that sets a request time...
91 mlx-community/Qwen3.5-35B-A3B-4bit @ stop-system-pirate stop-system-pirate OK 3 0.0 3.0 685 11.39
60.1
Tell me about treasure hunting on the high seas.
92 mlx-community/Qwen3.5-35B-A3B-4bit @ agent-cached-turn1 agent-cached-turn1
--enable-prefix-caching
OK 3 0.0 1.0 67 1.15
58.2
Read the file Sources/MacLocalAPI/main.swift and explain wha...
93 mlx-community/Qwen3.5-35B-A3B-4bit @ agent-no-cache-turn1 agent-no-cache-turn1 OK 3 0.0 1.0 67 1.22
55.0
Read the file Sources/MacLocalAPI/main.swift and explain wha...
94 mlx-community/Qwen3.5-35B-A3B-4bit @ stop-low-max-tokens stop-low-max-tokens OK 3 0.0 2.0 100 1.95
51.2
List 10 mountains, numbered 1 through 10, one per line.
95 mlx-community/Qwen3.5-35B-A3B-4bit @ short-output short-output OK 3 0.7 2.0 50 1.5
33.2
Describe the entire history of Rome.

AI Analysis (--smart)

Quality, Anomalies & Recommendations · avg score: 3.0/5

Full Responses

mlx-community/Qwen3.5-35B-A3B-4bit @ stop-long-phrase 1143 tokens · 149.6 tok/s

mlx-community/Qwen3.5-35B-A3B-4bit @ stop-json-object-key 4096 tokens · 122.1 tok/s

mlx-community/Qwen3.5-35B-A3B-4bit @ stop-non-streaming 4096 tokens · 121.9 tok/s

mlx-community/Qwen3.5-35B-A3B-4bit @ prefill-large-4096 3652 tokens · 121.7 tok/s

mlx-community/Qwen3.5-35B-A3B-4bit @ prefill-small-256 3652 tokens · 121.5 tok/s

mlx-community/Qwen3.5-35B-A3B-4bit @ prefill-default 3652 tokens · 121.3 tok/s

mlx-community/Qwen3.5-35B-A3B-4bit @ stop-four-max 4096 tokens · 121.3 tok/s

mlx-community/Qwen3.5-35B-A3B-4bit @ no-streaming 3820 tokens · 120.5 tok/s

mlx-community/Qwen3.5-35B-A3B-4bit @ stop-double-newline 742 tokens · 119.9 tok/s

mlx-community/Qwen3.5-35B-A3B-4bit @ tool-call-multi 1169 tokens · 119.3 tok/s

mlx-community/Qwen3.5-35B-A3B-4bit @ kv-quantized 1450 tokens · 118.7 tok/s

mlx-community/Qwen3.5-35B-A3B-4bit @ tool-call-auto 502 tokens · 118.5 tok/s

mlx-community/Qwen3.5-35B-A3B-4bit @ code-swift 4096 tokens · 118.3 tok/s

mlx-community/Qwen3.5-35B-A3B-4bit @ scientist 2168 tokens · 118.1 tok/s

mlx-community/Qwen3.5-35B-A3B-4bit @ math 1830 tokens · 118.0 tok/s

mlx-community/Qwen3.5-35B-A3B-4bit @ tool-call-complex 458 tokens · 117.6 tok/s

mlx-community/Qwen3.5-35B-A3B-4bit @ stop-guided-json-brace 1063 tokens · 117.5 tok/s

mlx-community/Qwen3.5-35B-A3B-4bit @ tool-call-xml 4096 tokens · 117.3 tok/s

mlx-community/Qwen3.5-35B-A3B-4bit @ developer-role 437 tokens · 117.2 tok/s

mlx-community/Qwen3.5-35B-A3B-4bit @ long-form 3354 tokens · 117.2 tok/s

mlx-community/Qwen3.5-35B-A3B-4bit @ pirate 1358 tokens · 117.1 tok/s

mlx-community/Qwen3.5-35B-A3B-4bit @ guided-json-simple 1373 tokens · 116.8 tok/s

mlx-community/Qwen3.5-35B-A3B-4bit @ stop-period 692 tokens · 116.8 tok/s

mlx-community/Qwen3.5-35B-A3B-4bit @ special-chars 4028 tokens · 116.5 tok/s

mlx-community/Qwen3.5-35B-A3B-4bit @ guided-json-nested 937 tokens · 115.8 tok/s

mlx-community/Qwen3.5-35B-A3B-4bit @ raw-mode 827 tokens · 115.7 tok/s

mlx-community/Qwen3.5-35B-A3B-4bit @ small-kv 1241 tokens · 115.4 tok/s

mlx-community/Qwen3.5-35B-A3B-4bit @ long-output 1993 tokens · 115.2 tok/s

mlx-community/Qwen3.5-35B-A3B-4bit @ non-streaming-seeded 2469 tokens · 114.4 tok/s

mlx-community/Qwen3.5-35B-A3B-4bit @ high-temp 1202 tokens · 114.3 tok/s

mlx-community/Qwen3.5-35B-A3B-4bit @ max-completion-tokens 2300 tokens · 114.2 tok/s

mlx-community/Qwen3.5-35B-A3B-4bit @ streaming-seeded 2469 tokens · 114.0 tok/s

mlx-community/Qwen3.5-35B-A3B-4bit @ stop-immediate 767 tokens · 113.6 tok/s

mlx-community/Qwen3.5-35B-A3B-4bit @ developer-role 4096 tokens · 113.5 tok/s

mlx-community/Qwen3.5-35B-A3B-4bit @ seed-42-run2 4096 tokens · 113.2 tok/s

mlx-community/Qwen3.5-35B-A3B-4bit @ stop-guided-json-comma 763 tokens · 113.0 tok/s

mlx-community/Qwen3.5-35B-A3B-4bit @ response-format-schema 1478 tokens · 113.0 tok/s

mlx-community/Qwen3.5-35B-A3B-4bit @ top-p 1173 tokens · 112.9 tok/s

mlx-community/Qwen3.5-35B-A3B-4bit @ long-prompt 831 tokens · 112.9 tok/s

mlx-community/Qwen3.5-35B-A3B-4bit @ stop-word 1214 tokens · 112.1 tok/s

mlx-community/Qwen3.5-35B-A3B-4bit @ eli5 1066 tokens · 111.8 tok/s

mlx-community/Qwen3.5-35B-A3B-4bit @ multilingual 795 tokens · 111.8 tok/s

mlx-community/Qwen3.5-35B-A3B-4bit @ combined-samplers 1051 tokens · 110.5 tok/s

mlx-community/Qwen3.5-35B-A3B-4bit @ default 569 tokens · 110.3 tok/s

mlx-community/Qwen3.5-35B-A3B-4bit @ greedy 546 tokens · 109.0 tok/s

mlx-community/Qwen3.5-35B-A3B-4bit @ min-p 621 tokens · 108.8 tok/s

mlx-community/Qwen3.5-35B-A3B-4bit @ top-k 578 tokens · 108.5 tok/s

mlx-community/Qwen3.5-35B-A3B-4bit @ tool-call-none 475 tokens · 107.5 tok/s

mlx-community/Qwen3.5-35B-A3B-4bit @ think-normal 833 tokens · 106.9 tok/s

mlx-community/Qwen3.5-35B-A3B-4bit @ response-format-json 1303 tokens · 106.8 tok/s

mlx-community/Qwen3.5-35B-A3B-4bit @ numbered-list 489 tokens · 106.4 tok/s

mlx-community/Qwen3.5-35B-A3B-4bit @ max-completion-tokens 1174 tokens · 105.6 tok/s

mlx-community/Qwen3.5-35B-A3B-4bit @ json-output 384 tokens · 104.5 tok/s

mlx-community/Qwen3.5-35B-A3B-4bit @ think-raw 833 tokens · 104.3 tok/s

mlx-community/Qwen3.5-35B-A3B-4bit @ seed-42-run1 4096 tokens · 103.2 tok/s

mlx-community/Qwen3.5-35B-A3B-4bit @ verbose 368 tokens · 102.2 tok/s

mlx-community/Qwen3.5-35B-A3B-4bit @ strict-format 334 tokens · 101.5 tok/s

mlx-community/Qwen3.5-35B-A3B-4bit @ stop-no-match 256 tokens · 101.3 tok/s

mlx-community/Qwen3.5-35B-A3B-4bit @ stop-special-chars 558 tokens · 100.8 tok/s

mlx-community/Qwen3.5-35B-A3B-4bit @ tool-call-complex 338 tokens · 99.5 tok/s

mlx-community/Qwen3.5-35B-A3B-4bit @ tool-call-xml 330 tokens · 99.5 tok/s

mlx-community/Qwen3.5-35B-A3B-4bit @ very-verbose 277 tokens · 98.4 tok/s

mlx-community/Qwen3.5-35B-A3B-4bit @ stop-unicode 341 tokens · 97.9 tok/s

mlx-community/Qwen3.5-35B-A3B-4bit @ tool-call-multi 287 tokens · 97.3 tok/s

mlx-community/Qwen3.5-35B-A3B-4bit @ tool-call-auto 330 tokens · 97.2 tok/s

mlx-community/Qwen3.5-35B-A3B-4bit @ response-format-text 370 tokens · 97.0 tok/s

mlx-community/Qwen3.5-35B-A3B-4bit @ repetition-penalty 4096 tokens · 96.3 tok/s

mlx-community/Qwen3.5-35B-A3B-4bit @ minimal-prompt 236 tokens · 95.3 tok/s

mlx-community/Qwen3.5-35B-A3B-4bit @ stop-multi 253 tokens · 92.9 tok/s

mlx-community/Qwen3.5-35B-A3B-4bit @ code-python 267 tokens · 91.7 tok/s

mlx-community/Qwen3.5-35B-A3B-4bit @ with-penalty 3577 tokens · 90.4 tok/s

mlx-community/Qwen3.5-35B-A3B-4bit @ stop-multi-word 374 tokens · 90.2 tok/s

mlx-community/Qwen3.5-35B-A3B-4bit @ stop-system-numbered 874 tokens · 89.3 tok/s

mlx-community/Qwen3.5-35B-A3B-4bit @ logprobs 144 tokens · 85.7 tok/s

mlx-community/Qwen3.5-35B-A3B-4bit @ stop-newline 173 tokens · 83.3 tok/s

mlx-community/Qwen3.5-35B-A3B-4bit @ agent-no-cache-turn3 149 tokens · 82.8 tok/s

mlx-community/Qwen3.5-35B-A3B-4bit @ stop-cli-api-dedup 234 tokens · 79.7 tok/s

mlx-community/Qwen3.5-35B-A3B-4bit @ no-penalty 4096 tokens · 79.6 tok/s

mlx-community/Qwen3.5-35B-A3B-4bit @ stop-cli-api-merge 245 tokens · 77.3 tok/s

mlx-community/Qwen3.5-35B-A3B-4bit @ stop-guided-json-value 209 tokens · 77.0 tok/s

mlx-community/Qwen3.5-35B-A3B-4bit @ agent-cached-turn3 149 tokens · 76.5 tok/s

mlx-community/Qwen3.5-35B-A3B-4bit @ stop-html-tag 232 tokens · 74.7 tok/s

mlx-community/Qwen3.5-35B-A3B-4bit @ stop-single 199 tokens · 73.0 tok/s

mlx-community/Qwen3.5-35B-A3B-4bit @ stop-cli-only 209 tokens · 70.2 tok/s

mlx-community/Qwen3.5-35B-A3B-4bit @ stop-seed-run1 329 tokens · 70.0 tok/s

mlx-community/Qwen3.5-35B-A3B-4bit @ stop-seed-run2 329 tokens · 69.5 tok/s

mlx-community/Qwen3.5-35B-A3B-4bit @ stop-cli-multi 83 tokens · 69.3 tok/s

mlx-community/Qwen3.5-35B-A3B-4bit @ agent-no-cache-turn2 103 tokens · 68.6 tok/s

mlx-community/Qwen3.5-35B-A3B-4bit @ stop-high-temp 245 tokens · 65.7 tok/s

mlx-community/Qwen3.5-35B-A3B-4bit @ agent-cached-turn2 103 tokens · 65.2 tok/s

mlx-community/Qwen3.5-35B-A3B-4bit @ stop-system-pirate 685 tokens · 60.1 tok/s

mlx-community/Qwen3.5-35B-A3B-4bit @ agent-cached-turn1 67 tokens · 58.2 tok/s

mlx-community/Qwen3.5-35B-A3B-4bit @ agent-no-cache-turn1 67 tokens · 55.0 tok/s

mlx-community/Qwen3.5-35B-A3B-4bit @ stop-low-max-tokens 100 tokens · 51.2 tok/s

mlx-community/Qwen3.5-35B-A3B-4bit @ short-output 50 tokens · 33.2 tok/s