Tool Call Parser Test Report — 20260223

--tool-call-parser hermes

mlx-community/Qwen3-30B-A3B-4bit

4/4 PASS

Test	Mode	Result	Time	Details
server_start	—	PASS	—	Server started successfully
weather_nonstream	sync	PASS	1.66	tool: `get_weather` args: `{"city": "Tokyo"}` finish: `tool_calls`
weather_stream	SSE	PASS	1.06	tool: `get_weather` args: `{"city": "London"}` finish: `tool_calls`
calc_nonstream	sync	PASS	2.23	tool: `calculate` args: `{"expression": "17 * 23 + 5"}` finish: `tool_calls`
calc_stream	SSE	PASS	1.3	tool: `calculate` args: `{"expression": "99 * 101"}` finish: `tool_calls`

mlx-community/Llama-3.3-70B-Instruct-4bit-DWQ

4/4 PASS

Test	Mode	Result	Time	Details
server_start	—	PASS	—	Server started successfully
weather_nonstream	sync	PASS	4.61	tool: `get_weather` args: `{"city": "Tokyo"}` finish: `tool_calls`
weather_stream	SSE	PASS	4.28	tool: `get_weather` args: `{"city": "London"}` finish: `tool_calls`
calc_nonstream	sync	PASS	4.11	tool: `calculate` args: `{"expression": "17 * 23 + 5"}` finish: `tool_calls`
calc_stream	SSE	PASS	4.41	tool: `calculate` args: `{"expression": "99 * 101"}` finish: `tool_calls`

mlx-community/functiongemma-270m-it-bf16

4/4 PASS

Test	Mode	Result	Time	Details
server_start	—	PASS	—	Server started successfully
weather_nonstream	sync	PASS	1.0	tool: `get_weather` args: `{"city": "Tokyo"}` finish: `tool_calls`
weather_stream	SSE	PASS	0.95	tool: `get_weather` args: `{"city": "London"}` finish: `tool_calls`
calc_nonstream	sync	PASS	0.97	tool: `calculate` args: `{"expression": "17 * 23 + 5"}` finish: `tool_calls`
calc_stream	SSE	PASS	0.96	tool: `calculate` args: `{"expression": "99 * 101"}` finish: `tool_calls`

mlx-community/mistralai_Devstral-Small-2-24B-Instruct-2512-MLX-8Bit

4/4 PASS

Test	Mode	Result	Time	Details
server_start	—	PASS	—	Server started successfully
weather_nonstream	sync	PASS	0.96	tool: `get_weather` args: `{"city": "Tokyo"}` finish: `tool_calls`
weather_stream	SSE	PASS	0.92	tool: `get_weather` args: `{"city": "London"}` finish: `tool_calls`
calc_nonstream	sync	PASS	1.15	tool: `calculate` args: `{"expression": "17 * 23 + 5"}` finish: `tool_calls`
calc_stream	SSE	PASS	1.07	tool: `calculate` args: `{"expression": "99 * 101"}` finish: `tool_calls`

mlx-community/Qwen3-Coder-Next-4bit

4/4 PASS

Test	Mode	Result	Time	Details
server_start	—	PASS	—	Server started successfully
weather_nonstream	sync	PASS	0.68	tool: `get_weather` args: `{"city": "Tokyo"}` finish: `tool_calls`
weather_stream	SSE	PASS	0.62	tool: `get_weather` args: `{"city": "London"}` finish: `tool_calls`
calc_nonstream	sync	PASS	0.75	tool: `calculate` args: `{"expression": "17 * 23 + 5"}` finish: `tool_calls`
calc_stream	SSE	PASS	0.71	tool: `calculate` args: `{"expression": "99 * 101"}` finish: `tool_calls`

mlx-community/GLM-4.7-Flash-4bit

2/2 PASS

Test	Mode	Result	Time	Details
server_start	—	PASS	—	Server started successfully
weather_nonstream	sync	PASS	1.63	tool: `get_weather` args: `{"city": "Tokyo"}` finish: `tool_calls`
calc_stream	SSE	PASS	0.97	tool: `calculate` args: `{"expression": "99 * 101"}` finish: `tool_calls`

mlx-community/Qwen3-30B-A3B-4bit

2/2 PASS

Test	Mode	Result	Time	Details
server_start	—	PASS	—	Server started successfully
weather_nonstream	sync	PASS	1.35	tool: `get_weather` args: `{"city": "Tokyo"}` finish: `tool_calls`
calc_stream	SSE	PASS	1.21	tool: `calculate` args: `{"expression": "99 * 101"}` finish: `tool_calls`

mlx-community/Qwen3-Coder-Next-4bit

2/2 PASS

Test	Mode	Result	Time	Details
server_start	—	PASS	—	Server started successfully
weather_nonstream	sync	PASS	0.67	tool: `get_weather` args: `{"city": "Tokyo"}` finish: `tool_calls`
calc_stream	SSE	PASS	0.7	tool: `calculate` args: `{"expression": "99 * 101"}` finish: `tool_calls`