| # | Test | Group | Status | Duration | Details |
|---|---|---|---|---|---|
| 1 | Same seed (42) produces identical output 3x | Seed | PASS | 0.8s | 3 identical: Mango |
| 2 | Different seeds (10 seeds) produce variation | Seed | PASS | 2.3s | >1 unique out of 10 |
| 3 | No seed produces varied output | Seed | PASS | 1.2s | >1 unique out of 5 |
| 4 | temp=0 is deterministic (argmax) | Temperature | PASS | 0.7s | 3 identical: 4 |
| 5 | temp=0.8 + seed=777 produces valid output | Temperature | PASS | 0.5s | r1=8, r2=8 |
| 6 | top_k=1 is deterministic (like argmax) | Top-K | PASS | 0.7s | 3 identical: 4 |
| 7 | top_k=1 and top_k=1000 both produce output | Top-K | PASS | 0.5s | k=1:Blue! 😊, k=1000:Blue! 💙 |
| 8 | top_p=0.5 + seed=42 is deterministic | Top-P | PASS | 0.5s | identical: Mars! 😊 |
| 9 | top_p=0.1 and top_p=1.0 both produce output | Top-P | PASS | 0.5s | p=0.1:Blue! 😊, p=1.0:Blue! 💙 |
| 10 | min_p=0.05 + seed=42 produces valid output | Min-P | PASS | 0.5s | r1=7, r2=7 |
| 11 | min_p=0.99 and min_p=0.0 both produce output | Min-P | PASS | 0.5s | m=0.99:Blue! 😊, m=0.0:Blue! 💙 |
| 12 | presence_penalty=0 vs 2.0 produce different results | Presence | PASS | 0.6s | different |
| 13 | presence_penalty=1.5 + seed=42 produces valid output | Presence | PASS | 0.5s | r1=6, r2=6 |
| 14 | rep_penalty=1.3 + seed=42 produces valid output | Repetition | PASS | 0.5s | r1=7, r2=7 |
| 15 | rep_penalty=1.0 and 1.5 both produce output | Repetition | PASS | rp=1.0:Pizza! 🍕, rp=1.5:Pizza 😄 |
|
| 16 | All params + seed=42 is deterministic | Combined | PASS | 0.5s | identical: London! |
| 17 | Streaming with all params works | Combined | PASS | 0.3s | SSE data received |
| 18 | Log line contains all new params | Combined | PASS | 0.8s | top_k, min_p, presence_penalty, seed in log |
| 19 | top_k=0 (disabled) produces output | Edge | PASS | 0.3s | Yes. |
| 20 | presence_penalty=0 (disabled) produces output | Edge | PASS | 0.2s | Yes. |
| 21 | No sampling params (all defaults) works | Edge | PASS | 0.3s | Hello there! How can |