 Xiaoze Fan
|
4f510f1ba6
|
feat(server): enable reasoning_effort on /v1/chat/completions (#2)
* feat(server): enable reasoning_effort on /v1/chat/completions
* fix(server): glm thinking-off mislabeling and reasoning_effort mapping edge cases
|
2026-08-14 00:02:32 -07:00 |
|
|
Shuo Yang
|
9dc3ff4ca5
|
Support minimax m3 (#1)
* feat(minimax_m3): serve MiniMax-M3-NVFP4 single-GPU (block-sparse GQA + MXFP8 dense + swigluoai NVFP4 experts)
|
2026-08-13 16:22:41 -07:00 |
|
|
Xiaoze Fan
|
ea5348b4e3
|
feat(kvcache): checkpoint decode state at the tool-call opener token
|
2026-08-13 18:32:02 +00:00 |
|
|
Xiaoze Fan
|
ee54f638fd
|
fix(gemma4): read head_dim / kv heads per attention type from per_layer_config
|
2026-08-13 03:57:59 +00:00 |
|
|
Xiaoze Fan
|
3af9d90ee5
|
feat: initial open-source release
Co-authored-by: Shuo Yang <andy_yang@berkeley.edu>
|
2026-08-11 22:53:25 +00:00 |
|