4 Commits

Author	SHA1	Message	Date
Shuo Yang	9dc3ff4ca5	Support minimax m3 (#1) ... * feat(minimax_m3): serve MiniMax-M3-NVFP4 single-GPU (block-sparse GQA + MXFP8 dense + swigluoai NVFP4 experts)	2026-08-13 16:22:41 -07:00
Xiaoze Fan	ea5348b4e3	feat(kvcache): checkpoint decode state at the tool-call opener token	2026-08-13 18:32:02 +00:00
Xiaoze Fan	ee54f638fd	fix(gemma4): read head_dim / kv heads per attention type from per_layer_config	2026-08-13 03:57:59 +00:00
Xiaoze Fan	3af9d90ee5	feat: initial open-source release ... Co-authored-by: Shuo Yang <andy_yang@berkeley.edu>	2026-08-11 22:53:25 +00:00