Xiaoze Fan ea5348b4e3 feat(kvcache): checkpoint decode state at the tool-call opener token

2026-08-13 18:32:02 +00:00

..

attention

feat: initial open-source release

2026-08-11 22:53:25 +00:00

benchmark

feat: initial open-source release

2026-08-11 22:53:25 +00:00

checkpoint

feat: initial open-source release

2026-08-11 22:53:25 +00:00

daemon

feat: initial open-source release

2026-08-11 22:53:25 +00:00

distributed

feat: initial open-source release

2026-08-11 22:53:25 +00:00

engine

feat: initial open-source release

2026-08-11 22:53:25 +00:00

kernel

feat: initial open-source release

2026-08-11 22:53:25 +00:00

kvcache

feat(kvcache): checkpoint decode state at the tool-call opener token

2026-08-13 18:32:02 +00:00

layers

feat: initial open-source release

2026-08-11 22:53:25 +00:00

llm

feat: initial open-source release

2026-08-11 22:53:25 +00:00

message

feat: initial open-source release

2026-08-11 22:53:25 +00:00

models

fix(gemma4): read head_dim / kv heads per attention type from per_layer_config

2026-08-13 03:57:59 +00:00

moe

feat: initial open-source release

2026-08-11 22:53:25 +00:00

scheduler

feat(kvcache): checkpoint decode state at the tool-call opener token

2026-08-13 18:32:02 +00:00

server

feat(kvcache): checkpoint decode state at the tool-call opener token

2026-08-13 18:32:02 +00:00

shell

feat: initial open-source release

2026-08-11 22:53:25 +00:00

tokenizer

feat: initial open-source release

2026-08-11 22:53:25 +00:00

utils

feat(kvcache): checkpoint decode state at the tool-call opener token

2026-08-13 18:32:02 +00:00

__init__.py

feat: initial open-source release

2026-08-11 22:53:25 +00:00

__main__.py

feat: initial open-source release

2026-08-11 22:53:25 +00:00

cache_report.py

feat: initial open-source release

2026-08-11 22:53:25 +00:00

cli.py

feat: initial open-source release

2026-08-11 22:53:25 +00:00

control_cli.py

feat: initial open-source release

2026-08-11 22:53:25 +00:00

core.py

feat(kvcache): checkpoint decode state at the tool-call opener token

2026-08-13 18:32:02 +00:00

env.py

feat: initial open-source release

2026-08-11 22:53:25 +00:00

launch.py

feat: initial open-source release

2026-08-11 22:53:25 +00:00

version.py

feat: initial open-source release

2026-08-11 22:53:25 +00:00