Skip to content

[V1] Move more control of kv cache initialization from model_executor to EngineCore#11960

Merged
comaniac merged 22 commits intovllm-project:mainfrom heheda12345:v1_kv_initJan 17, 2025
+515-104

Commits

Commits on Jan 11, 2025

Commits on Jan 14, 2025

Commits on Jan 16, 2025

Commits on Jan 17, 2025