KVarN: Native vLLM backend for KV-cache quantization by Huawei

Article URL: https://github.com/huawei-csl/KVarN Comments URL: https://news.ycombinator.com/item?id=48399974 Points: 127 # Comments: 13

查看原文 →

来源：Hacker News · RSS 采集