Running 7 Awesome KV Cache Optimization π 7 System-Aware KV Cache Optimization for LLM Serving [Survey]
Running 4 Reproduction: De-Linearizing Agent Traces: Bayesian Inference of Latent Partial Orders for Efficient Execution π― 4 Explore agent logs, traces and collaborate via a web logbook
Running 2 ZeroSlopβ’ KV-Cache & Diff Estimator β‘ 2 KV-Cache memory wall calculator & AST diff minimizer.
saarvajanik/facebook-opt-6.7b-gqa-ub-16-best-for-KV-cache Text Generation β’ Updated Jan 28, 2024 β’ 262 β’ 10
nintwentydo/pixtral-12b-FP8-dynamic-FP8-KV-cache Image-Text-to-Text β’ 13B β’ Updated Jan 6, 2025 β’ 274 β’ 14
open-llm-leaderboard-old/details_saarvajanik__facebook-opt-6.7b-qcqa-ub-16-best-for-KV-cache Updated Jan 28, 2024 β’ 1.17k β’ 18
Sleeping Agents 10 KVCacheSizeCalculator π 10 Calculate the required KVCache size for the Huggingface mode
Running 7 Reproduction: Effective Model Pruning : Measuring the Redundancy of Model Components π― 7 Explore research logbook and collaborate with an AI agent
open-llm-leaderboard-old/details_saarvajanik__facebook-opt-6.7b-gqa-ub-16-best-for-KV-cache Updated Jan 28, 2024 β’ 1.09k β’ 16