OSCAR KV Cache Compression

Research on OSCAR KV Cache Compression

Research papers include:

• Zhongzhu Zhou, Donglin Zhuang, Jisen Li, Ziyan Chen, Shuaiwen Leon Song, Ben Athiwaratkun, Xiaoxia Wu, 18 May 2026, OSCAR: Offline Spectral Covariance-Aware Rotation for 2-bit KV Cache Quantization, https://arxiv.org/abs/2605.17757 https://oscar-quantize.github.io/index.html https://github.com/ZunhaiSu/OScaR-KV-Quant (INT2 KV cache compression.)
• KiaDev, May 2026, OSCAR: Attention-Aware 2‑Bit KV Cache for LLMs, https://www.kiadev.net/news/2026-05-25-oscar-2bit-kv-cache
• Editorial Team, 25 May 2026, Together AI Open-Sources OSCAR for 2-Bit KV Cache, https://news.skrew.ai/together-ai-oscar-2bit-kv-cache-quantization/
• Chat Forest, May 26, 2026 Together AI Open-Sources OSCAR: 5× Less KV Cache Memory, Near-Zero Accuracy Loss, https://chatforest.com/builders-log/together-ai-oscar-2bit-kv-cache-quantization-llm-serving/

More AI Research Topics

Read more about:

• 500+ LLM Inference Optimization Techniques
• What's Hot in LLM Inference Optimization in 2025?
• Inference Optimization Research
• « Research Home