- [H2O: Heavy-Hitter Oracle for Efficient Generative Inference of Large Language Models](https://arxiv.org/pdf/2306.14048)

https://github.com/FMInference/H2O


- [](https://arxiv.org/pdf/2310.01801)