Mell: Memory-Efficient Large Language Model Serving via Multi-GPU KV Cache Management

作者: Qianli Liu, Zicong Hong, Peng Li, Fahao Chen, Song Guo