Mell: Memory-Efficient Large Language Model Serving via Multi-GPU KV Cache Management

Authors: Qianli Liu, Zicong Hong, Peng Li, Fahao Chen, Song Guo