SPIN: Accelerating Large Language Model Inference with Heterogeneous Speculative Models

Authors: Fahao Chen, Peng Li, Tom H. Luan, Zhou su, Jing Deng

Abstract

No abstract is available for this paper.

Open original