MMODELYST
People/Zhihao Zhang
PPL

Zhihao Zhang

Papers (1)
SpecInfer: Accelerating Generative Large Language Model Serving with Tree-based Speculative Inference and Verification