MMODELYST
People/Xupeng Miao
PPL

Xupeng Miao

Papers (2)
SpecInfer: Accelerating Generative Large Language Model Serving with Tree-based Speculative Inference and VerificationCoral: Cost-Efficient Multi-LLM Serving over Heterogeneous Cloud GPUs