Acm Sosp 2024. Efficient distributed prompt scheduling for llm serving. Vikranth srivatsa*, zijian he*, reyna abhyankar, dongming li, yiying zhang (* equal.
The annual acm symposium on op. Daniel berger, microsoft azure and university of washington.
Acm Sosp 2024 Images References :