Ctrlk
For the complete documentation index, see llms.txt. This page is also available as Markdown.

Spot Instances

  • SpotServe: Serving Generative Large Language Models on Preemptible Instances (ASPLOS 2024) [Personal Notes] [Paper] [Code]

    • CMU & PKU & CUHK

  • Can't Be Late: Optimizing Spot Instance Savings under Deadlines (NSDI 2024) [Paper] [Trace]

    • UC Berkeley

    • Outstanding Paper

  • Parcae: Proactive, Liveput-Optimized DNN Training on Preemptible Instances (NSDI 2024) [Paper] [Slides] [Code]

    • CUHK & ByteDance & CMU & UCLA & Microsoft

Last updated