Spot Instances

• SpotServe: Serving Generative Large Language Models on Preemptible Instances (ASPLOS 2024) [Personal Notes] [Paper] [Code]

  • CMU & PKU & CUHK

• Can't Be Late: Optimizing Spot Instance Savings under Deadlines (NSDI 2024) [Paper] [Trace]

  • UC Berkeley

  • Outstanding Paper

• Parcae: Proactive, Liveput-Optimized DNN Training on Preemptible Instances (NSDI 2024) [Paper] [Slides] [Code]

  • CUHK & ByteDance & CMU & UCLA & Microsoft