ATC 2023

Meta Info

2023 USENIX Annual Technical Conference

Homepage: https://www.usenix.org/conference/atc23

Paper List: https://www.usenix.org/conference/atc23/technical-sessions

Papers

Mixture of Experts (MoE)

• Accelerating Distributed MoE Training and Inference with Lina

• SmartMoE: Efficiently Training Sparsely-Activated Models through Combining Offline and Online Parallelization

GPU Fragmentation

• Beware of Fragmentation: Scheduling GPU-Sharing Workloads with Fragmentation Gradient Descent