Hyper-Parameter Tuning (HPO)

No active maintenance.

Optimizing HPO Workloads

• Hydro: Surrogate-Based Hyperparameter Tuning Service in Datacenters (OSDI 2023) [Paper] [Code]

  • NTU & Shanghai AI Lab

  • Surrogate models; co-locate HPO jobs with LLM training.

• Elastic Hyperparameter Tuning on the Cloud (SoCC 2021) [Paper]

  • UC Berkeley

  • SEER

• RubberBand: Cloud-based Hyperparameter Tuning (EuroSys 2021) [Paper]

  • UC Berkeley

HPO for Systems

• Morphling: Fast, Near-Optimal Auto-Configuration for Cloud-Native Model Serving (SoCC 2021) [Paper] [Code]

  • HKUST & Alibaba

  • Meta-learning for tuning resources and runtime parameters in model serving systems.

• Selecting the Best VM across Multiple Public Clouds: A Data-Driven Performance Modeling Approach (SoCC 2017) [Paper]

  • UC Berkeley & FAIR & MSR

  • Select the best VM across multiple cloud providers.

• CherryPick: Adaptively Unearthing the Best Cloud Configurations for Big Data Analytics (NSDI 2017) [Paper]

  • Yale & MSR & UC Berkeley & Alibaba

  • Pick the right cloud configuration for big data analytics jobs.

• Google Vizier: A Service for Black-Box Optimization (KDD 2017) [Paper]

  • Google

  • Black-box optimization.

Acronyms

• HPO: Hyper-Parameter Tuning