Hyper-Parameter Tuning (HPO)

No active maintenance.

Optimizing HPO Workloads

Hydro: Surrogate-Based Hyperparameter Tuning Service in Datacenters (OSDI 2023) [Paper] [Code]
- NTU & Shanghai AI Lab
- Surrogate models; co-locate HPO jobs with LLM training.
Elastic Hyperparameter Tuning on the Cloud (SoCC 2021) [Paper]
- UC Berkeley
- SEER
RubberBand: Cloud-based Hyperparameter Tuning (EuroSys 2021) [Paper]
- UC Berkeley

Morphling: Fast, Near-Optimal Auto-Configuration for Cloud-Native Model Serving (SoCC 2021) [Paper] [Code]
- HKUST & Alibaba
- Meta-learning for tuning resources and runtime parameters in model serving systems.
Selecting the Best VM across Multiple Public Clouds: A Data-Driven Performance Modeling Approach (SoCC 2017) [Paper]
- UC Berkeley & FAIR & MSR
- Select the best VM across multiple cloud providers.
CherryPick: Adaptively Unearthing the Best Cloud Configurations for Big Data Analytics (NSDI 2017) [Paper]
- Yale & MSR & UC Berkeley & Alibaba
- Pick the right cloud configuration for big data analytics jobs.
Google Vizier: A Service for Black-Box Optimization (KDD 2017) [Paper]
- Google
- Black-box optimization.

Last updated 2 years ago