For the complete documentation index, see llms.txt. This page is also available as Markdown.

Whale: Efficient Giant Model Training over Heterogeneous GPUs

Distributed training framework for large models.