# Whale: Efficient Giant Model Training over Heterogeneous GPUs