2023

HexGen: Generative inference of foundation model over heterogeneous decentralized environment High-throughput generative inference of large language models with a single GPU

Last updated 1 year ago