Ctrlk
For the complete documentation index, see llms.txt. This page is also available as Markdown.

2023

HexGen: Generative inference of foundation model over heterogeneous decentralized environmentHigh-throughput generative inference of large language models with a single GPU

Last updated