Cloud-Edge Collaboration

No active maintenance.

Framework

• Walle: An End-to-End, General-Purpose, and Large-Scale Production System for Device-Cloud Collaborative Machine Learning (OSDI 2022) [Paper] [Code] [中文官网]

  • Alibaba

  • Production system; support for collaborative ML; optimized for mobile devices.

Automatic Graph Partitioning

• SPINN: Synergistic Progressive Inference of Neural Networks over Device and Cloud (MobiCom 2020) [Paper]

  • Samsung AI Center & Cambridge

  • Early-exit; split CNNs at runtime.

• Dynamic Adaptive DNN Surgery for Inference Acceleration on the Edge (INFOCOM 2019) [Paper]

  • PolyU & Sydney

  • DNN surgery: Consider different network conditions; characterize DNNs as DAG rather than a chain.

• Distributed Deep Neural Networks Over the Cloud, the Edge and End Devices (ICDCS 2017) [Paper] [Code]

  • Harvard

  • DDNN: Distribute DNN across the cloud, the edge and end devices.

• Neurosurgeon: Collaborative Intelligence Between the Cloud and Mobile Edge (ASPLOS 2017) [Personal Notes] [Paper]

  • UMich

  • At the granularity of NN layers; select one partition point.