Collaborative Large Model Inference in LEO Satellite Networks: A New Scheme to Break Through On-Board Resource Constraints

Introduction / Main Floor: Collaborative Large Model Inference in LEO Satellite Networks: A New Scheme to Break Through On-Board Resource Constraints

This paper proposes a communication-efficient collaborative inference scheme for Low Earth Orbit (LEO) satellite networks. Through model partitioning, pipeline parallelism, and adaptive activation compression, it achieves significant results: a 42% reduction in inference latency and a 71% decrease in communication overhead, while maintaining an accuracy loss of less than 1%.