Collaborative Large Model Inference in LEO Satellite Networks: A New Solution to Break Through On-Satellite Resource Constraints

This paper proposes a communication-efficient collaborative inference scheme for LEO satellite networks. Through three core technologies—model partitioning, pipeline parallelism, and adaptive activation compression—it achieves significant results: 42% reduction in inference latency and 71% decrease in communication overhead, while keeping the accuracy loss below 1%. This effectively breaks through the memory, power, and communication resource constraints of a single satellite, opening up a new path for on-board intelligent computing.

LEO satellites play a key role in intelligent Earth observation (environmental monitoring, disaster early warning, etc.), but a single satellite faces three major resource constraints:

1. Memory Limitation: On-board computing units have only a few GB to tens of GB of memory, making it difficult to host modern large language models;
2. Power Constraint: Solar power supply limits computing output;
3. Communication Bottleneck: Inter-satellite link bandwidth is limited and latency is high. The traditional scheme of transmitting data back to the ground for processing introduces significant latency, weakening the advantage of real-time processing.

The core strategy is collaborative inference that breaks the whole into parts, combined with three technical optimizations:

1. Model Partitioning: Split the large model into sub-models deployed on multiple satellites; input data passes through each sub-model in sequence to complete inference, breaking through the memory bottleneck of a single satellite;
2. Pipeline Parallelism: Overlap computation and communication processes to hide inter-satellite transmission latency and improve system throughput;
3. Adaptive Activation Compression: Dynamically adjust the compression ratio based on layer importance, accumulated error, and input content to balance accuracy and communication efficiency;
4. Joint Optimization: Convert the selection of model partition points and compression ratios into a shortest path problem in a directed acyclic graph, and find an approximate optimal solution using an improved A* algorithm.

Results from large-scale simulation verification:

• Latency Optimization: End-to-end inference latency is reduced by 42% compared to the baseline scheme;
• Communication Overhead: Adaptive compression reduces inter-satellite communication overhead by 71%;
• Accuracy Preservation: Inference accuracy loss is strictly controlled within 1%, achieving a balance between efficiency and quality.

This scheme has important strategic significance:

1. Real-Time Earth Observation: Supports on-satellite local processing of large models, meeting the needs of time-sensitive applications such as disaster response;
2. Space-Ground Integration: Extends edge computing to space, laying the foundation for 6G and space-air information networks;
3. Cross-Scenario Promotion: Can be applied to resource-constrained distributed environments such as drone swarms and ocean-going ship networks.

Current research limitations: Based on simulation verification, real satellite platform deployment faces engineering challenges such as space radiation and energy management, and the high-speed movement of satellites leads to dynamic changes in network topology. Future directions:

• Explore joint training methods for model partitioning and compression;
• Study reinforcement learning-based dynamic scheduling strategies to adapt to network changes;
• Develop fault-tolerant mechanisms to handle satellite failures or link interruptions.