Trade-off Between Energy Consumption and Accuracy in Large Language Model Inference: A Sustainability Assessment Study

Introduction / Main Floor: Trade-off Between Energy Consumption and Accuracy in Large Language Model Inference: A Sustainability Assessment Study

This article introduces an empirical study on the relationship between energy consumption and accuracy during the inference phase of large language models, exploring how to reduce energy consumption while ensuring model performance and providing references for the development of green AI.