Replacing Traditional CPU Branch Prediction with Machine Learning: An Innovative Experiment That Disrupts Hardware Architecture

ML-branch-predictor is an open-source project developed by Anurag Raj and Aditi Chauhan, aiming to replace the traditional CPU's 2-bit saturating counter branch predictor with the XGBoost machine learning model. By intercepting execution traces using the Intel Pin tool, training the AI model, and translating it into pure C++ code, it achieves a prediction accuracy of 95.18% on adversarial test loads—significantly outperforming the traditional hardware solution's 71.12%—and brings disruptive ideas to CPU architecture design.

Traditional CPU branch predictors, represented by the 2-bit saturating counter, record branch history via a four-state machine (strong not taken, weak not taken, weak taken, strong taken). Their advantages are simple hardware implementation and low latency, but they have three major limitations: limited state capacity (only captures short-term history), vulnerability to adversarial attacks (easily deceived by periodic code), and hardware aliasing issues (interference caused by different branches mapping to the same counter), leading to a sharp drop in performance under complex or malicious loads.

The project builds a complete AI prediction pipeline consisting of five stages: 1. Execution trace capture: Use Intel Pin to record PC values, target addresses, whether a backward jump occurs, an 8-bit local history window, and actual jump results; 2. Time-series data partitioning: Split into 80% training / 20% testing in chronological order to avoid data leakage; 3. XGBoost training: Learn on 2.78 million branch records, achieving 99.97% accuracy on the Python test set; 4. Model translation: Use a custom m2cgen tool tool to convert the model into a dependency-free pure C++ header file; 5. Hardware simulator comparison: Replay traces in a bare-metal C++ simulator to compare the two predictors.

The experiment was tested on the adversarial load beast_target.cpp (containing traps such as modulo 3, modulo 2, linear congruential generators, etc.), and the results are as follows:

Predictor Type	Running Environment	Accuracy
Traditional 2-bit saturating counter	Bare-metal C++ simulator	71.12%
XGBoost AI model	Python (after time-series partitioning)	99.97%
Translated AI model	Bare-metal C++ simulator	95.18%

Even with a slight drop in accuracy after translation, the AI predictor still outperforms the traditional solution by 24 percentage points, especially performing outstandingly in adversarial scenarios (the weak link of traditional predictors).

The key to the AI model's superiority over traditional solutions lies in the 8-bit local history window. The traditional 2-bit counter only records rough recent tendencies, while the 8-bit window records the last 8 execution sequences of the branch, providing rich temporal context. XGBoost can identify complex periodic patterns (such as the "not taken, not taken, taken" cycle of i%3==0), which traditional counters cannot predict stably due to state limitations, whereas the AI can achieve near-100% accuracy.

The project provides a Streamlit web interface that supports: real-time compilation and testing of custom C++ code, quick inference by uploading branch trace CSV files, scrolling charts to compare the accuracy of the two predictors, and analysis of branch distribution heatmaps and history tables. This platform lowers the threshold for experiments and helps researchers intuitively explore the impact of code patterns on predictor performance.

The current solution has limitations: 1. Latency issue: The nested if-else structure in the translated C++ code may introduce unacceptable prediction latency, requiring ASIC design for parallel evaluation of decision trees; 2. Storage overhead: Maintaining an 8-bit history for each branch point requires additional registers/SRAM; 3. Generalization ability: Need to verify performance on real-world loads (such as SPEC CPU benchmarks). Future directions include embedding ML into CPU microarchitecture and hardware co-design with the popularization of AI accelerators.

The ML-branch-predictor project demonstrates the power of interdisciplinary innovation (machine learning + computer architecture + system programming), challenging decades-old hardware design traditions. It proves that mature fields can also achieve breakthroughs through new perspectives and tools, making it a valuable resource for developers interested in CPU microarchitecture, ML systems, or hardware-software co-design.