SaANN: Building a Self-Automated Artificial Neural Network from Scratch to Deeply Understand MLP Architecture Principles

SaANN (Self-automated Artificial Neural Network) is an open-source project that implements a multi-layer perceptron (MLP) from scratch. It aims to help developers deeply understand the internal working principles of neural networks—including forward/backward propagation, activation functions, and optimization strategies—by avoiding framework abstractions. This project is ideal for those who want to transition from API users to engineers with a solid grasp of deep learning fundamentals.

In an era of mature frameworks like PyTorch/TensorFlow, why start from zero? SaANN answers: true understanding comes from hands-on construction. When using model.fit(), questions like "how are gradients calculated?" or "how do activation functions affect learning?" can only be fully answered by diving into code. For ML learners, building from scratch is a milestone—signaling a shift from API user to principle-aware engineer. SaANN serves as both a teaching tool and an extensible base framework.

SaANN implements a classic MLP with input, hidden, and output layers. Layers are fully connected, with weights (signal strength) and biases (activation threshold) for each neuron. SaANN's design is modular and configurable: network layers, neuron counts, and activation functions can be adjusted flexibly, making it adaptable to different tasks/datasets.

Forward Propagation: Converts input to output via linear transformations (z = sum(w_i x_i + b) ) and non-linear activation functions (Sigmoid, Tanh, ReLU). Output layer activation depends on task type (e.g., Softmax for multi-class classification). Backward Propagation: Uses chain rule to compute parameter gradients from prediction errors, then updates weights to minimize loss. SaANN implements full backprop and optimization strategies like SGD with momentum, helping users understand gradient flow and debugging.

Loss Functions: Task-dependent—MSE for regression, cross-entropy for classification (binary/multi-class). Training: Iterative process (forward → loss → backward → update). Key hyperparameters:

• Learning rate: Controls update step size (SaANN supports decay).
• Batch size: Balances noise and stability.
• Epochs: Early stopping prevents overfitting.
• Initialization: Xavier/Glorot init stabilizes signal propagation.

SaANN reduces manual work via:

1. Auto Architecture: Suggests layers/neurons based on data/task (user can override).
2. Adaptive Learning Rate: Adjusts if loss stagnates or spikes.
3. Auto Preprocessing: Normalizes data, encodes categorical features automatically. These features make SaANN both a teaching tool and a practical prototyping framework.

Use Cases:

• Education: Demo neural network principles (teachers/students).
• Small Projects: Fast prototyping for simple tasks with small datasets.
• Research: Experiment with new ideas before migrating to high-performance frameworks. Tips: Start by reading code → run examples → modify to experiment (e.g., add new activation functions).

SaANN highlights that deep learning's core lies in forward/backward propagation and gradient descent. For AI developers, building from scratch fosters intuition—critical for solving complex problems. SaANN bridges the gap between API usage and deep understanding, reminding us to prioritize foundational knowledge amid fast-evolving tech trends.