MMODELYST
Papers/Adaptive Multi-Scale Goodness Aggregation for Forward-Forward Learning
PAP

Adaptive Multi-Scale Goodness Aggregation for Forward-Forward Learning

May 11, 2026

arXiv
Abstract

We propose Adaptive Multi-Scale Goodness Aggregation (AMSGA), a novel extension of the Forward-Forward (FF) algorithm designed to improve stability, robustness, and generalization in local-learning neural networks. AMSGA addresses several limitations of the original FF framework by introducing multi-scale goodness aggregation across local, intermediate, and global representations; adaptive curriculum-guided hard negative mining; layer-dependent adaptive thresholds; and a warm-up cosine annealing learning-rate schedule for improved optimization stability. Together, these modifications strengthen the FF paradigm while preserving its biologically plausible and memory-efficient properties. Experiments on MNIST and Fashion-MNIST demonstrate consistent performance improvements over the baseline FF algorithm, achieving up to +1.45% improvement on MNIST and +1.50% improvement on Fashion-MNIST without significant computational overhead. Our results suggest that local learning methods can become substantially more competitive when goodness estimation and training dynamics are carefully designed.

Select text to highlight · click a highlight to remove · saved in this browser only
Authors
Salar Beigzad, Vansh Verma
Your notes (browser-local)
saved
arXiv:2605.18804