Skip to content

Architecture also shapes continual learning

An article published on January 17, 2026 reports that wider networks and less global average pooling may improve retention, while ResNets and WideResNets learn new tasks quickly but forget more.

By Wendelmaques ·

Source: Escolhas de arquitetura afetam o aprendizado contínuo e o esquecimento (x.com). Text prepared with AI from this source.

What happened and what to do

The article, published on January 17, 2026, compares architectures for continual learning. According to the publication, wider networks and removing or reducing global average pooling may improve retention. ResNets and WideResNets learn new tasks quickly but show more forgetting. The article emphasizes that architecture affects the balance between stability and plasticity, in addition to the continual-learning algorithm.

A company that updates models with new data or tasks could compare architectures using a sequence of tasks representative of its use case. A practical implementation could record performance at each stage, measure retention and forgetting, and display results in a dashboard to support training and deployment decisions.

How the consultancy can help

Wendelmaques can diagnose the model-update process, scope an architecture comparison, and implement the evaluation, monitoring, and dashboards needed to track retention and forgetting.

Next step

Send a short description of your case and the models you want to evaluate to receive a scoped proposal.

Looking for something else?Frequently asked questionsGuidesContact