Artificial Neural Networks Reap the Benefits of Sleep: Off-line Training Mitigates ‘Catastrophic Forgetting’

Artificial Neural Networks learn better when they spend time not learning at all

Summary: \”Offline\” periods in AI training reduced \”catastrophic remembering\” in artificial neural network, mimicking sleep’s learning benefits in the brain.

Source: UCSD

Humans need between 7 and 13 hours of sleep every 24 hours, depending on their age. During sleep, many things happen: The heart rate, the breathing, and the metabolism fluctuate; hormones adjust, and the body relaxes. The brain is not affected as much.


Artificial Neural Networks Learn Better When They Spend Time Not Learning at All