Surprise in ANN

A new paper in Neural Networks describes integrating the concept of surprise from information theory with ANN learning. It's an interesting idea that I've only seen once or twice before (a colleague at Otago University has investigated something similar for a different kind of neural network). It also makes sense - things that are surprising to people are more strongly remembered (they stick in your mind, which is the same as learning them well). I'll be looking at integrating this concept into some of my own work.