Learning slowly, but surely