Looking Back Can Be Harmful