Your memory is a monster; you forget - it doesn't. It simply files things away. It keeps things for you, or hides things from you - and summons them to your recall with a will of its own. You think you have a memory; but it has you!
Heaven knows that there are plenty of opportunities in later life, too, for being carried away. What of it? We remain what we are and, no doubt, it is all very good for us!