I've been in to that sort of stuff since also reading Robert Anton Wilson, Kerry Wendell Thornley, Subgenius stuff, etc. in junior high school but for some reason I can never remember details about any of the stuff I've read. It just exits my brain as soon as I'm done reading it. I've only recently come to understand KWT's "Step-Brother" thing, despite having read his explanations over and over again.
I have the same problem with horribly bad science-fiction novels. I really enjoy reading them, but when I'm finished one, don't ask for a detailed account of what I just read.