This strictly depends on whose releases we're talking about. I realize that the topic says noise releases specifically, but I'll assume that that includes all of the usual suspects falling under the greater industrial noise umbrella, i.e., PE, death industrial, etc.
Power electronics and death industrial are easy for me, and I would wager are for most avid listeners, because much of both has something conventionally distinctive about it: vocals and (at least a loose) structure, not to mention the frequent inclusion of synthesizer tones that aren't necessarily "noise" by the strictest definition. I know most early Whitehouse albums front to back, for example, and noone's gonna forget "show me your fucking titties!" with the hard Ts from Sutcliffe Jugend's The Victim as Beauty. Then there's Prurient, who, depending on the album, makes brilliant use of melodic, analog synth lines that are frankly unforgettable.
I know those things aren't really what the question's getting at, though, so when it comes to noisy-ass noise proper, it depends on the artist. For example, Merzbow I tend to remember in terms of mood, technique, and sonics: I remember Venereology as "the chaotic, organic, relentlessly harsh one", Pulse Demon as "the blown-out/bassy, multi-layered/complex, cut-up one", and 1930 as "the moody, unconventional (for Merzbow at the time), heavily loop-based one". Merzbow is a singular example though, being especially evocative of different moods for me, and I can't necessarily say the same for every noise artist.
That being the case, harsh noise wall records I tend to associate mostly with texture and dynamic (or lack thereof): The Rita's Magazine and The Cherry Point's Night of the Bloody Tapes are on the more dynamic end of the spectrum, with the former abruptly shifting wall textures mid-track, and the latter burying sub-textures beneath the monolithic overtones. In fact, I associate Sea Wolf Leviathan and Thousands of Dead Gods with the same buried, gestural sub-noise. Vomir, obviously, is on the other end, with the most impenetrable, unvarying, oppressive noise walls that you can make. They do vary significantly from record to record, however, but Vomir for me has a distinct enough sound that I simply remember his albums as exactly that: Vomir. These three projects also illustrate something that I find that I do when it comes specifically to HNW, which is recalling albums by dominant frequencies, rather than simply texture. For example, The Cherry Point tends to have a lot of highs and high-mids, the Rita leans toward mids and low-mids, and Vomir is brutally low-mid and low end.
All of that being said, I do think that there's something to the notion of noise and heavily noise-based albums being some degree of novel every time you put them on, and therein lies a big part of the magic for me.