On some level, I like everything up through Red Mecca 1981, which strikes me as the second of two transitional albums. Then, for me, the albums get really patchy up through The Covenant 1985. I'm an album person, so I don't bother with anything after Red Mecca.
Cabaret Voltaire - Methodology '74-'78 Attic Tapes - a great collection of edits and ideas - if something between P16.D4 and a cold wave Clock DVA sounds like a good idea, here you go. Definitely some proto-power-electronic stuff happening. Great headphone music.
Cabaret Voltaire - Mix-Up 1979 - jagged and difficult, but good, especially the back end of the album.
Cabaret Voltaire - The Voice Of America 1980 - really interesting, jagged album that is clearly a transition from experimentalism into finding a new sound and integrating much more accessible ideas - good album and recommended.
Cabaret Voltaire - Three Mantras 1980 - two 20-minute tracks - really good album - could be mistaken for a krautrock album - nice Arabic influence on "Easter Montra" - recommended, thought the 2nd track can get annoying at times.
and yeah, listen to Clock DVA and that lineage.