I am not an audiophile, but I will suggest a couple things.
I do pro tapes with a duplication company that includes a COBY Walkman with each order. They are cheap and easily replaceable. I recently had a Sony dual tape deck from the 80s that died after 30 years, and I dubbed a few short run tapes on them, about 200 dubs altogether, and that was the nail in the coffin, to be honest, but in terms of playback, never had a problem. I think in this case, when the tape stopped, something wore out that the motor didn't stop,so if I didn't manually stop it, it would wear the motor... And it eventually wore out. I should have fixed that, it was a mighty loyal deck.
So... the COBY Walkman is really cheap, and has never eaten anything of mine, a couple years now, BUT it gets feedback from cell phone signals very easily, so if you are in public, you will get a loud buzzing sound when someone on their phone passes. But at home, it's not a problem. Also, if you decide to take another chance with a thrift store, again, I am no expert, but it seems to me, the heavier the better. And must be from the 80s, especially if you plan to do home dubbing. Anything in the 90s is just not meant to dub more than 150 tapes in its lifetime.
And also, I've been using CDrs since 1997, and the only ones that have worn out are those where it is black on the playable side. I don't understand the reluctance toward CDrs, aside from the likeliness that it will be labelled with sharpie marker or spray paint and whatnot. Obviously there is a bit of a sound difference between glass mastered CDs and CDrs, but I've never been able to tell the difference with one, unless it was the very cheap kind, like Verbatim...