I understood Armstrong did take EPO though, as part of his post-cancer rehabilitation therapy (since chemotherapy destroys red blood cells along with many other things). That was all perfectly legal and above board, since he wasn't competing at the time, nor was he expected to compete again.
EPO doesn't hang around in the blood for very long though, so by the time he started serious training it should have been long gone, as would any performance-enhancing benefits.