@irontoenail - I guess the ovaries and the testes are probably the same organ that is simply made to perform different functions in women and men, so that makes sense that they can both produce testosterone.
I know that one of the things people do when they want to change their biological gender is start taking more testosterone or blockers that stop its effects.
I guess eventually some of them might even cut off their testes (or remove their ovaries? I'm not sure if they ever do that though). With surgery of course, although I've heard very sad stories where people are driven to do it themselves when they can't afford the surgery.
In theory, having the testes removed would stop them from having to constantly take so many pills, as well as change their appearance.