Well, Wiles (and Crazy Canuck) the issue is that that threshold isn't currently concrete, but this is not the only time I've seen data like this, as they mention the plural, "journals" here:
What's more, studies of these phytoestrogens in leading peer-reviewed medical journals suggest that even lower doses—such as the amount in the 25-gram soy protein target cited by the FDA—have the potential to wreak hormonal havoc.
A simple 32 oz of soy milk has about 24 grams of protein, and add in what D Bergy mentioned, that it's a filler in many foods (baked goods, cereals, packaged items, it's in a lot of places) and it's not hard to fathom that you're dancing towards, near, or past that "threshold" which we have to acknowledge, is different for everyone (Price was a bit more sensitive to the phytoestrogens than many males)....
Yes, moderation will curtail these effects, but the fact that 25-50 grams can make a difference has at least me saying I don't want to go much past 10 or 15 at most.
I've been avoiding it or limiting it to what I can just because I know what estrogens in the male body do, but that has a bit more to my with my "lifestyle" than the average male may desire. The problem is though, as I said, it's not just about man breasts and muscle gains, it's about male health, mental, physical, the fact that almost any guy wouldn't mind being a bit leaner suggests to me the relevance is broader than just athletes, and estrogen offsets the fat-fighting testosterone. These effects are pretty broad, once you learn the mechanisms and responsibilities at play, even in women (there are upper limits that estrogen should reach in females too, as they need some testosterone and hormonal balance is critical). The soy of today is very different than the soy of 100 years ago, as well.
It's just fire I'd rather not play with, personally.