An overwhelming exception is an
informal fallacy of
generalization. It is a generalization that is accurate, but comes with one or more qualifications which eliminate so many cases that what remains is much less impressive than the initial statement might have led one to believe.[1]
Examples
"Our foreign policy has always helped other countries, except of course when it is against our National Interest..."
The false implication is that their foreign policy always helps other countries.
The rhetorical use of the fallacy can be used to comic effect, as in the below examples:
"All right, but apart from the sanitation, the medicine, education, wine, public order, irrigation, roads, a fresh water system, and public health... what have the Romans ever done for us!?" – Monty Python's Life of Brian
The attempted implication (fallacious in this case) is that the Romans did nothing for them.