You mean the bonus would go zero if you remove the gloves? Well... Interesting theory. If you have something other in mind, please enlighten me.
You know, as I was playing a funny thing happened. I had +3 steel gloves and was absolutely destroying everything in my path until Rondol came along and spanked the living shit out of me without taking a scratch. However, against just about everything I came up against I was ripping arms, legs and heads off like there was no tomorrow. It occurred to me that, with a more tactical approach unarmed could probably be extremely useful, but I still don't haven't tested enough to be able to verify its usefulness. For example, I'm not sure if the +X bonuses to your gloves affect your unarmed damage, if a heavier gauntlet does more damage than a lighter one regardless of AC (bronze > adamantite?) and I wasn't even paying much attention to how well I ended up parrying either. What I do know is that I wasn't doing so hot against carnivorous plants, but anything with detachable limbs didn't last very long against me (except the aforementioned Rondol, of course).
I'm gonna keep playing around with unarmed to see what kind of results I can get, but so far it's looking like it can be a lot more impressive than I originally thought. If you want to get a good look at just how damn impressive it can be get yourself an angel and strip it of its equipment. Force it not to change its gear and you'll end up with a buzzsaw that can rip through just about anything in a few hits. You might also want to try putting some heavy mitts, a decent cape and armor on him and see what you can do with it.
Back to the topic at hand though: Nefas. Drunken boxing. I WISH.