I've been having this same issue. I always had this key set to talk on ventrilo, now I got it to Caps Lock, but every now and then I hit it in the middle of a warzone and it takes at least 3 clicks to close, so it's really annoying.
Maybe in the future they'll let us disable it, I really hope so.