Try to stick with the standard alphanumeric characters and the ones above your number keys and you'll probably be ok.
Avoid things like <>(),.;'"\|/?
Unfortunately, that's not much help. At least some of the ones you said to avoid are OK, and some of the ones you said are OK apparently are not. Hard to tell exactly which, though, when there are multiple "special" characters in a password that gets rejected. But both my old and new passwords had characters from both lists.
Could we get an official response of exactly which ones are or are not allowed (or both)?
I managed to get it changed by just generating a bunch until I got one that worked. I could set my password program to only use acceptable characters, and avoid the frustration, if I knew which ones are (not) OK.