I'm not against having more/better tools for finding groups. But I am very much against a cross server queue/lobby function.
My reason if that I fear such a system would bring preassure to subsequently make the flashpoints trivial in difficulty. And if that happens, there will be no challenging content for casual players.
What you see in wow is that the new dungeons released are easy enough to one-shot almost all bosses in a group of complete strangers with little to no communication. Doing the same content with a group of friends is.... just not fun. No challenge whatsoever. Not the least bit interesting.
So IF a cross server "dungeon finder" system also means trivial difficulty; then YES such a system affects the people who prefers not using it as well. And for me, it's definately worth "robbing" people of that feature if that feature essentially takes away my fun. Rob them before they rob me