Yes, that's exactly what I find irritating about this. I don't like the interruption in what I'm currently doing on a planet.
Then don't use it. It's that simple.
Bioware has stated that, as the way flashpoints are currently set up, they can't pop you back to where you were. I think they said they are looking at changing it but I don't remember for sure.