I'm sure you're right, that it is my way of playing that's the problem.
My imp side, i did stealth with the sith assassin. I realized also that my counselor can stealth. However, I am far more efficient with mobs on those two compared to the smuggler ruffian. I was also far more efficient with the gunslinger.