Every planet has different levels of mats. You better follow your class quests and other planet missions and gether your mats at the same time. It is better to level your character and crew skills simultaneously. Of course it is not necessary. Also you can send your companions to the missions and increase your skill level while gethering your mats.
um, Luxury fabrics are from Underworld Trading - a mission only crew skill