You`re assuming that those events have to happen within the time span of the game and without pockets of the empire surviving in some, perhaps unexpected way--even unrecognizable way from the point of view of people in the future. The game doesn`t have to end with genocide, in fact, I`m certain it won`t. The end of the empire can happen long after our character`s deaths from old age.