You've got three options, yeah? You try to bring everyone under your banner voluntarily, but then you have to deal with the people who won't come, and figure out how to enforce your control the people who do. You could also try to do it by force, and deal with rebellion, with lack of loyalty, with fights against you.

[Those are two of the three options. The third is not trying at all.]