In Chapter 37, we hear about Cj's election and what, 62 votes as a vast majority? Some people have been surprised that there were so many survivors. I find it very low. Marcus tells Michael there are hundreds at the colony.

So, maybe the colony is down to roughly a hundred people. That is a huge number of dead. The other way to look at it is there may be 100s, but only a select few vote. Remember, the mallers kept slaves, the farm hands at the colony are treated like crap and the barkeep was even going to throw Michael out of the saloon when he goes to visit victor after waking up from surgery because laborers are not allowed here.