There is also a pole closer to the substation which is carrying the power for 5000 people.
Meanwhile if four of the eight people near your house decide to disconnect from the grid because the fixed fee is too high, you still have to cover the cost of that pole with half as many people, some of whom might then decide that the higher fixed fee is too much and disconnect too, etc.
