One option is to have a small 12V setup (400 watts at max, probably) and a larger 24V or 48V setup. If you have sensitive electronics like radios, having a dedicated 12V can be nice in case a 12V buck converter is noisy. The buck converter will always also draw some current (not sure how much).
But, if nothing is sensitive and the idle current + efficiency loss is not a problem, I'd go with higher voltages and a buck converter if you want to go that way.
Bigger charge controllers usually draw more at idle. You also will have a better idea of what you want by the time you want to grow the setup. I understand the logic in wanting to get a bigger one to grow (I did that, too), but in the end it seemed a bit overkill.
Also consider checking Ebay for used charge controllers. Can be a gamble, or can save some. If your panels are close by, you could save a ton of money by doing them in parallel and getting a 30A PWM charge controller. Then saving up towards a bigger 48V system that would be better for higher loads, especially inverters.