It's up to you actually. Some prefer having 24 guilds, some prefer having 0 guilds (not very clever). Build the amount you want. Personally, I'll go for 5 spy attack buildings.