the fort aspect is less about protecting from attack and more to control the goods stored and traded. Much like any store you don't want people to be able to walk in from any direction and take stuff.