You use an action to speak the command word that dismisses it, which works only if the fortress is empty.