Your base is cleverly concealed from outsiders. Either it looks like a perfectly ordinary building, is hidden underground, or is concealed by a perception filter.
Finding the base if you do not know it is there is almost impossible. Even if an advanced enemy is scanning for the base, the characters have several minutes to prepare before they are discovered.