Barbarian Outposts appear on foreign islands that your troops explore. Each Outpost defeated allows you to add one more General.
After they're defeated, they still hang around on the map taking up space. They can be moved... but not deleted.
Most players move them out of the way of the layout of their city.