Pirates used Bald Head Island as a hideaway. The pirates would watch for vessels that would run aground on the Frying Pan Shoals, and then commandeer their cargo and valuables. Pirates often traveled from New England to the Bahamas, preying upon vessels they encountered along the way. Bald Head was a favorite stopping point to refill their food supply and bury some of their loot. Black Beard among others often used this island paradise as a hideaway. Many of the streets on the island, today are named after the famous pirates that frequented these waters.

Civil war troops were stationed to deny access to approaching ships into the Cape Fear River Inlet. On the island there is a fort that was used for many years by the civil war troops.

At one time many wild pigs roamed the island and were dangerous to inhabitants. Hunters were brought in from neighboring towns to capture and destroy the wild boars.