A postscript to the Castle Pinckney article in the National Parks Traveler noted that two other US castle forts were built and still remain in New York Harbor. They were part of the New York harbor Defense system and completed about the same time.
Castle Williams was completed in 1811 on Governor's Island, a strategic location between Lower Manhattan and Brooklyn. It can be visited at Governor's island National Monument.
The other castle fort was also completed in 1811 and is at nearby Castle Clinton National Monument in lower Manhattan's Battery Park.
My Kingdom for a Castle. --Old B-R