Garden Key's Fort Jefferson was built as a deterrent but was never finished. The fort was primarily used as a prison for Confederate prisoners and Union deserters (as well as Dr. Mudd who lent aid and comfort to John Wilkes Booth after he assassinated President Lincoln). This circa 1950 image shows the remains of the barracks at the fort. The image is from the Louise White Collection at the Florida Keys History Center.