Built by the French to fight off the British during the colonial era, The Fort des Oliviers (or rather, what remains of it) is a spectacular, picture-perfect ruin overlooking the Caribbean sea. If you happen to be visiting in August, you’re in luck! The Fort des Oliviers is where the locals celebrate the five-day Mermaid Festival at the end of summer.