New Zealand’s only castle sits high on the spine of the Otago Peninsula.