Oamaru

Oamaru: a Victorian port town built in its own creamy local limestone.

It calls itself the steampunk capital, and has a blue penguin colony by the harbour.