Fair warning: One weekend in this former fishing village may convince you to retire here.