Japan's Prime Minister Shigeru Ishiba says he won't step down, despite a major setback in upper house elections that's fueling dissent within his own party.