New prime minister had explored raising £12,570 personal allowance before taking office on Monday