While the former PM still has some admirers in Labour, others wings of the party are not listening.