The long shadow of an expense scandal is keeping members of the governing Labor Party at home.