In a statement posted to social media, Pentagon spokesman Sean Parnell said Phelan was "departing the administration, effective immediately."