Federal prosecutors say rushed contractor work, not vandalism, caused damage leading to charges against an Olympian