The global event is one of a number of major sporting events where the U.S. president has bummed out crowds