The future of the Duchess of Sussex's trip with her little ones is up in the air.