The World Cup isn't designed for neutrals, although a lot do get enjoyment from it.
Esp. with the expansion, the tournament is designed to engage the nationals of the teams taking part in each respective game. Probably the Spanish, Swiss, Swedes, English etc were invested in those games.
And of course, money and influence talks, so I doubt we'll get a 'stop the clock' unless the FA's of Italy, Germany, France, England, Spain and Brazil push for it. As proponents of a bit of time-wasting, can't see it happening.