Effect of stadiums discarded Tempest Dive not leaving until another stadium is played

Danger-Liam

So far I've seen this happen with Collapsed Stadium and Path to the Peak.

For example, I cleared Collapsed Stadium and for the next two turns the bench was still 4 cards until Path was played. At which point benches went back to 5. But when Path was then discarded and Luminion was played next turn I wasn't able to use the Ability.