Passing time only lasts for 10-15 minutes or so, but it’s really, really hard to turn while driving, unless you have an arrow. And even then, if the passing time mob disagrees with the walk sign, you’re stuck anyway.
Not that I know from experience or anything.