Arrow - Spoilers galore

Scorpius the Allfather said

So if there's no return from where Oliver is then how does the Monitor leave that place?

Click to expand...

I would guess it has more to do with the deal he made with The Monitor, not a physical impossibility.