Maybe all of that took place in the other place? Maybe he went through to a different universe the first time?