Correct. I was thinking more of when he used it in battle.
Okay, how about this.
He switched quickly to Spectral Realm. He turned quickly and fled through the stone wall behind him. When the booming stopped, he ran quickly back into the other chamber and switched back to Physical Realm and he quickly scaled the wall.
And then I would just continue on with my original plan.