I think he stayed back to guard the ship from the very beginning? Maybe?

Edit: This is honestly the problem with having so many main crew members. Someone ought to die next arc.