I've been thinking about it. And I actually thin he'll be fine, but not until Shanks knows hes there and word spreads that Luffy'e crew is there. Shanks has a huge fleet and tons of guys and ships so he can probably have security for anyone who knows him. I'm guessing Luffy will be welcomed by him when they get there.