Sea is liquid so seastone can't be in there in overly high concentrations. It could be that falling into an ocean saps their strength far slower, and the inability to swim is a separate matter altogether, like a second weakness in addition to the seastone allergy.