Didn't Blackbeard's crew used to have a woman in it from Impel Down?
Yeah, the big nose lady.
Blackbeard's crew doesn't seem to all be hanging out together. Some are with Blackbeard fighting Law. Some are on the island. She could be with either group. Or even doing something else entirely.