I've been watching Naruto now for a bit, but I don't recall ever seeing how they got wiped out.

I have a feeling Sasuke's brother was the cause or reason, but I'm not sure.

Someone enlighten me?