Well...we do have no idea what Gai was like when he was a kid, for all we know, taijustu might have been the only thing he was good at until he got older.
Lee can mold chakra, just not outside his body.