Yeah, it just seems like individual clans, like the orcs have the Warsong clan, Dragonmaw Clan, Blackrock clan, ect. But I guess it could be safe to say they were wiped out by Grom during his little conquest of Ashenvale behind Thrall's back, since you had to kill them off in-game.
-VGsatomi