how polished the map is is the first thing i think of for a good orpg. if anyone ever played elemental rpg before, the concept is good, but the effort is pretty bad.
i want an rpg where you don't have to grind for hours for get 1 level.
i like teamwork in an rpg, so that you can't just solo everything.
really good items, well thought out and balanced items.
good heroes, not too many. try not to use like dh, or bm as hero models.
abilities, i personally like how defiance or imagica rpg(
The Imagica RPG v3.8 - Warcraft 3 Maps - EpicWar.com) have their abilities. you really have to strive to get them. however, i like abilities to be really well designed and executed.
quests, good quests and a storyline people will actually do.
things that make it stand out. i.e TKoK shows how much dmg you do everytime, has custom models, and has a unique thing for equipment. what makes it stand out also, is how well it is made. tbr had a secondary class thing where you can make pots, or become a weaponsmith.
the final good trait of a great rpg, it hooks you. you can't stop playing the rpg. when you play wc3, you want to host the map and play with teamates again to kill better bosses, get better items, get more levels, etc. and what really hooks you, imo, is a great base for an rpg, and secondly, custom stuff that you wouldn't find in other rpgs.