yea, 4 years!
I spent last night reading over this thread and am still thinking what the answer is...
perhaps we could use new names, same 0-10 scale:
ART 0-4 for Art's sake, like awe ,but simply subjective, as in "is it? or isn't it art?". Yea, 4 points, because looks are important, and for some people this is all that matters. Of course this could get really detailed, like fit and finish, polish, details. I said details twice because this canvas has sight and sound, if it doesn't have either, then it just smells bad and no one will touch it.
Gameplay 0-4 This is what players want to know, no BS, just does it play well, well does it? Do you want to play it again? and again? well do ya? Sometimes you have to face the fact that looks aren't everything. If it doesn't play, art is for hanging on your wall or storing in a remote corner of your hard drive. True, there's no such thing as bad sex, even if it really hurts, however there's really super steaming sweet sex, and which would you rather have? Okay, if it smells bad and you won't touch it... probably never got to first base therefor gets zero play.
Merit 0-2 Only 2 points! Is the map techinically complete? Screenshot, music, sound effects, light sourcing, readme, and all the rest of the details that say "this is a finished map, now download it!". Reviewer could pop a technical detail to boost the score, like "wow. that kismet sequence was life changing!" or "the custom texture pack and meshes, absolutely incredible!". Sometimes you want to throw a mapper a bone, and some times they just need to be boned...
And there you have it., or not
Note: This is almost the same as Insite's AVA/Gameplay schema, plus a possible 2 "merit" ponts. If both sites are similar it wouldn't hurt BU IMO