News | Forum | People | FAQ | Links | Search | Register | Log in
·~¤ THE QUAKE AWARDS 2018-19 ¤~·
Hey guys.

I've started to organize some awards for our community. I've made a website over at http://www.quakeawards.com. Head on over and have a poke around.

In 13 days the nominations will open for all non beta maps released in 2017. There are a number of categories for maps, as well as a people's choice award.

Cheers,

Shamblernaut
First | Previous | Next | Last
So... 
...may one vote if one hasn't played ALL maps released in 2017 yet? I did play most of them up to early October, there's one that stands out quite tall above the rest IMHO and I highly doubt it's gonna get dethroned by a late map. 
I Think You're Good To Go ;) 
I've only played six (!) maps from early 2017, so I don't consider myself eligible to vote, though. 
WTF Google Account?! 
Isn't it enough to sign in & log in? I don't want Google to monitor my online activity... 
 
I haven't checked the retain information of submitters option for the google form, so at the very least I don't track that stuff... I'm not sure if I can say the same for google itself.

The reason why I used google forms is it's super simple to set up. I could allow anonymous voting, but the requirement to sign in via a google account prevents serious voting abuse. Otherwise it would be crazy easy to vote a million times for one map. 
 
Otherwise it would be crazy easy to vote a million times for one map.
Yeah, I can appreciate that. You don't want the QuakeAwards to become The Voice... Oh well, I guess I can create a Google account to use only for this. 
 
One of the fun things about this was that it got me to play or re-play several 2017 maps and really think about what I liked about them.

The website says that the winners will be revealed tomorrow, and they'll get their well-deserved moment in the spotlight. Before then though, I'd like to call out a few other maps that didn't make the shortlists.

Hopefully this is taken in the spirit it's intended; I want to give props to some more good work, and no shade intended toward anything else.

First of all, Retro Jam 6 was a fantastic release. So much good stuff in there! I would particularly highlight retrojam6_mukor (Sacrifice Unto Sebek), for both looking and playing great. Visually I might give this the edge over the actually-nominated mukor map, and I had a lot of fun with the pacing and variety of the map & the way the routes criss-crossed back over the main areas in different ways.

Map Jam 9 was another killer collection, and I want to give a nod to jam9_shotro (Ruins of the Elder God) in the "oddball" category. I know some folks just won't get on with the "retreading" involved in playing all the way through this map, but it was a cool ambitious idea, and for me it worked and was fascinating to play.

While I'm here I'll mention that I gave ad_sepulcher a nom for best visuals (along with the rest of its nominations haul). Just the initial view alone gets it there IMO, and it's dripping in atmosphere.

Finally megad2lvl3 (Wenl Mine) had some terrific classic fighting and exploring. I wasn't sure how much the gameplay category was intended be about innovation, but this map was super solid in a good ol' familiar way. And like any good map it has a few clever setpieces or other touches that give it character.

Was a good year. 
 
Wenl Mine was a great one, good call. Don't forget the awesome moving geometry in the endgame.

Looking forward to seeing the winners! In the meantime, good call on posting judge interviews. Reminds me of the old mapper interviews on Quaddicted. 
I Suppose I Ain't Gonna Vote, Then... 
Oh well, I guess I can create a Google account
Nope nopey nopes. These wankers ask for a phone number so they can send me a text message. Ha ha. Very funny, guys. Even if my phone wasn't currently dead, I certainly wouldn't give Google my personal phone number. They can go fuck themselves with a dirty toilet brush. 
 
You can click skip 
No I Can't 
They insist on wanting my number. 
Mugwump, Let Me Know Your Vote 
and I'll add it to the total at the end 
Forgotten Sepulcher 
What else? Thanks Snaut. 
 
The awards are up guys, go check em out :) 
Thanks For The Heads-up! 
All winners truly deserve it. Congrats y'all! I coincidentally discovered Bal's map yesterday and it is fantastic!

BTW, does Bal always speak of himself in the 3rd person? xD

I would have liked to have the judges' names appended to "judge 1, judge 2, judge 3".

I'm quite surprised that Sepulcher won the people's choice with only 26% of the votes. I thought it would be a landslide! Can you please inform us on how the votes were distributed for this category? I'd like to know the percentage of votes for each map.

I have a suggestion for the 2019 awards: a mapper should only be nominated once per category. As it is, vanilla has MissBubbles nominated twice and even worse, gameplay is split between Sock, Giftmacher and... Giftmacher+Sock! 
Hey Mugwump 
Yeah, unfortunately there wasn't much engagement with the voting, I chalk that down to

1. my website and how poor it was for mobiles
2. the choice to use google forms
3. people having run out of steam for the awards once the voting came around.

Next time I think it would be better to open up the voting to all the maps released in the previous year. OTP suggested this in a previous discussion with him, however I wanted people to engage with the nominations, so the "your map will only be eligible for the people's choice award if it is nominated for a category" was to get people to engage with the categories and maybe this worked, because there were a heap of nominations. Lots of doubles too.

There were lots of individual votes for maps, and only a handful of maps got more than a single vote.

During discussions early on people made it pretty clear that they wanted the focus to be on the maps, not the mappers. So at the time I wasn't too fussed about some mappers getting more than one map in. I didn't want to have too much oversight over what maps went where as I'm attached to this project long term and don't want too many accusations of bias or cronyism. So when it came to choosing the maps, all I did was shuffle things in spreadsheets once the judges had chosen the shortlist. In hindsight I could have made that an explicit rule.

It does beg the question though, do we want to primarily reward the map? or the mapper?

Anyway, all this aside, I plan on having a debrief thread here on func in about a week, once the dust has settled a little. I can post the percentages of the votes at that point too. If you think of anything else you want to raise, that would be a great time to do it... or, raise it here in the meantime and I'll post the best answer I can then :)

Cheers,

Shamblernaut 
 
It does beg the question though, do we want to primarily reward the map? or the mapper?
Fair point. You made it abundantly clear that the focus was on the maps. Yet, having the same people more than once per category seems odd to me. I'd like to know where others stand on this, if any of you guys feel like chiming in.

If you think of anything else
Nope, that's pretty much it for now. If I do, I'll make sure to let you know. 
 
I'd say it's good to focus on the maps. The main purpose of the awards IMO is to show players some good stuff to experience. The fact that the author gets kudos is nice but not the main thing. We shouldn't artificially discard some maps just because an author made a lot of good ones that year. 
 
btw if you want to submit a news post for the results, that would be great. 
Wow 
Quite honored, Thanks guys!
Away on vacation these days, cool surprise. Congrats to all the winners, finalists, and organizers! 
 
Make it more user friendly next time? I went to the website 3 or 4 times and every time it was just a bunch of empty pages saying something was coming soon. I have no idea where nominations or votes were supposed to take place. 
Awards Debrief 
Hey Guys,

Let me just start by saying thanks for all the support you guys have given and the interaction with the process. It was really good to see so many nominations roll in and seeing your comments here has been awesome.


From very early on it was suggested to me that I use this years awards as a dry run for next year. As a first iteration I think things went fairly well, I learned a lot about what I think need to happen to make it run better next year.

I'll start the ball rolling with known problems with the process.

Lack of specific description around what exactly constitutes certain categories. This ended up hurting one particular mapper who had a very good chance of winning that category. Unfortunately my error was pointed out to me after we had already published the shortlist, and because of this he missed out.

Lack of testing UX for the website. I made the (incorrect) assumption that the links (and scrolling) on the website would work as well as it did in the mobile preview of my browser. My choice in theme wasn't great either.

Engagement. As I mentioned in post 109 engagement with the voting was down as compared to the nominations. It was good to see a variety of votes, but the margin of the winner was not what I expected. I'll publish the votes below.


Other issues that have been raised.

The landing page for the website not being clear enough with conveying the information that the user needs. (post #114)

Not having named the comments against the judges. (post #108)

The requirement for a google account for voting. (post #97)

Voting on one category rather than multiple for people's choice awards. (post #94)

Too short shortlist (post #92)

A counter on the website (post #73)

Everything before this seems to be ok / settled. So that's enough for post 1. Next post will be addressing some of this stuff. 
Post 2 
So let me post my plan for solving some of the problems.

Probably the biggest thing initially would be to get more experienced people on board. I need people with the following skill sets.

Somebody who would like to run outreach or social media. I tweeted out a bit, but didn't engage with other forms of media, this would probably be helpful.
Somebody with css and/or design skills to improve the website.
Somebody to help me with writing reviews / descriptions.

Regarding the names of the judges against the comments. I can change this in the future, but the reason why I did this was to have the opinions of the judges assessed as an aggregate, so if they receive any "hate" from anyone it would be directed at the group rather than any one individual. I'd rather not change it, and would probably only do so if there was overwhelming community support for this change.

For next years award I'll look for a better solution than having a google account for voting. It was quick, easy and "fit for purpose", but I underestimated the reluctance for people to use it. This could have contributed to the low People's Choice Award engagement.

Multiple categories for People's Choice Award(s). So I wanted to keep the scope of the website awards small, initially I only wanted to include the people's choice to minimise potential "hate" being posted toward the judges. The idea being that if people are unhappy, they can still have their say.

I'm willing to include more categories for the people's choice in the future, but I would like to hear from you guys regarding this. With more people on board helping me it should be easier, but I still want to keep the scope of the site manageable. Would you guys like more people's choice categories? If so how would you like to see them implemented?

Regarding too short of a shortlist, I tried to keep the shortlist fairly short so that there would be the two runners up and a winner. Either way, the judges need to cull the maps down from the nominations list to a shortlist. The only person that this really makes more work for is whoever is writing the previews (in this years case, me). So I'm not particularly opposed to making it longer, so long as there is somebody else on board to help me write up the website. Again if we could get discussion regarding this below.

Finally, the breakdown of votes for the maps:

The Forgotten Sepulcher - Sock, 6 votes
Mensis Keep - Breezeep, 3 votes
A Conspiracy of Cartographers - Kell, 2 votes
Shattered Soul of the Scarabrus - Orl, 2 votes
Wenl Mine - Megaman, 2 votes
The Pillar - Pritchard
A Warm Welcome Home - Bal
Blastocyst - Orl
Chasing Promises - Skacky
Manchester's Leftovers - Daya
Nyarlathotep's Sand Castle - Sock
Sacrifice Unto Serek - Muk0r
Temple of Azathoth - Yuki Raven

Thanks guys,

I look forward to hearing your feedback 
 
First off: good job. The winners are excellent maps, and so are the others that were highlighted in various ways on the site.

Judged awards come down to taste and different folks will have different ideas about what the winners should be, but I don't have much about the results per se that I would feel like griping about. I guess I'll mention that I do think it's crazy -- like bark-at-the-moon gnaw-your-own-toes Crazy -- that Sepulcher didn't compete for best visuals. But otherwise, super reasonable picks.

Comments about stuff other than specific results:

1) I'm the guy (or one of the guys) that mentioned that the shortlists were too short. Also I don't think there was a clear distinction between "shortlist" and "honorable mention". Both problems could be solved by combining those lists. I doubt that anyone cares about how many "runners-up" there are in a category. Or at least, speaking only for myself, I just want to see good stuff recognized and it is also nice to have one of those picked out as the best. The size of the shortlist would ideally be driven by where a "quality dropoff" is more than by a set number.

2) The vanilla-compatible category had problems. IMO there shouldn't be a category driven by technical concerns, as that makes things harder for the judges and the audience probably isn't concerned about that. A "vanilla feel" or "classic" category that goes purely on aesthetics could be better.

3) "Best gameplay" was also sort of a headscratcher for me, when nominating stuff. "Gameplay" is a vague term, and maps can excel in many different ways. E.g. exploration, combat setup, puzzles, or new mechanics introduced in a mod. In the end IMO this makes the category so broad that picking one winner feels arbitrary. Maybe there's a way to split this up, not sure. Classic vs. experimental, or combat vs. exploration, or ... anything that makes the category smaller.

4) I really liked having the various posts on the site about things other than the pure results. I don't think I have any constructive criticism about the site here -- obviously the presentation could be better in some ways, which is true of about any website, but I don't have a silver bullet change to recommend. 
 
Oh, and about the people's choice thing:

Personally having only one award there didn't bother me a lot; I was just initially confused/surprised since it had been called "people's choice awards".

With the tiny shortlists I did feel like having a people's choice vote in each category would be one way to recognize more of the best maps. If the shortlists are larger that might be less of a motivation. 
About Voting Activity 
After having seen the low amount of votes, I think it might be wise to keep just a single category until we see an increase in voting activity.

Personally, I didn't vote because I hadn't had time to play hardly any maps from 2017. Otherwise I would've voted.

So, maybe next year concentrate on reaching out to people first etc. and if those measures increase voting activity to high enough levels to warrant more voting categories, they can then be added next year. 
First | Previous | Next | Last
You must be logged in to post in this thread.
Website copyright © 2002-2024 John Fitzgibbons. All posts are copyright their respective authors.