|
|
Post by megaman9 on Oct 28, 2015 13:00:09 GMT -5
The likelihood of more level judges being added becomes slimmer everyday thanks to R4ZOR's seemingly ignorant attitude to what is going on (I am only saying this because he does come on the forum every now and again... and says nothing), and the chances before already seemed quite slim. I think at this rate we'll just have to have "unofficial" level judges. We pretty much do already :V |
|
WillFlame
Owner
Direful Reflection
An idea has taken root.
5,190 posts
Discord: WillFlame#5739
Favorite Level: Colourful Overnight
Mini-Profile Background: {"image":"https://i.imgur.com/4y98NDS.png","color":""}
Mini-Profile Name Color: 00a3ff
Mini-Profile Text Color: ffffff
|
Post by WillFlame on Oct 28, 2015 14:23:33 GMT -5
The reason why we have varied numbers for various categories is because our scores mean different things. In my reviews, it isn't hard to get a 7, because that's only worth decent, although for others, a 7 is worth good. Therefore, before we decide where each score goes, we need to decide the method for determining the score. To start off, should gameplay, decoration, and whatever else be weighed equally? (As a second thought, we could use the method Cheeseman suggested, putting the level board next to the score. But we should figure this out anyways.) As MechaAnguis said, three judges per level would take a long time for anything to get done, since there aren't enough level judges as of now. A solution could be to have one judge review it, and if someone else agrees, they give it a like or something. Reaching a certain amount of likes from a certain bunch of people would get the review approved. If they don't agree, then write a secondary review- If they disagree enough, there should be more than enough motivation to write a post explaining why. Does that sound good? And yes, I agree there should be at least one person solely dedicated to the moderation of the Level Suggestions board, whether it's a mod or a level judge. But if the judge reviews a level, do they get to move it right away, or do they have to go through approval processes too? EDIT: Wow, I missed three posts. :/ We do have "unofficial" level judges, but without perms, they aren't any better than a regular forum member. P.S. Jumpyhead, I wasn't telling Kappa to fix his grammar, just pointing it out.  |
|
2,322 posts
Hardest Demon: Blue
Mini-Profile Name Color: {"image":"http://freedesignfile.com/upload/2014/07/Shiny-eco-style-green-background-vector-01.jpg","color":""}
|
Post by ~Pear~ on Oct 28, 2015 14:43:14 GMT -5
agree with everyone here. i also want to see the method you use Cheeseman i love reviewing. but i feel like people ignore my reviews and just do whatever they want. |
|
|
|
Post by Jumpyhead on Oct 28, 2015 19:48:18 GMT -5
The reason why we have varied numbers for various categories is because our scores mean different things. In my reviews, it isn't hard to get a 7, because that's only worth decent, although for others, a 7 is worth good. Therefore, before we decide where each score goes, we need to decide the method for determining the score. To start off, should gameplay, decoration, and whatever else be weighed equally? (As a second thought, we could use the method Cheeseman suggested, putting the level board next to the score. But we should figure this out anyways.) As MechaAnguis said, three judges per level would take a long time for anything to get done, since there aren't enough level judges as of now. A solution could be to have one judge review it, and if someone else agrees, they give it a like or something. Reaching a certain amount of likes from a certain bunch of people would get the review approved. If they don't agree, then write a secondary review- If they disagree enough, there should be more than enough motivation to write a post explaining why. Does that sound good? And yes, I agree there should be at least one person solely dedicated to the moderation of the Level Suggestions board, whether it's a mod or a level judge. But if the judge reviews a level, do they get to move it right away, or do they have to go through approval processes too? EDIT: Wow, I missed three posts. :/ We do have "unofficial" level judges, but without perms, they aren't any better than a regular forum member. P.S. Jumpyhead, I wasn't telling Kappa to fix his grammar, just pointing it out. Lol k  |
|
4,693 posts
Discord: lumpfriend
Mini-Profile Background: {"image":"","color":"000000"}
Mini-Profile Name Color: ffffff
Mini-Profile Text Color: ffffff
|
Post by Lumpy on Oct 28, 2015 21:12:25 GMT -5
What we need is: 1. Restrucuturing the rating system so that it's centralized and everyone follows the same template. 2. Letting 3 reviewers rate the level and then move it; based on average score. 3. An actual "ingame mod" camping this section; either a new level mod or someone new. 1. As for the rating system:I had a thread somewhat like this entire section once. The rating system was based upon ((Gameplay 0-10)+(Decorations 0-5)+(timing 0-5)/2)+(eventual bonus points)Where gameplay measures how fun it is to play, Decorations measures how nice it looks, Timing measures how timed the level is to the music, and Bonus points are if the level impress me in a way. The bonus points can also be negative; if the level does something that makes me cringe etc. (for example spanish dialogue in bossfights) If we put in an example level in here: Generic sunsetlevelGameplay: 2 Decor: 5 Timing: 1 One bonus point for some pretty nice decorations. Then we get ((2+5+1)/2)+1=5.5Total score: 5.5/10 (the highest level I've rated with this system got 11.5/10  ) 2. Three judges per level.This is to stop eventual bias. All scores are added together and divided by 3 to get an average. This score decides the level's placement. This is how I view the scores:0-4 Needs improvement 4.5-6 Decent 6.5-8 Good 8.5-10 Feature worthy (should be renamed to very good; as good and even decent levels often is feature worthy. 3. An ingame mod here to actually speed up the processEither someone here should apply for moderator status (how do you even do that) or we should get a moderator over here to check through the lists almost daily. As of now, they've sorta stacked up in a big mess; so even if RubRub checked it right now; he'd miss a lot. This. Everything you said, down to the minute detail, should be the ideal goal. We may not have enough active level judges to average 3 scores, and we may not yet be organized to enough to implement a formula, and we may not have an in-game mod to sort stuff here. But it can be done. I vouch |
|
|
|
Post by megaman9 on Oct 29, 2015 8:34:22 GMT -5
The three judges per level thing is inconvenient for us judges (because we have to look around the Level Suggestions board to find stuff that's been reviewed) AND for the people that made the levels (it'll take forever, not many level judges are online at once and more and more people will keep posting levels)
|
|
WillFlame
Owner
Direful Reflection
An idea has taken root.
5,190 posts
Discord: WillFlame#5739
Favorite Level: Colourful Overnight
Mini-Profile Background: {"image":"https://i.imgur.com/4y98NDS.png","color":""}
Mini-Profile Name Color: 00a3ff
Mini-Profile Text Color: ffffff
|
Post by WillFlame on Oct 29, 2015 8:42:28 GMT -5
The three judges per level thing is inconvenient for us judges (because we have to look around the Level Suggestions board to find stuff that's been reviewed) AND for the people that made the levels (it'll take forever, not many level judges are online at once and more and more people will keep posting levels) Instead of looking through the Level Suggestions board, we could have it moved to a "reviewing" board or something like that to make things easier, although it might seem a little random to most people on the forum. Just an idea that probably needs some editing. |
|
396 posts
Mini-Profile Background: {"image":"","color":"1d81bf"}
Mini-Profile Name Color: 1c2833
Mini-Profile Text Color: aed6f1
|
Post by Cheeseman on Oct 29, 2015 9:02:46 GMT -5
Welp I've decided to try and add R4ZOR as a Skype contact and I'll discuss all this level judging stuff with him if he adds me and I find him online at some point...
|
|
)