Web Paint-by-Number Forum
Comments on Puzzle #12408: Rating Trainer #2
By Brian Bellis (mootpoint)

peek at solution       solve puzzle
  quality:   difficulty:   solvability: line logic only  

Puzzle Description Suppressed:Click below to view spoilers

#1: Tom O'Connell (sensei69) on Feb 25, 2011

ok...i'll give a 2 for quatlity
#2: Kristen Vognild (kristen) on Feb 25, 2011
This would likely end up with a 1.5, unless it has a really good story to go with it.
#3: Sarah Andrews (sarah) on Feb 25, 2011
Agree. Kristen has a good point: I think a clever title and/or description, a lol puzzle, or a good story does influence a rating. But, by definition, that would not be an anchor, right?
#4: bugaboo (bugaboo) on Feb 25, 2011
i heart this puzzle
haha
#5: annalivia (annalivia) on Feb 25, 2011
agreed
#6: Brian Bellis (mootpoint) on Feb 25, 2011
After multiple ratings do you think this would end up less than 2? If so it is not a good anchor. We need a definative 2. Any suggestions?
#7: Annie (amoston) on Feb 25, 2011
Can some please explain this? I DO NOT get it. At all. Please? Anyone.
#8: Brian Bellis (mootpoint) on Feb 25, 2011
I've suggested in forum 275 that we "train" raters on what a 1,2,3,4,& 5 quality rating looks like in a small puzzle. That way we can be a bit more proactive instead of just complaining that small puzzles are not rated fairly.

To do that we need a set of anchor puzzles. I made this one up to be a classic 2. What do you think Anne? Is this a 2? Have you done any small puzzles that you think are a 4 or a 5? Which ones?
#9: Joel Lynn (furface1) on Feb 26, 2011
Brian, maybe you should mention Forum #275 in the title and/or description of all these "trainer" puzzles.
#10: Susan Duncan (medic25733) on Feb 27, 2011
OK I'll give it a 2
#11: Bruce Yanoshek (yanogator) on Dec 28, 2017
I think ratings are and should be a personal thing - nearly half subjective. I hate having to fill in white space all around a puzzle, when it isn't really part of the image (like this one), so I tend to rate those lower. On this one, I think a 1-row, 1-column white border would be enough.
#12: Brian Bellis (mootpoint) on Dec 28, 2017
So Bruce, you didn't say if you would give this a 1 or a 2 for quality.

Most people seem to rate the quality of small puzzles lower than big ones. This was my attempt to give the small puzzle creators and solvers (like me) some reasonable idea of how to rate a small puzzle.

I think I only did a 1, 2, and 3. Perhaps I'll try for a 4 and 5.
#13: Aurelian Ginkgo (AurelianGinkgo) on Dec 28, 2017
I agree that small puzzles often don't get a high rating, and it is mostly because you can't fit as much detail into it. It is a total shame because creators can work just as hard, if not harder, on a small puzzle just to get it to look right as on a large one. Unfortunately, solvers don't rate based on how much work the creator put into it - and really, how could we if we don't know? They rate based on their own solving experience and how much they like the final picture, which is completely subjective, whether the creator likes it or not. And yet, the vast majority of us probably prefer the little puzzles because they are not a time-consuming project to complete. They are certainly under-rated because we like them more than ratings really show. I try not to rate based on picture definition because it is really not fair, but sometimes if a big picture just wows me, well... 5 it is. That said, I do rate small puzzles well if I enjoyed the logic and the idea behind the picture.
#14: Norma Dee (norm0908) on Dec 28, 2017
There are many people who solve but don't create. If you have never worked to make a small puzzle recognizable as well as fun to solve, then you have no concept on how to rate small puzzles.

Show: Spoilers

Goto next topic

You must register and log in to be able to participate in this discussion.