All about flooble | fun stuff | Get a free chatterbox | Free JavaScript | Avatars    
perplexus dot info
Discussion Forums
Login: Password:Remember me: Sign up! | Forgot password

Forums > General Discussion
This is a forum for discussing anything and everything.
levik
2002-12-09 05:57:56
Ratings.

People seem to be forgetting to rate problems again. Ratings are kind of important, because I they allow groupings of problems by quality. With ratings we can see "top problems" as well as recent top, which are the highest rated for the month.

Additionally, I am looking to add an advanced search page (as the number of problems is growing it will make more sense), and filtering by score (Slashdot-style) would be useful.

Finally, and this is not something I'm sure about, I'm thinking of having high-rating problems count for more when calculating user promotions. But this may prove too difficult to do.

SO.... If you're logged in and looking at a problem you haven't rated yet, it will give you a small reminder by "animating" the rating prompt of the page. Hopefully nothing too distracting.

Raveen
2002-12-09 20:55:07
Re: Ratings.

No, not at all distractiong! Actually I didn't notice it untill I read Nicks message on the chatterbox and looked for it!

Raveen
2002-12-09 21:00:54
Re: Ratings.

ok, I just realized how helpful it is :D Thumbs Up! :p

Nick Reed
2002-12-10 02:13:45
Re: Ratings.

I noticed that for ages you can see what ratings people give, on average, and how many problems they've submitted, by viewing their user stats. It might also be interesting to see the average rating of their problems too - this might be an interesting way to see if a person generally submits poor problems, or whatnot... Just a thought.

friedlinguini
2002-12-10 04:49:31
Re: Ratings.

Not so sure about this. Is it really a good idea to publicly give negative feedback to people genuinely trying to contribute content?

Nick Reed
2002-12-10 08:11:34
Re: Ratings.

Ah, true I suppose. I'll hush now then. ;-)

levik
2002-12-10 09:36:31
Re: Ratings.

Hmmm, you both have good points. On one hand it's rather interesting to see people's average problem scores. On the other, fl is right about embarrasing people who are doing their best.

I will have to think about it some more.

friedlinguini
2002-12-11 03:47:27
Re: Ratings.

A slight variation on Nick Reed's suggestion: Rather than posting the average rating of submitted problems, post a total of the ratings of all puzzles (the average rating times the number of submitted puzzles if my explanation wasn't too clear). Put up a link to "Top Puzzlers" or something like, listing either all contributors or the top N contributors. That way, even a Rating 1 puzzle will boost the submitter's score (hey, it was good enough to get accepted, right?). Ranking submitters on the same page also adds a competitive element that ought to create an incentive for people to submit problems.

Cory Taylor
2003-01-14 06:03:37
Re: Ratings.

i find that unless I really enjoy a puzzle, I won't rate it because I'm not able to guarantee subjectiveness. e.g. if I've seen a puzzle before, its hard to rate properly, or if it isn't my style (along with levik - i think - i don't really appreciate a riddle, even if it is a good one), so I stay out of the game. The base reason has been highlighted by you guys above - I don't really want to "hurt" someones feelings with an undeserved bad rating, but at the same time don't want to water down the rating scheme by giving marks too generously. I guess I would make a poor teacher...

friedlinguini
2003-01-14 06:30:09
Re: Ratings.

A problem's obscurity can also be a point in its favor. The fewer people that have heard of a problem, the more interesting it is likely to be. I think the best approach is just to vote in a way consistent with how much you enjoy the puzzle. Your vote won't be the only one, so you needn't worry about being the one who hurt a poster's feelings..

Andrew
2004-10-21 17:44:45
Re: Ratings.

I like rating stuff hehe.

SteveH
2004-10-23 23:10:37
Re: Ratings.

I'm new to this site, and I haven't been able to find anything that provides guidance on ratings. Are the ratings supposed to be based on relative difficulty or fun (related, but not the same thing), or a general "quality" judgement? Would itbe useful to guidance into the FAQ so that some consistency could be applied?

SilverKnight
2004-10-24 05:41:18
Re: Ratings.

That's a common source of confusion, Steve. And there are other similar comments in the Forums (look at some from many months ago).

But to answer your question: it should be a judgement of "quality" of the problem. The difficulty rating was determined and accepted before the problem was posted.

Erik O.
2005-04-25 20:03:14
Re: Ratings.

I don't think subjectivity is all bad in this area. As long as enough people rate the problems, then the average works out in the end. If it really is a good problem, then there will be enough experienced puzzlers to recognize that and rate it higher. Likewise with the poorer puzzles.

Avin
2005-04-25 20:15:24
Re: Ratings.

I generally forget to rate problems unless I really like them. That's evidenced in the fact that my average rating given is 4.80 (for 5 ratings given)!

Maybe you should be unable to comment on problems that you haven't yet rated? Of course that has the disadvantage that people are forced to rate it even if they haven't figured out the solution yet and are still in the process of solving it...

Bruce Brantley
2005-05-01 16:09:25
Re: Ratings.

Generally, I think you have a good idea Avin. But there are many puzzles posted that are beyond my experience and knowledge. Does this mean that I should not be allowed to comment on them without rating them? How can I rate a problem without understanding it? I wonder if the ratings serve any actual purpose.

Gamer
2005-05-02 02:01:27
Re: Ratings.

Just have an extra reminder. "Do you really want to post before rating the problem?" That way rating and commenting takes fewer steps than commenting, going to rating, then commenting and it will remind you to do so. You can still comment if you wanted to on problems you haven't solved yet.

Bruce Brantley
2005-05-02 13:48:32
Re: Ratings.

That sounds like a good idea Gamer. Quite often I forget to rate a puzzle because I'm thinking about the possible solution rather than how good the puzzle is. A reminder would help. I don't know if it would be worth Levik's time. Perhaps others could weigh in on this.

Erik O.
2005-05-02 18:02:17
Re: Ratings.

I really hesitate to rate some problems until an official solution is given. there have been a number of riddles which I think should be difficult to answer only to find out that the official solution is trivial and mundane.

I think what the rating system does do for us is indicate what types of puzzles people like. Knowing this we can submit puzzles which are more popular to more people.

I have found from my own experience that I am more likely to rate problems I like rather than problems I don't like (unless they really suck).

Jer
2005-05-03 17:39:14
Re: Ratings.

What is the pupose of having problems rated anyway?

Why is one a probem a '5' or a '1'? If people don't rate problems without similar criteria the ratings don't mean much. If prople only rate problems they feel strongly about, that rating don't mean much.

I'm thinking about a site with a similar ranking system that I use: Netflix.
I enjoy giving a movie 1 to 5 stars based on how much I liked it. I rate every movie I see. Why?
One reason is the site will give reccomendations based on which other movies you rated. I think there's more to it than that though -- something I can't put my finger on. Maybe some kind a a club mentality: what did I think of the movie that other people liked?

Netflix is not perfect either. A higly polarizing move like Fareinheit 9/11 probably rates around a 3 because everyone either rates it a 1 or a 5. You will probably either love it or hate it. A so-so movie also rates around 3 because everyone rates it close to 3. You will probably find it mediocre.

What is the rating of a perplexus puzzle supposed to indicate?

Percy
2005-08-23 02:08:45
Re: Ratings.

I've bn thinking a lot about this since moving in here. I would sugest that a rating indicates enjoyability. The purpose of ratings for me is to make it easier to choose an enjoyable puzzle in the first place. Of course there may be exceptions to this such as a frustrating puzzle that you really hate but when you solve it, see that there was somthing especially clever in its creation- but then that is still a source of satisfaction.


Some people do seam rather generous but then u r more likley to rate a problem you like. I would suggest people try to average their ratings roughly at three, where three being the average puzzle on this site (and therefore by no means bad)


By the way that animation is so slight, I think the text size could be larger or the colour bright pinker or something.

Copyright © 2002 - 2024 by Animus Pactum Consulting. All rights reserved. Privacy Information