The Grey Labyrinth is a collection of puzzles, riddles, mind games, paradoxes and other intellectually challenging diversions. Related topics: puzzle games, logic puzzles, lateral thinking puzzles, philosophy, mind benders, brain teasers, word problems, conundrums, 3d puzzles, spatial reasoning, intelligence tests, mathematical diversions, paradoxes, physics problems, reasoning, math, science.

   
The Grey Labyrinth Forum Index
 FAQFAQ   SearchSearch   MemberlistMemberlist   UsergroupsUsergroups    RegisterRegister  
 ProfileProfile   Log in to check your private messagesLog in to check your private messages   Log inLog in 

Converting rating scales

 
Reply to topic    The Grey Labyrinth Forum Index -> Science, Art, and Culture
View previous topic :: View next topic  
Author Message
Courk
Daedalian Member



PostPosted: Thu Jul 09, 2009 6:10 am    Post subject: 1 Reply with quote

Let's say a 5-point rating system has been used in the past for rating anything subjectively -- books, movies, whatever. What's the best way to convert that to a 10-point rating system? On the surface it seems just multiplying everything by 2 would work, but I'm not sure that's necessarily the best, considering people are doing the scoring. I would think there'd be something slightly off, with someone who thinks something was not quite perfect giving it the second highest score, meaning a lot of 4/5s would be more equivalent to 9/10s, rather than 8/10s.
Back to top
View user's profile Send private message Send e-mail AIM Address
MTGAP
Daedalian Member



PostPosted: Thu Jul 09, 2009 5:34 pm    Post subject: 2 Reply with quote

Maybe it could be optimized with something involving logarithms. That could make a nice curve.

I would think it should be something like this:

1/5 = 1/10
2/5 = 3/10
3/5 = 5/10
4/5 = 8/10
5/5 = 10/10
_________________
This statement is false.
Back to top
View user's profile Send private message
Lepton*
Guest



PostPosted: Fri Jul 10, 2009 11:28 am    Post subject: 3 Reply with quote

For me, the range 1-4 (out of 5) maps onto the range 1-9 (out of 10), with the extremities being maintained as extremes,so:
0 - 0
1 - 1
2 - 3.6...
3 - 6.3...
4 - 9
5 - 10
Back to top
Courk
Daedalian Member



PostPosted: Fri Jul 10, 2009 2:21 pm    Post subject: 4 Reply with quote

It starts at 1, how does that affect it?

And how are you figuring this out? That's what I'm most curious about.
Back to top
View user's profile Send private message Send e-mail AIM Address
Chuck
Daedalian Member



PostPosted: Fri Jul 10, 2009 4:05 pm    Post subject: 5 Reply with quote

1 stays as 1
2 stays as 2
3 discarded for not caring
4 becomes 9
5 becomes 10
Back to top
View user's profile Send private message Send e-mail Visit poster's website AIM Address
Zag
Tired of his old title



PostPosted: Fri Jul 10, 2009 5:04 pm    Post subject: 6 Reply with quote

Do you have full data of who gave what rating? If so, you should bell-curve the ratings of each individual. For instance, if Easy Ed made 100 ratings, and they are all 4's and 5's (of 5) then you should convert them to, say 4's and 8's. On the other hand, Harsh Harry similarly gave 100 ratings but they are one 1, four 2's. ninety 3's, four 4's, and one 5, then I would convert his so that 1=1, 2=2, 3=5, 4=9, 5=10. Etc.
Back to top
View user's profile Send private message Send e-mail Visit poster's website Yahoo Messenger
Dread Pirate Westley
Daedalian Member



PostPosted: Fri Jul 10, 2009 9:50 pm    Post subject: 7 Reply with quote

This is why you should never tell anyone the scale on which you are rating things. I typically use a scale from 3 to 8.5, but it can vary. I do rate movies from 1 to 10, but it's logarithmic.
Back to top
View user's profile Send private message AIM Address
Samadhi
+1



PostPosted: Fri Jul 10, 2009 10:37 pm    Post subject: 8 Reply with quote

I read the OP as:
Q. How can you subjectively convert one subjective scale to another?

My answer: It depends...
_________________
And he lived happily ever after. Except for the dieing at the end and the heartbreak in between.
Back to top
View user's profile Send private message Send e-mail MSN Messenger
Scurra
Daedalian Member



PostPosted: Fri Jul 10, 2009 11:37 pm    Post subject: 9 Reply with quote

I tend to subscribe to the Duke Ellington school of ratings. He said there were two sorts of music: good music and bad music. (The fun part is that we all violently disagree about which is which... and none of us are necessarily right Revenge most foul!)
That's not too far off Chuck's scale actually, except that that version has a little bit more "give" in it.
_________________
still Quiz Olympiad champion. Must get a life.
New definitions: COFFEE - someone who is coughed upon
Back to top
View user's profile Send private message Visit poster's website
Frankie*
Guest



PostPosted: Fri Aug 28, 2009 11:51 am    Post subject: 10 Reply with quote

You will need to have some folks rate according to both systems.
You might be able to use Rasch Scaling / Rasc Modelling, which would also help you identify harsh (or easy) raters and strange items.
Back to top
Dragon Phoenix
Judge Doom



PostPosted: Sat Aug 29, 2009 5:37 am    Post subject: 11 Reply with quote

For a music discussion site, I rate songs according to:

10/10 - brilliant, one of the best 200 songs of all time
9/10 - excellent, one of the next best 500 songs of all time
8/10 - great, I'd put it on my MP3 player
7/10 - good, like to hear it on the radio
6/10 - OK, don't mind hearing it
5/10 - would probably switch channels
4/10 - would definitely switch channels
3/10 - aargh, quick, get rid of it
2/10 - dear god, why
1/10 - the smurf song

Converting this into a 5 point scale, I'd say
5/5 excellent, one of the best 700 songs of all time (9-10/10)
4/5 great, I'd put it on my MP3 player (8/10)
3/5 OK, like to hear it occasionally (6-7/10)
2/5 would switch channels (4-5/10)
1/5 awful (1-3/10)
_________________
My photography:
http://www.flickr.com/photos/artrock2006/
Back to top
View user's profile Send private message Send e-mail Visit poster's website AIM Address
MatthewV
Daedalian Member :_



PostPosted: Sat Aug 29, 2009 10:03 pm    Post subject: 12 Reply with quote

I agree with DP for the most part. And fort that reason, I would map

1 --> 1 or 2 (does it really matter?)
2 --> 4
3 --> 5 (I would do a 5.5 but that is essentially a 20 point scale)
4 --> 7 (or a 7.5)
5 --> 9

I feel that is better to downrate than to overrate.

Also, after converting the ratings, weight them so that after a few (a relative term) new people could influence the score by about 1 point.
Back to top
View user's profile Send private message Send e-mail AIM Address
Samadhi
+1



PostPosted: Mon Aug 31, 2009 3:42 pm    Post subject: 13 Reply with quote

I castle that reason.
_________________
And he lived happily ever after. Except for the dieing at the end and the heartbreak in between.
Back to top
View user's profile Send private message Send e-mail MSN Messenger
Display posts from previous: by   
Reply to topic    The Grey Labyrinth Forum Index -> Science, Art, and Culture All times are GMT
Page 1 of 1

 
Jump to:  
You cannot post new topics in this forum
You can reply to topics in this forum
You cannot edit your posts in this forum
You cannot delete your posts in this forum
You cannot vote in polls in this forum


Powered by phpBB © 2001, 2005 phpBB Group
Site Design by Wx3