Register | Sign In


Understanding through Discussion


EvC Forum active members: 65 (9164 total)
5 online now:
Newest Member: ChatGPT
Post Volume: Total: 916,422 Year: 3,679/9,624 Month: 550/974 Week: 163/276 Day: 3/34 Hour: 1/0


Thread  Details

Email This Thread
Newer Topic | Older Topic
  
Author Topic:   Why Ratings Are Not Objective.
Stile
Member
Posts: 4295
From: Ontario, Canada
Joined: 12-02-2004


(1)
Message 61 of 88 (536507)
11-23-2009 1:47 PM
Reply to: Message 54 by Percy
11-21-2009 7:47 AM


Possible New Rating System?
I understand that the numbers are a user-friendly, easy way to put in some sort of rating system. So my thoughts here may be too in-depth for what you want the rating system to be. If that's the case, just ignore me.
But... it could be done without numbers entirely, and not have any of the negative affects of "being spammed" as well. But, it seems like it may be rather in-depth and perhaps not so user-friendly... and maybe also bog down the database. Here's the basics:
For rating individual message:
Instead of a rating system (1-5 or 1-3 or whatever), it could just be an agree/disagree or for/against system. You could list the total numbers of all those who are for and against each post where the Message Rating number is now. But, if you click on this area, it opens a wee pop-up box (like the one used for suspensions and such) that lists all user names that voted for or against. I think listing the user names is important so that no one can vote anonymously. The internet itself is already anonymous enough, and this adds some semblance of accountability.
For rating member profiles:
Staying with the above system, each member would have a list of "for" and "against" for all those who have rated their messages. Members would be under either "for" or "against" according to the last-rated message they did for that profile.
Example (for ease of display, I'm assuming all messages are being rated before the next message is posted, but this need not be the case at all):
Percy posts 3 messages:
Message 1
Message Rating: 3 For, 2 Against
If you click you get a little box saying:
For: Moose, Nosy, Stile
Against: Asgara, PD
Percy's Profile After Message 1
Member Rating: 3 For, 2 Against
For: Moose (1F-0A), Nosy (1F-0A), Stile (1F-0A)
Against: Asgara (0F-1A), PD (0F-1A)
Message 2
Message Rating: 1 For, 2 Against
If you click you get a little box saying:
For: Stile
Against: Asgara, PD
Percy's Profile After Message 2
Member Rating: 3 For, 2 Against
For: Moose (1F-0A), Nosy (1F-0A), Stile (2F-0A)
Against: Asgara (0F-2A), PD (0F-2A)
Message 3
Message Rating: 1 For, 0 Against
If you click you get a little box saying:
For: Asgara
Against: ---
Percy's Profile After Message 3
Member Rating: 4 For, 1 Against
For: Asgara (1F-2A), Moose (1F-0A), Nosy (1F-0A), Stile (2F-0A)
Against: PD (0F-2A)
This way you get a few things:
-if someone goes insane and gives negative marks for all posts on some particular member... it only acts as "1 Against" on that member, and that memeber's profile will show "0F-24A" from that insane user and it's obvious to all who the baby is.
-members ratings will constantly be updated as to how people are liking their latest messages
-you'll be able to identify if someone rates someone good most of the time, and then just happens to rate them bad once or twice
-if you want to get really nifty, you could also link the "Stile (2F-0A)" part on Percy's member profile back to the post for Stile's latest rating on Percy...
Bad things:
-server and database heavy, not sure how many requests would need to be made, perhaps too intensive? Each message would also need to store For and Against member IDs. All profile information and counts could be retrieved through seaches of the message database, though (I think).
Also, I'd suggest implementing an Admin Tool of something like "nullify user's ratings" if an admin perhaps identifies an insane member, and the admin decides it would be best for the board (for whatever reason) if their insane ratings were "forgotten."
Edited by Stile, : Just added a few things for clarity. Not that it helped much... I feel like this idea isn't even too clear in my own head right now...
Edited by Stile, : "anonomous" is funny looking... and rightfully so

This message is a reply to:
 Message 54 by Percy, posted 11-21-2009 7:47 AM Percy has seen this message but not replied

Replies to this message:
 Message 65 by Admin, posted 11-24-2009 7:05 AM Stile has replied

  
Perdition
Member (Idle past 3259 days)
Posts: 1593
From: Wisconsin
Joined: 05-15-2003


(1)
Message 62 of 88 (536515)
11-23-2009 2:58 PM
Reply to: Message 54 by Percy
11-21-2009 7:47 AM


I worked like crazy the first year to create a good impression. lots of unpaid overtime, and received an average assessment.
Well, considering working for a company and not getting paid for it is illegal and the company can get into some very serious issues were it to be discovered, your unpaid overtime could have been the very reason you got rated less than you probably deserved.
It happens all the time where I work. Someone has a project, but overtime isn't approved, so they stay late off the clock to finish it. They usually get talked to very sternly if they're found out, and we're told very often to either go home and just let the project take longer, work as long as you need to, but flex your schedule the rest of the week to stay under 40 hours, or talk to a supervisor and see if they can get overtime approved for you, but under no circumstances, work off the clock.

This message is a reply to:
 Message 54 by Percy, posted 11-21-2009 7:47 AM Percy has replied

Replies to this message:
 Message 63 by Percy, posted 11-23-2009 4:39 PM Perdition has not replied
 Message 64 by New Cat's Eye, posted 11-23-2009 4:45 PM Perdition has not replied

  
Percy
Member
Posts: 22480
From: New Hampshire
Joined: 12-23-2000
Member Rating: 4.8


(1)
Message 63 of 88 (536536)
11-23-2009 4:39 PM
Reply to: Message 62 by Perdition
11-23-2009 2:58 PM


Hi Perdition,
I'm salaried, so maybe I shouldn't have called it unpaid overtime. When projects reach crunch time long hours are common, but there are other reasons for working longer hours. Whether it pays off or not you don't find out until later at salary review and bonus time. The neat thing about hourly is that overtime definitely pays off.
--Percy

This message is a reply to:
 Message 62 by Perdition, posted 11-23-2009 2:58 PM Perdition has not replied

  
New Cat's Eye
Inactive Member


(1)
Message 64 of 88 (536537)
11-23-2009 4:45 PM
Reply to: Message 62 by Perdition
11-23-2009 2:58 PM


As a salaried employee, I am exempt from overtime.
Are You an Exempt Employee?

This message is a reply to:
 Message 62 by Perdition, posted 11-23-2009 2:58 PM Perdition has not replied

  
Admin
Director
Posts: 13017
From: EvC Forum
Joined: 06-14-2002
Member Rating: 1.9


(1)
Message 65 of 88 (536594)
11-24-2009 7:05 AM
Reply to: Message 61 by Stile
11-23-2009 1:47 PM


Re: Possible New Rating System?
Hi Stile!
I want a system with the flexibility to implement a number of approaches, including ones along the lines you describe. It should also be possible using correlations to divide members into camps and adjust the impact of their ratings according to how strongly they and who they're rating correlate with the different camps. Properly implemented, a low rating from some members could have the effect of increasing someone's rating.
But this will take time to implement. For now I advise that no one pay much attention to the current ratings. Whether high or low, they're both imposters a la Kipling's If.

--Percy
EvC Forum Director

This message is a reply to:
 Message 61 by Stile, posted 11-23-2009 1:47 PM Stile has replied

Replies to this message:
 Message 66 by Stile, posted 11-24-2009 8:24 AM Admin has seen this message but not replied
 Message 67 by Straggler, posted 12-04-2009 3:13 PM Admin has replied

  
Stile
Member
Posts: 4295
From: Ontario, Canada
Joined: 12-02-2004


(1)
Message 66 of 88 (536606)
11-24-2009 8:24 AM
Reply to: Message 65 by Admin
11-24-2009 7:05 AM


Re: Possible New Rating System?
Admin writes:
But this will take time to implement.
No problem at all. Just wanted to get an idea out of my head. But it sounds like you're already working on a bigger-and-better system. I'll save my criticism for the next round, then... whenever it is.
For now I advise that no one pay much attention to the current ratings. Whether high or low, they're both imposters a la Kipling's If.
Meh, I don't pay attention to ratings much anyway. I can just appreciate that you're making the software for a more... common and general audience. Anyway, good luck with all the new features you're planning on still editing/adding.

This message is a reply to:
 Message 65 by Admin, posted 11-24-2009 7:05 AM Admin has seen this message but not replied

  
Straggler
Member
Posts: 10333
From: London England
Joined: 09-30-2006


Message 67 of 88 (538219)
12-04-2009 3:13 PM
Reply to: Message 65 by Admin
11-24-2009 7:05 AM


Re: Possible New Rating System?
Admin writes:
It should also be possible using correlations to divide members into camps and adjust the impact of their ratings according to how strongly they and who they're rating correlate with the different camps. Properly implemented, a low rating from some members could have the effect of increasing someone's rating.
I fail to see how this even could work given the widespread nature of debate. Two members from opposing camps of the deistic/theistic Vs atheistic debate might wholly agree with each other on social threads relating to gun laws or anti-discrimination laws. For example.
I like the new member stats on forums participated in with percentages etc. Is there a way to see when a member last logged in? Regardless of having posted. If not is this a stat that could be published in a members stats profile?
And if we want to get controversial is there a way to show not just the stats pertaining to the threads a member participates in and the number of posts per day - but their number of words per post?
Half joking with that last one

This message is a reply to:
 Message 65 by Admin, posted 11-24-2009 7:05 AM Admin has replied

Replies to this message:
 Message 68 by Admin, posted 12-04-2009 3:29 PM Straggler has replied

  
Admin
Director
Posts: 13017
From: EvC Forum
Joined: 06-14-2002
Member Rating: 1.9


(1)
Message 68 of 88 (538223)
12-04-2009 3:29 PM
Reply to: Message 67 by Straggler
12-04-2009 3:13 PM


Re: Possible New Rating System?
Straggler writes:
I fail to see how this even could work given the widespread nature of debate. Two members from opposing camps of the deistic/theistic Vs atheistic debate might wholly agree with each other on social threads relating to gun laws or anti-discrimination laws. For example.
Oh ye of little faith.
I like the new member stats on forums participated in with percentages etc. Is there a way to see when a member last logged in? Regardless of having posted. If not is this a stat that could be published in a members stats profile?
At some point the member's profile page will include whether he's currently active, and if so what he's doing, like reading a thread or posting a message. And if he's not active then it will include when he was last active and what he was doing at the time.
And if we want to get controversial is there a way to show not just the stats pertaining to the threads a member participates in and the number of posts per day - but their number of words per post?
How about a readability index. Your first paragraph scores at 11th grade with an ease of reading of 44, about mid-range of the Flesch-Kincaid reading ease score.
I'm currently working on private messaging.

--Percy
EvC Forum Director

This message is a reply to:
 Message 67 by Straggler, posted 12-04-2009 3:13 PM Straggler has replied

Replies to this message:
 Message 69 by Straggler, posted 12-04-2009 3:37 PM Admin has replied

  
Straggler
Member
Posts: 10333
From: London England
Joined: 09-30-2006


Message 69 of 88 (538224)
12-04-2009 3:37 PM
Reply to: Message 68 by Admin
12-04-2009 3:29 PM


Re: Possible New Rating System?
Admin writes:
How about a readability index. Your first paragraph scores at 11th grade with an ease of reading of 44, about mid-range of the Flesch-Kincaid reading ease score.
I don't know if that is a subtle compliment, a subtle dig or just a statement of pure fact. But it sounds like a good idea.
Flesch-Kincaid reading ease score

This message is a reply to:
 Message 68 by Admin, posted 12-04-2009 3:29 PM Admin has replied

Replies to this message:
 Message 70 by Admin, posted 12-04-2009 6:16 PM Straggler has not replied

  
Admin
Director
Posts: 13017
From: EvC Forum
Joined: 06-14-2002
Member Rating: 1.9


(2)
Message 70 of 88 (538242)
12-04-2009 6:16 PM
Reply to: Message 69 by Straggler
12-04-2009 3:37 PM


Re: Possible New Rating System?
Straggler writes:
I don't know if that is a subtle compliment, a subtle dig or just a statement of pure fact. But it sounds like a good idea.
Viv Pope puts us all to shame. Cut-n-paste some stuff from him and some of the rest of us into this Readabilty Index Calculator. I bet you won't find anyone who beats him.

--Percy
EvC Forum Director

This message is a reply to:
 Message 69 by Straggler, posted 12-04-2009 3:37 PM Straggler has not replied

Replies to this message:
 Message 71 by lyx2no, posted 12-04-2009 7:01 PM Admin has seen this message but not replied
 Message 75 by RAZD, posted 12-05-2009 4:43 AM Admin has seen this message but not replied

  
lyx2no
Member (Idle past 4737 days)
Posts: 1277
From: A vast, undifferentiated plane.
Joined: 02-28-2008


(1)
Message 71 of 88 (538245)
12-04-2009 7:01 PM
Reply to: Message 70 by Admin
12-04-2009 6:16 PM


Readability
I'm certainly not happy with my score on these few sentences:
The point was non-materialistic explanations. Your example had nothing to do with non-materialistic explanations. Frankly, even if the arm had been moved psychokinetically we'd not have evidence of non-materialistic explanations but of psychokinesis being material.
-10 for readability? Is it any wonder that I have no friends?

The world breaks everyone, and afterward many are strong at the broken places. But those it cannot break, it kills. It kills the very good and the very gentle and the very brave impartially. If you are none of these, you can be sure that it will kill you too, but there will be no special hurry.
Ernest Hemingway

This message is a reply to:
 Message 70 by Admin, posted 12-04-2009 6:16 PM Admin has seen this message but not replied

Replies to this message:
 Message 72 by RAZD, posted 12-04-2009 9:28 PM lyx2no has replied

  
RAZD
Member (Idle past 1426 days)
Posts: 20714
From: the other end of the sidewalk
Joined: 03-14-2004


(1)
Message 72 of 88 (538252)
12-04-2009 9:28 PM
Reply to: Message 71 by lyx2no
12-04-2009 7:01 PM


Re: Readability
Yes so you know anyone with a grade 10 or higher should be able to comprehend what you say.
My 11 is:
You are making two conceptual errors here. The first is that you can make a calculation when you only know part of the possibilities and have no idea how large the set is. It's not a probability, it is just an opinion based on your world view of what you think the probability is: there is no calculation. This pseudo-probability argument is just the argument from incredulity dressed up.
Enjoy

This message is a reply to:
 Message 71 by lyx2no, posted 12-04-2009 7:01 PM lyx2no has replied

Replies to this message:
 Message 73 by lyx2no, posted 12-04-2009 9:53 PM RAZD has replied

  
lyx2no
Member (Idle past 4737 days)
Posts: 1277
From: A vast, undifferentiated plane.
Joined: 02-28-2008


(1)
Message 73 of 88 (538255)
12-04-2009 9:53 PM
Reply to: Message 72 by RAZD
12-04-2009 9:28 PM


Re: Readability
Yes so you know anyone with a grade 10 or higher should be able to comprehend what you say.
The grade level was 18. The readability was 20 points below legalese. I guess you couldn't read it either.
AbE: The Horta, with "No kill I.", had a grade level 2 and an ease of reading of 90.
Edited by lyx2no, : Just thought it would be important to know that.

The world breaks everyone, and afterward many are strong at the broken places. But those it cannot break, it kills. It kills the very good and the very gentle and the very brave impartially. If you are none of these, you can be sure that it will kill you too, but there will be no special hurry.
Ernest Hemingway

This message is a reply to:
 Message 72 by RAZD, posted 12-04-2009 9:28 PM RAZD has replied

Replies to this message:
 Message 74 by RAZD, posted 12-04-2009 10:00 PM lyx2no has seen this message but not replied

  
RAZD
Member (Idle past 1426 days)
Posts: 20714
From: the other end of the sidewalk
Joined: 03-14-2004


(1)
Message 74 of 88 (538258)
12-04-2009 10:00 PM
Reply to: Message 73 by lyx2no
12-04-2009 9:53 PM


Re: Readability
Ah. My readability was 47, still well below sunday comics (which I'm not sure is a bad thing). I've been told that I need to write on a simpler level with a grade 5 target - to make sure my points get across. This is difficult to do when I already consider my points to be pretty simple.

we are limited in our ability to understand
by our ability to understand
Rebel American Zen Deist
... to learn ... to think ... to live ... to laugh ...
to share.


• • • Join the effort to solve medical problems, AIDS/HIV, Cancer and more with Team EvC! (click) • • •

This message is a reply to:
 Message 73 by lyx2no, posted 12-04-2009 9:53 PM lyx2no has seen this message but not replied

  
RAZD
Member (Idle past 1426 days)
Posts: 20714
From: the other end of the sidewalk
Joined: 03-14-2004


(1)
Message 75 of 88 (538274)
12-05-2009 4:43 AM
Reply to: Message 70 by Admin
12-04-2009 6:16 PM


Re: Possible New Rating System?
Viv Pope puts us all to shame. Cut-n-paste some stuff from him and some of the rest of us into this Readabilty Index Calculator. I bet you won't find anyone who beats him.
might be interesting to have a "readability meter" for posts ...
(as if you have nothing else to do)

This message is a reply to:
 Message 70 by Admin, posted 12-04-2009 6:16 PM Admin has seen this message but not replied

  
Newer Topic | Older Topic
Jump to:


Copyright 2001-2023 by EvC Forum, All Rights Reserved

™ Version 4.2
Innovative software from Qwixotic © 2024