View Poll Results: Will BoC have a lower rep than Animeniax one month from now?

Voters
46. You may not vote on this poll
  • FO SHO

    14 30.43%
  • NAW

    32 69.57%
Results 1 to 20 of 224

Thread: Reputation System: Dramatics and Whining

Hybrid View

Previous Post Previous Post   Next Post Next Post
  1. #1
    Benevolent Dictator
    complich8's Avatar
    Join Date
    Jul 2003
    Location
    some terminal somewhere
    Age
    43
    Posts
    2,189
    Blog Entries
    1

    Reputation System: Dramatics and Whining

    I'll follow up with a detailed post, but the short version is ... I didn't like where the old system was going, so I changed how the calculations worked, fundamentally changed the code, updated all the given rep values, and rebuilt the whole world's reputations.

    Don't panic. But it's permanent. Explanation to follow shortly.

  2. #2
    Vampiric Minion Kraco's Avatar
    Join Date
    Oct 2005
    Location
    :noitacoL
    Age
    45
    Posts
    17,924
    Wow... That was quite a crash. With the updated scores, it looks almost as if every hit just gives a few points at max, or something. I'll be looking forward to the detailed explanations, and the new calculator.

    Heh heh. I suppose it's safe to say good bye to the dream of achieving a custom title...

  3. #3
    It looks like the relative positions of everyones rep count haven't changed so i'm gonna guess comp just took a nice bite out of everyone's value, if it was a flat percentage from everyone then looking at the new values is kinda cool because you can really see who had hig rep and who had INSANE rep before this overhaul.

    I'm gonna miss those little boxes though, they made the area under my avatar look so much better

    EDIT: How is this a complaint?
    Last edited by Yukimura; Fri, 05-12-2006 at 06:10 PM.

  4. #4
    Banned mage's Avatar
    Join Date
    Jul 2003
    Location
    Out of the system
    Age
    37
    Posts
    1,810
    i had finally gotten up to 5 squares and now its back to one

    i even got 4 positive reps in a row once!

  5. #5
    Benevolent Dictator
    complich8's Avatar
    Join Date
    Jul 2003
    Location
    some terminal somewhere
    Age
    43
    Posts
    2,189
    Blog Entries
    1
    There were two problems with the system as it was
    First problem: rep power spiraled out of control, blasting nearly every active poster off the rep scale entirely. This rendered the entire system meaningless in the short term, and utterly pointless in the long term.

    Second problem: setting rep factors to a level that doesn't cause things to spiral out of control shuts out new users, making them unable to have a meaningful role in the rep system

    Basically, the population has endpoints that are simply too high. The top users have >6000 posts (terra's currently at 7850, bud's at 6299, assertn at 6896) and have been around as long as the forums have existed. Other users have been around since the forums came into being, but have spent large amounts of time inactive. Still others are newer, but extremely active. And then there's the complete newcomers, who just haven't had any history with us at all.

    The reputation system is supposed to be a way to encourage users to participate and a mechanism to give each other feedback.

    However, as we've seen the last two months (wow, pretty much exactly … I first turned on and explained the rep system on March 11, it's now May 12), there are big problems with the implementation. Many of you have pointed this out.

    There's three variables to control rep power: membership time, post count, and rep score. I think they should all count. But, if any one variable is set to a value that allows new members any influence, old members, high-postcount members, or people who've accumulated large amounts of reputation already become too powerful.

    In the previous system, things were controlled by a linear equation, :
    Code:
    Power = (post count/post factor) + (user age/age factor) + (reputation / rep factor).
    Since these are all integer ops, they lock a user into having no influence until they've exceeded at least one of those factors..

    But some quick math shows us that if we have a low value, then we get disproportionately powerful people in the mix. With all the thresholds at 30, a user like AssertnFailure would get 229 rep power from his post count, and 33 from his age. And that's not including the huge reputation that he would quickly be able to build with other people having that scale of power. Clearly, this is broken.

    But setting this value so Assertn doesn't have 230 rep power just from his post count renders the post weight meaningless. The old value was 400 -- meaning users with 800 posts only got 2 points from it, while Assertn STILL got 18 from it.

    There are a lot of users around who registered back in 2003, and maybe posted a couple times (enough that their accounts didn't get purged for being inactive and having <2 posts). If age alone a substantial rep factor, then those people will be at an advantage. A user who's been around for 3 years, but only made 3 posts in august 2003 and has never been back shouldn't have more power than a user who's made 300 posts in the last 3 months.

    Lastly, there's reputation score. This is the most variable of the lot, because it jumps forward by the power of the person giving you rep. This quickly spirals after a certain threshold - while the equation is linear, the growth along it is quadratic, based on the average rep value of the participants.

    You may be asking yourself at this point, "what's wrong with all of that?" The problem is, the rep display only scales up to 1000. While I can add higher values to the reputation categories, I can't easily change how the display boxes scale. Meaning after a certain point, the average growth rate of reputations becomes greater than the intervals between display categories.

    Further, Tuning any value such that the top end users aren't excessively powerful means shutting new users out of that field as an influence mechanism. And there will inevitably be users who are extremes at any, or even every category.

    When I applied the brakes, the highest rep power calculated out at 186. Not very far away, the next was 178. Now, that's just too damned fast … and as I said, this is a quadratic growth. A single rep hit from one of the highest end reppers increased a user's displayed reputation by nearly two full boxes. That's … at risk of being redundant, too damned much. It means that EVERYONE very quickly goes off the displayable scale of reputations, one way or the other, based on the whims of a small group of more powerful (ie: more popular) people.

    Now, my whole goal in the reputation system experiment was to encourage users to participate - to try to raise both the participation volume, and the average quality of posts. And you know, the system succeeded at that, on the short term. But at the same time, it's pretty plain to me that on the long term, the growth spiral was going to continue indefinitely, powers were going to continue to grow quadratically, and a single hit would be able to completely fill or flatten any user's rep display.

    Even worse, individual users would get the power to disenfranchise anyone they wanted to. Think about it … if user X has a rep power of 200, they can neg rep a newbie, and drop their rep to -100 singlehandedly. Because that's where I set the threshold where reps don't count any longer, that user can no longer participate in the system until someone else finds it in their heart to toss them a positive rep and drag them out of the depths. But I think it's a natural tendency to pre-judge someone with those angry little red boxes proclaiming "this user sucks" - and that's more likely to swing more people to neg rep them.

    Now, this scenario aside, if a new user who's just crossed the threshold into having their rep hits count (at 20 posts, by the old value), gets positive repped by someone with 200 reputation, and the rep factor is 25, that 200-point hit hands them 8 more points of rep power. Still pales in comparison to the 200 points that the giver has, but it's more influence than someone with 20 posts and no prior reps should have. This is sort of a power proliferation problem - by giving you rep power and making the rep factor smaller than your power, inherently every hit you make will be giving the receiver more firepower. And again, with the quadratic expansion of power factors, before long it would get to the point that by simply giving a rep hit, you would give enough power to another person for them to immediately give someone else another point of power (ie: two tiers of power proliferation from a single hit -- this would happen at a rep power of 625 -- with 2000 posts and being a 1 year member of the forum, that would be a rep score of a bit over 15,000 -- not too far off, seeing how growth had already reached higher than 1000 points per week for the top repped people).

    Again, this in itself isn't much of a problem, it's just an inherent quality of the system. By using your rep score to calculate your rep value, you get this sort of thing, and this is where that quadratic growth factor comes from.

    And the thing is, I like that attribute of the system! Or rather, I like the core meaning of it. I want it to be the case that if you are more popular, you've got more influence. That just makes sense -- let the system be a democratic meritocracy. But at the same time, I don't want it to be the case that if you're more popular, you're practically a god, and if you're less popular you're insignificant - because new users are inherently less popular than older ones, regardless of what they try to do. Part of my goal is to attract and keep new users, to keep constantly revitalizing the forums with a stream of new people who stay around. A community like this has two paths: grow and thrive, or stagnate and die, and I'd be ignoring my role as an admin if I encouraged it to stagnate and die (although, admittedly, it would make my life a little easier ).

    So … to summarize the problem, if the system is going to be meaningful and sustainable, then it needs to accommodate both new users and old, and give them fair influence. But fair isn't a linear equation, and linear equations in calculating power lead to quadratic growth and the implosion of the system as a whole.

    So I changed the equation …

    Here's the new general equation, roughly:
    Code:
    Power = 1 + sqrt(post count/post factor) + sqrt(age / age factor) + sqrt(rep score/rep factor).
    (there's some added logic for negative rep scores to keep things rational)

    You guys have put 2 months and about 4000 reputation hits into the old system. I didn't want to discard it, even though it was broken. So instead, I squarerooted all the values of all previous rep hits. Then I recalculated everyone's rep based on the new values for every hit.

    The recalculation of total based on all of that has dramatically moved people, as you've seen. As for what your current rep power is, see RepCalcv2.xls . The top users are still the top users, but they're not so dramatically overpowered anymore.

    I think all of this levels the playing field. Basically, as you get higher and higher values, you get diminishing returns. There's still value in doing more, but it's harder to attain that value. This lets me open all the doors. Every factor is at 30, but users at the extremes won't get incredibly disproportionate amounts of power.

    Finally, a new guideline: quit signing your reps. It's ok if you sign a rep that's thanking someone for someone doing a favor for you (like ... making you a new sig, or solving a problem for you), or if you're asking a favor from them (like, "please pm me that link"). But if you're signing most of your hits, it will be interpreted as rep solicitation, and punished severely (like ... re-squarerooting your received hits, or simply disabling your ability to leave rep).

  6. #6
    Moderator Emeritus masamuneehs's Avatar
    Join Date
    May 2005
    Location
    a fountain pourin' like an avalanche, comin' down the mountain
    Age
    38
    Posts
    3,874
    Quote Originally Posted by woofcat
    Ok, So to be clear, signing reps is now illegal and punishable by law?
    Yup. But as with most laws that can hold water this isn't purely cut-and-dry.

    Quote Originally Posted by complich8
    Finally, a new guideline: quit signing your reps. It's ok if you sign a rep that's thanking someone for someone doing a favor for you (like ... making you a new sig, or solving a problem for you), or if you're asking a favor from them (like, "please pm me that link"). But if you're signing most of your hits, it will be interpreted as rep solicitation, and punished severely
    While it would be safest to stop signing reps alltogether there's obviously some cases that warrant it. From what I've seen I agree this new guideline is in order, as signing reps just for the sake of showing your identity to the person you're Pos Repping certainly reeks of soliciting.

    Humans are different from animals. We must die for a reason. Now is the time for us to regulate ourselves and reclaim our dignity. The one who holds endless potential and displays his strength and kindness to the world. Only mankind has God, a power that allows us to go above and beyond what we are now, a God that we call "possibility".

  7. #7
    Moderator Emeritus masamuneehs's Avatar
    Join Date
    May 2005
    Location
    a fountain pourin' like an avalanche, comin' down the mountain
    Age
    38
    Posts
    3,874
    lol comp you explained it to me last night but i can't quite recall all the specifics... something about a square root beingthrown into the equation?

    All I know is I like the change. Yeah, sure, we all look like we've got no reputation now. That's the way it's supposed to we when the Rep system has only been in effect for 2 months! People maxing out boxes, getting the customs after that little time makes the entire system quite laughable. Imagine if you logged onto a forum and half the users had reputation to the moon.

    This way it seems like the system will more accurately serve as a long term gage of users. Serious props to comp for going through all the trouble of figuring out a better system and implementing it. It certainly wasn't an easy task, as you can see:

    [07:44] * Assassin gives complich8 his thinking cap
    [07:44] <complich8> I'm waist-deep in php right now
    [07:45] * Assassin takes the hat back

    edit - totally agree with comp. Signing reps is from the devil! Cease and desist at once or be destroyed.

    edit again - I totally love my new title, though the fact that switching between that and 'Shaved Butt Monkey' is a matter I have no say in and that comp can do with his pinky in 10 seconds is a bit disconcerting
    Last edited by masamuneehs; Fri, 05-12-2006 at 05:09 AM.

    Humans are different from animals. We must die for a reason. Now is the time for us to regulate ourselves and reclaim our dignity. The one who holds endless potential and displays his strength and kindness to the world. Only mankind has God, a power that allows us to go above and beyond what we are now, a God that we call "possibility".

  8. #8
    Benevolent Dictator
    complich8's Avatar
    Join Date
    Jul 2003
    Location
    some terminal somewhere
    Age
    43
    Posts
    2,189
    Blog Entries
    1
    actually, the code mod itself was pretty easy -- though it would have been easier if that bastard hadn't taken back his cap.

    Just that I don't actually know php, and wasn't terribly familiar with vbulletin code =D. Maybe I'll actually teach myself how to write it (instead of just tweaking it) this summer.

    And yeah, it's basically just "squareroot each component of rep". For the extremely curious, here's a diff! HAHA!

  9. #9
    Fails at reputation woofcat's Avatar
    Join Date
    Dec 2003
    Location
    Ontario Canada
    Posts
    479
    Ok, So to be clear, signing reps is now illegal and punishable by law?

  10. #10
    Vampiric Minion Kraco's Avatar
    Join Date
    Oct 2005
    Location
    :noitacoL
    Age
    45
    Posts
    17,924
    Heh. Well, that was quite a change. Powers sure fell down. This was an act of great equalization. When this whole rep system was established, and everybody started from the scratch (except for select admins), every single rep hit counted. But during the latest times when you had your eyes on the 2500 limit, and nothing else since you didn't anymore get more squares, hits from new users with low power became less meaningful, although they were still nice to get; who wouldn't want his efforts to be appreciated?

    While it's useless to anymore even dream about ever getting up the 2500 score for the custom title (I'll probably be in a grave from old age before that happens), now it's at least possible to once again stare at the squares, and be equally glad about every hit you get.

    And thank you very much for illegalizing the signing of the rep comments. That was a kingdom of fear. No matter what people say, but if they didn't get the favor back, I seriously doubt they were as eager to rep that same person again. And for me who only signed a few comments during the last days (as responses, though "valid" ones for the Event), it was thus a thing of great distress. As much as I wanted to have a custom title, I still didn't want to break the original idea of the reputation system. Now that it's practically impossible to gain the custom title, even slight solicitation of course is much less meaningful altogether.


    Edit: Ciber has one red square and Wilik one green! No need to look any further for the ones who suffered the most...
    Last edited by Kraco; Fri, 05-12-2006 at 06:50 AM.

  11. #11
    Awesome user with default custom title itadakimasu's Avatar
    Join Date
    Feb 2007
    Location
    Ebay
    Age
    40
    Posts
    1,612
    i dont like that persons name... or their avatar or their lack of avatar... i think i will give them negative rep points ^^ WOOOT!!!

    neg rep should be reserved for only select douche bags and haters.. and if you find yourself neg repping every day... you probably fall into one of those two categories.
    Last edited by itadakimasu; Sat, 04-07-2007 at 09:34 PM.

  12. #12
    Moderator Emeritus masamuneehs's Avatar
    Join Date
    May 2005
    Location
    a fountain pourin' like an avalanche, comin' down the mountain
    Age
    38
    Posts
    3,874
    you do need to be more careful with the forum rules... and it's probably not a good idea to complain too much about Negative Reps if you, like you say, don't care about them... I used to Neg Rep anyone who seemd to make such a complaint...

    just learn to let things slide. Rather, maybe these comments aren't helpful, but you could still look at some of those posts and manage to figure out how to improve your arguing and writing. Some neg reps are done out of sheer spite and assholeness, but others have a legit rationale behind them, even if it's not evident from the rep comment.

    Humans are different from animals. We must die for a reason. Now is the time for us to regulate ourselves and reclaim our dignity. The one who holds endless potential and displays his strength and kindness to the world. Only mankind has God, a power that allows us to go above and beyond what we are now, a God that we call "possibility".

  13. #13
    I don't understand the whole anonymity thing... Why not attach names to reps?

  14. #14
    Mainly to prevent the phenomenon known as the "Circle Jerk".

  15. #15
    Well, it helps what I call the neg rep stalkers. They like to stalk people's posts to neg rep.

  16. #16

    Reputation System: Dramatics and Whining

    There are several members with ridiculously low reputation. The current leader is Animeniax.

    I'm going to try to overtake him. Everyone neg rep me as much as possible and see if I can discover the depths of the rep system. Is it doable in one month? We'll find out.

    I will keep a daily record of how many +/- reps I get. There will always be Animeniax fans +repping me. Bastards.

    Merged this thread with the one in Announcements, since they essentially cover the same kind of stuff. Renamed the thread to more accurately reflect the contents...

    Sorry BoC, but I did keep the poll up.
    masa
    Last edited by masamuneehs; Fri, 04-06-2007 at 01:47 PM.

  17. #17
    This should be interesting. Good luck!

  18. #18
    Day 1 results:

    1 positive
    9 negative
    Net change: -61 points

    Keep it up guys!

  19. #19
    Remnant of Woot Lucifus's Avatar
    Join Date
    Sep 2005
    Location
    Photoshop, Eclipse, Notepad
    Age
    34
    Posts
    1,949
    Done and done. Become the baddest on gotwoot.
    Don't believe in yourself, believe in me, who believes in you.


  20. #20
    Decent progress so far today. Keep it up. Don't just neg rep this post...whenever I post anything, neg rep it immediately.

    Day 2 results:

    1 positive
    8 negative
    Net change: -62 points
    Last edited by Board of Command; Sun, 04-08-2007 at 10:28 AM.

Posting Permissions

  • You may not post new threads
  • You may not post replies
  • You may not post attachments
  • You may not edit your posts
  •