BFG's picture
BFG
  • 2.3k
  • ADM
3479

+ 19 How we rank sources (and how you can verify it)

ad

How Our Ranking Works

R = average rating for a category
v = number of votes in that category
C = baseline score (9.19)
m = baseline votes (60)
i = each category (Quality, Delivery, Service, Overall, Pricing)

W = (1/5) * Σ [(Rᵢ * vᵢ + C * m) / (vᵢ + m)]

We use a weighted voting formula so rankings are somewhat stable and can't be pushed up or down too much by just a few votes.
For each category (Quality, Delivery, Service, Overall, Pricing), we calculate:

Category Score = (Category Average * Votes + Baseline Score * Baseline Votes) / (Votes + Baseline Votes)
Source Score = (Quality Score + Delivery Score + Service Score + Overall Score + Pricing Score) / 5

Current constants

  • Baseline Score (C) = 9.19
    This is a hard coded value, originally designed to be a true site-wide average value. Turned out to be problematic because users vote either 1*; or 5* - which creates extreme volatility.
  • Baseline Votes (m) = 60
    Controls how quickly a source moves away from the Baseline Score (C).
    • Sources below m: stay closer to C (harder to swing up or down fast).
    • Sources above m: score reflects real voting more while baseline matters less.

Try the source score calculator

CategoryAvg Rating (%)Vote CountWeighted Score
Overall-
Quality-
Delivery-
Service-
Pricing-
Final Score-

What could be improved

  1. Implement true-to-data Baseline Score(C).
    C = 9.19 hard coded was not my original intention. Like I explained above, the value has been fixed to prevent swings and fluctuations when users rage vote, or, start gobbling source dick because of a particularly successful promo - but it is a fake value in a way and not a 100% representation of reality.
      If we change that to reflect true average which is 9.73
    • expect worse differentiation between high and lower ranked sources
    • even higher stability (no movement) in ranks
    • more gaming potential for sources with low vote count
    • But, if people start voting with their heads, C would go down organically and things would normalize
  2. Decrease Baseline Votes from 60 to a lower value.
    • give smaller sources a better chance of breaking away from the baseline.
    • Not a lot changes for sources with many votes
    • Slightly easier to game ranking (smaller sources dont need as many fake votes to "make it"

Vote for the change you wanna see

rating change

I want true Baseline Score (C)
7% (3 votes)
I want Baseline Votes (m) lowered
9% (4 votes)
Voting algo is fine, leave it as is.
84% (38 votes)
Total votes: 45
CLAPPER's picture

Hey @BFG I gotta a couple ideas that may improve on the model. Fr sent

In a promo × 1
hogwild's picture

Any way to decrease the overall weight or impact of the vote, if it's a vote for promo goods??? Hope that makes sense.

Owes a Review × 1 In a promo × 2
RobertB80's picture

How do you like dem apples? My boys wicked smart!

press1's picture

Matt Damon is literally an old man now, watched a Film on Netflix the other month with him in. I remember when this was one of my favourite films - The Talented Mr Ripley was brilliant too.

Jockstrap's picture

I liked his movies

Real Bruce Wayne's picture

Mostly a lurker, here to read and learn from post and peeps experiences.
One pattern I’ve noticed: new accounts can post star ratings easily, while short, honest reviews often get flagged as “not helpful.” Quick, practical feedback on what worked, what didn’t, and if it’s worth it’ can be just as valuable as a long write up.
I’ve relied on this forum for 10+ years, so it’s eye-opening to see newer sources climb the ranks, often on polished or questionable reviews.

Spool's picture

I’m just a guest in someone else’s house. And I really like this house. Like, a lot. It’s the best house actually.

PIN_CUSHION's picture

15 years, damn. I remember dumb luck stumbling onto this website thinking the whole thing was a scam, but what a game changer this place became. I remember going to the supermarket sending WU’s to the foreign exchange student from Thailand that lived with us. Man how things have changed. @BFG this is the single greatest website, next to xhamster of course. Hopefully there are many bfg’s In Utero.

UncleYoked's picture

lol, you made a source calculator.
Can I pay you to stay out of the top 10?

BFG's picture

Stock up on Ultima, that'll fix it Smile

ArkReunion's picture

Hey, can you please remove me from a promo? I’ve been trying to get out of it for a year now and I been wrote a review for it ages ago. The guy doesn’t even get on here anymore.

Owes a Review × 1 In a promo × 1
scoobydoo's picture

Offer free gear for 5 star reviews in pm. They'll strip your ranking. Lol

Pumped_'s picture

I hear its bad luck

In a promo × 1
Banjokid2020's picture

Would you like good/honest reviews wording wise but give you the lower stars? Lol

In a promo × 1
crystal_test's picture

I do wish there was a good way for small sources to breakthrough. But after thinking on it, it’s virtually impossible.

A few thoughts, though, but it’s’ going to take more math. Create a velocity metric behind the scenes. Large sources have volume, small have velocity. So larger sources with more promos get a weighted vote count the more votes they get (so Top 1 may get a *.8, top 2-10 gets *.9, etc).

You could add a ‘trusted reviewer metric’ on top of that, that prioritizes older accounts and those reviews give higher velocity to the smaller sources. This could be my Karma or date.

Another option is to split sources into large and boutique each with their own ratings. I think there is ‘something’ here because some smaller sources, while they may cost more, are truly domestic brew or have more testing, etc that should warrant some cost benefit to the customer. Since we are not really allowed to cross-pollinate source discussions in the forums, it’s ‘hard’ to learn what those sources are that might provide more benefits other than being the ‘Amazon of sources.’ Some are more than willing to pay for ‘extras’ and piece of mind.

BTW, something I wish that would be implemented, every review has to have the date in the photo (like written on a piece of paper or card). But people can’t follow simple instructions now…

But all of that is hard to manage and there is still room to game.

BFG's picture

Interesting ideas but since we're transitioning to a new codebase soon-ish it's out of scope right now.
Users already have the option to privately submit order numbers with their reviews to intended as proof or purchase, i think you're pushing it with mandatory order pics Smile
Btw you seem reasonable how did you earn that -17

crystal_test's picture

I think you or another admin hit me for sounding like a USROIDS dick rider when they were going through their drama. Feel free to fix it or zero me out :).

Greg's picture

You created a second account because your original account was -25. You (A) violated the rules creating a second account. (B) you weren't going to walk away from the hole you dug in the first account.

Petecastiglione's picture

I’d let you dig into my hole Greg (no homo)

In a promo × 1
Waltdisneysbum's picture

Nice post @BFG !

I'm really not interested in all the squabble but you talking about your first BTC payments gives me flashbacks to when I was holding some BTC around that same time, roughly 10 BTC
Sent it to a wallet in return for something that never arrived... Wish I just kept it and forgot about it Cray 2

In a promo × 1
BFG's picture

Yeah sucks I know.. I bought a phone for 10btc once...

press1's picture

NOOOOOooooooo LMAO!!! Rodney you Plonker!!!! Lol

That would be worth £500,000 right now mate

Waltdisneysbum's picture

You're telling me LOL

Sometimes I sit and think how close I was to riches, there's been a couple times in my careers and personal life where I could've hit it big...
But then I wouldn't have the joys of working 37.5 hours a week I guess! Crazy

In a promo × 1
press1's picture

Pal there are many times I think back to my 20's when I made some really bad money decisions when I was earning a fortune. I was a young lad and wanted it all right here right now attitude, if I'd of just held back and put my money into other things that I knew worked in the long term everything could of been different. But hell, we've all been there haven't we. The Gift of Life being alive, happy and healthy each day is the best ultimately.

Greg's picture

I spent fifty-one years building things that didn't belong to me... Fences for kings... silver that never stayed in my pocket. You look back and all you see is a dry trail of unmet promises. But a man’s gotta decide, before the light fails him... exactly where he’s going to stand.

I spent a lot of time chasing things that didn't matter for much.

Pumped_'s picture

I remember specifically my assistant manager came into my office in late 2000s talking about buying Bitcoin and wanted me invest a couple hundred to by a few and i told him go to helland stop believing this crap he probably read on myspace. Still kick myself in the ass everytime i buy bitcoin for purchases

In a promo × 1
TheIcon's picture

I opened a Kraken account years ago. I just recently was able to access it. I thought for sure this was going to be one of those newspaper articles where user finds bitcoin in long forgotten account. Sadly I didn't buy any in my Kraken account which is very odd for me. Because I have no clue why I would have went through with creating a login and account and not acctually using it. Not even $100 bucks worth.

SeeOhShow's picture

Don’t think anything is wrong with system, but I do think some of the rules could be fleshed out a little bit more. For example, it doesn’t explicitly say no packaging materials in photos, just says not to share shipping methods. That, to me, would mean carriers. If there’s things that result in bans, then there should be no room for interpretation on said rule.

  1. Engaging in any business activity, including buying or selling through our messaging system, is prohibited and may result in a ban.

Could instead say:
1. Engaging in any business activity, including buying/selling through our messaging system or recommending sources outside of eroids, is prohibited and may result in a ban.

In a promo × 1
Greg's picture

"Hey, do you know where?" And, "Hey thanks for accepting my friend request, you seem cool. Gimp gear in Facebook is g2g check him out."

Do you think there's no difference between the ask and tell and the solicitation be it just excitement or a paid shill (and how do you differentiate? )

SeeOhShow's picture

Based on the vagueness of the rule, I’d say those are both equal in the eyes of judge. In both of those scenarios, the ask and the shill, it could be implied “business” is being done via PM.

I personally see nothing wrong with someone asking me for an opinion via pm and I say “I’ve used X, Y, and Z and I think they’re good to go” with “X” and “Y” being eroids sources and “Z” being a non-eroids source. However, if that is considered “business”, then let’s explicitly state so. If I’m getting nothing out of the scenario, be it money or free gear, then I’m not conducting business nor shilling. I’m merely giving advice from personal experience.

In a promo × 1
Greg's picture

Maybe the intention is to get you to err on the side of caution.

You're over thinking it and not giving BFG the benefit of the doubt to trust he has the discretion to know the difference. He rarely steps in to ban someone much less for frivolous issues.

Greg's picture

You're like that twig of a guy that keeps mouthing off because it's not a good look for the much bigger guy to deck him.

I guess I'm not that big after all. God dang it, you won.

Min Diesel's picture

Lol, I wish we could institute a drama meter. Some sources have legit gear but always having some kinda fuckin drama, sometimes it’s good to stay away until the drama dissipates.

Min Diesel's picture

Swoleoil was before my time, but swoleoil sounds legit af lol. Yeah I know who. For some reason i keep getting caught up in dramatic sources. I’m addicted to abusive toxic relationships ever since i broke up with dc tom. I can’t help my self.

olemasta's picture

Lmao you done poured the whole bottle for the homies braddah man.

In a promo × 1
DonutMan's picture

This has been the only site I’ve used for my gear source since I started over 12 years ago. I base where I get mine from based on reviews from legit members and blood work posted under said source.

Owes a Review × 1 In a promo × 1
Teeeethreee's picture

Can I Barrow Five bucks?

In a promo × 1
Drexyl's picture

I need about $1,500 but I’ll pay interest.

Teeeethreee's picture

BeeEffGee has a high Vig

In a promo × 1
press1's picture

'Me Maaaa needs a New Caravan ........ LMFAO

Bodhi's picture

Love Snatch, such a great movie.

It's a camp site, a pikey campsite...
Ten points.
What we doing here?
We're buying a caravan.
Off a pack of fuckin' pikeys? What's wrong with you? This will get messy.
Well not if you're here.
Oh, you bastard! I fuckin' hate pikeys!

Teeeethreee's picture

It’s for Mi MaAA lol

In a promo × 1
Bill1976's picture

This is a great site no matter what. I asked a juice head at my gym where I could find gear 7 years ago. He gave me an online source. When I looked it up I happened to stumble in to this site. That source is on here. Go figure. I had no idea how to inject or what to take or even how to dose it.
The guy at my gym said I could run my first cycle using 500 mgs of testosterone a week and I could run tren my first cycle at 600 mgs a week for 10 weeks. Then kickstart with anadrol at 150 mgs a day for the whole ten weeks on my first cycle of I wanted to be huge.
You see where I’m going with this? I could have fucking died. He’s dead now. Died at age 44.
This is a true story. Not some made up bullshit.
Thanks for opening this site. I might be dead if this site didn’t exist. I do think the promos give an u fair advantage for gear. You feel obligated to give a 5 star review unless you make a purchase with your promo order. Which is what I always do.

Aggieguy's picture

Well here is the thing, if you do not give a source a 5 star review they get offended and they will not ever select you for a promo again. Sources PM members and tell them to give a 5 star review and will offer a promo. Its happened to lots of members on here.

In a promo × 1
Khandum's picture

Ain’t anyone on this sight who would say no to that, also ain’t that against the rules? It would be classified speaking business in the PM’s, am I wrong?

In a promo × 2
More by BFG