How Our Ranking Works

R = average rating for a category
v = number of votes in that category
C = baseline score (9.19)
m = baseline votes (60)
i = each category (Quality, Delivery, Service, Overall, Pricing)

W = (1/5) * Σ [(Rᵢ * vᵢ + C * m) / (vᵢ + m)]

We use a weighted voting formula so rankings are somewhat stable and can't be pushed up or down too much by just a few votes.
For each category (Quality, Delivery, Service, Overall, Pricing), we calculate:

Category Score = (Category Average * Votes + Baseline Score * Baseline Votes) / (Votes + Baseline Votes)
Source Score = (Quality Score + Delivery Score + Service Score + Overall Score + Pricing Score) / 5

Current constants

• Baseline Score (C) = 9.19
  This is a hard coded value, originally designed to be a true site-wide average value. Turned out to be problematic because users vote either 1*; or 5* - which creates extreme volatility.
• Baseline Votes (m) = 60
  Controls how quickly a source moves away from the Baseline Score (C).
  • Sources below m: stay closer to C (harder to swing up or down fast).
  • Sources above m: score reflects real voting more while baseline matters less.

Try the source score calculator

Category	Avg Rating (%)	Vote Count	Weighted Score
Overall			-
Quality			-
Delivery			-
Service			-
Pricing			-
Final Score			-

What could be improved

1. Implement true-to-data Baseline Score(C).
   C = 9.19 hard coded was not my original intention. Like I explained above, the value has been fixed to prevent swings and fluctuations when users rage vote, or, start gobbling source dick because of a particularly successful promo - but it is a fake value in a way and not a 100% representation of reality.
   
   If we change that to reflect true average which is 9.73
   • expect worse differentiation between high and lower ranked sources
   • even higher stability (no movement) in ranks
   • more gaming potential for sources with low vote count
   • But, if people start voting with their heads, C would go down organically and things would normalize
2. Decrease Baseline Votes from 60 to a lower value.
   
   • give smaller sources a better chance of breaking away from the baseline.
   • Not a lot changes for sources with many votes
   • Slightly easier to game ranking (smaller sources dont need as many fake votes to "make it"

Vote for the change you wanna see