# Brilliant Ratings

If nobody else can see your ratings, and you're already at Level 5, why do ratings matter at all? Whether they go up or down as you solve or not solve problems? What's the incentive to solve problems correctly the first time, or at all?

Note by Michael Mendrin
7 years, 4 months ago

This discussion board is a place to discuss our Daily Challenges and the math and science related to those challenges. Explanations are more than just a solution — they should explain the steps and thinking strategies that you used to obtain the solution. Comments should further the discussion of math and science.

When posting on Brilliant:

• Use the emojis to react to an explanation, whether you're congratulating a job well done , or just really confused .
• Ask specific questions about the challenge or the steps in somebody's explanation. Well-posed questions can add a lot to the discussion, but posting "I don't understand!" doesn't help anyone.
• Try to contribute something new to the discussion, whether it is an extension, generalization or other idea related to the challenge.

MarkdownAppears as
*italics* or _italics_ italics
**bold** or __bold__ bold
- bulleted- list
• bulleted
• list
1. numbered2. list
1. numbered
2. list
Note: you must add a full line of space before and after lists for them to show up correctly
paragraph 1paragraph 2

paragraph 1

paragraph 2

[example link](https://brilliant.org)example link
> This is a quote
This is a quote
    # I indented these lines
# 4 spaces, and now they show
# up as a code block.

print "hello world"
# I indented these lines
# 4 spaces, and now they show
# up as a code block.

print "hello world"
MathAppears as
Remember to wrap math in $$ ... $$ or $ ... $ to ensure proper formatting.
2 \times 3 $2 \times 3$
2^{34} $2^{34}$
a_{i-1} $a_{i-1}$
\frac{2}{3} $\frac{2}{3}$
\sqrt{2} $\sqrt{2}$
\sum_{i=1}^3 $\sum_{i=1}^3$
\sin \theta $\sin \theta$
\boxed{123} $\boxed{123}$

Sort by:

Personal gain and achievement. I don't care what people think about what my ratings and my levels are. I care about my own personal goals, if I am being able to solve a challenging problem, or to judge my own skill level, where I stand in a particular topic.

It's one of the basic philosophies on which Brilliant is built upon. Ratings are like money (I couldn't think of a better analogy), when you see your rating go down or up it triggers an emotional response, same as when you lose some belonging, or like when you're not able to save the ball going in the net in soccer, etc. You feel the sense of failure and nobody likes failure. So you'd want to try again, and again, and again, until you get it right, sometimes just to prove a point. The point that you are not stupid. Hence when you solve a problem correctly and see your rating go up, you feel happy, you feel confident, you feel like you can take on the world (at least I feel that way).

So ratings help us judge our progress and are a vital part of any system where there's a factor of win/lose, like in games, or for educational purposes, like at Brilliant.

Also, even though ratings aren't shown, you can look at the levels a person is at in any given topic by going to their profile which gives an idea of their skills. So you can to some extent compare how you are doing with respect to other people.

- 7 years, 4 months ago

I think solving a problem is its own reward. The trouble with the Brilliant rating system is that it appears to behave fairly randomly, so I lose interest in it.

- 7 years, 4 months ago

I agree with you somewhat about randomness but what I really like here is the passion people have to create and share questions by thinking out of box. So your score is derivative of questions you score but at the same time question's difficulty level is also derivative of people's score and I think for that purpose this score system does fair job.

- 7 years, 4 months ago

Well it's good that we can see a rating for a problem, so that we have an idea of how difficult it is going to be. However, I notice that the actual range of difficulty for problems "between 2000 and 2400" can be considerably greater than what the ratings would suggest.

- 7 years, 4 months ago

Can you clarify what you mean by 'random'?

Is it only that "the actuarial range of difficulty for problems between 2000 and 2400 can be considerably greater"? Does this comment apply only to "newly released" problems (esp those at the top of your newsfeed), or even to historical problems?

Are there other parts of it which confuse you?

Staff - 7 years, 4 months ago

Calvin, I'm a newbie here, only been around for a bit longer than a week. Still getting my bearings, solved a few problems, not really clear what the objectives are, other than just having fun solving problems.

By "random" is that while I can see now how my points are racking up with solving rated problems (and nothing from unrated problems), what's happening with my own ratings is not so clear cut. Kind of like how your credit score is affected by what you do---most of the time, it's unpredictable. I still have little or no idea on how to 1) consistently boost my ratings, and 2) keep it from dropping. So I don't bother with it any more, as it's interfering with my choice of problems to work on.

- 7 years, 4 months ago

Yes! I hate how the problems make you lose so many rating points that you can't even try problems that you don't know exactly how to solve.

- 7 years, 4 months ago

In fact, ratings are most useful to me in identifying the problems that can actually increase my points. Other than that, I'm not sure what they're good for.

- 7 years, 4 months ago

Well with some reverse engineering of scoring method I can approximately tell you how it works Calvin above may know better :) Check out the table below which shows my score movement when I attended multiple questions from Algebra http://i58.tinypic.com/6sgfq0.png

I can make following observations from the table: (1) You have level wise minimum points for answering (2) For a question which is above your rating you get approx 10% of the point differential . Or they are giving points based on Ranged table of point differential.

May be I am completely off but that's what I can see

- 7 years, 4 months ago

Now that's funny, it's worthy of a Brilliant question in its own right, "how are Brilliant ratings computed?" Your chart was very illuminating.

- 7 years, 4 months ago

But after seeing how it works, I think I understand now, if you're starting at lower than Level 5, the rating system helps encourage you to build it up. But once once you get to Level 5, well, I don't see any problems rated higher than 2500. Yet. What would be the rating of the Riemann Hypothesis? Probably 2600.

- 7 years, 4 months ago

It can be hard for a new member to understand ratings. We have a brief explanation initially, but cannot do it justice without having you experience the problem solving aspect, along with the interaction of other members.

The simplest understanding is that your ratings drop when you answer a problem incorrectly, and they increase when you answer a problem correctly. The extent of change is dependent on the relative rating of the problem, which then complicates matters.

I'm glad to see that you are beginning to get the hang of ratings. As you realized, you should be much more likely to solve problems with a rating lower than your own. There are definitely problems rated > 2500, but those are very rare creatures.

We previously thought of displaying the change of rating, but felt that it would have been much more complicated to understand. Do you feel that this would be helpful? IE you are told that "solving this problem correctly will raise your rating by 20 points. Solving this problem incorrectly will lower your rating by 30 points"

Staff - 7 years, 3 months ago

Lin, Vikram Pandya already did a pretty good job explaining how the ratings work, below. I have mixed feelings about the value of ratings, am I here to keep boosting my ratings, or just solve problems and ignore the ratings? Right now I'm kind of leaning towards the latter.

- 7 years, 3 months ago

Technically speaking, if you look at too many solutions/give a lot of wrong answers at Level 5, your rating could drop to a level such that you reach Level 4. Thus, ratings definitely play an important role even for Level 5 people!

- 7 years, 4 months ago

They don't decrease your rating for clicking on See Solution. But they will definitely decrease it if you solve a question wrong. Of course, I don't think anyone who deserves to be in Level 5 will do enough wrong to get to Level 4. Possibly someone on the borderline...

- 7 years, 4 months ago

Does our rating decrease with time?

- 6 years, 8 months ago