Most questions in brilliant have incorrect answers causing substantial drops in ratings. Many users must be facing this. The users whose ratings are high are not solving the lower rating questions. This dicourages expert answers on various problems. The staff should look into this matter.

## Comments

Sort by:

TopNewestI agree. As long as there's inevitably a good fraction of problems that are defective (poor wording, ambiguous, wrong "correct" answers, etc.), Brilliant shouldn't assume that all problems are perfect and base your rating changes on "0 expected return". Brilliant needs to adjust rating changes to take into consideration that a lot of problems have problems with them, instead of hoping that some day all of their problems will be perfect. – Michael Mendrin · 2 years, 6 months ago

Log in to reply

Hi @Ashtik Mahapatra my colleague Sue just posted two notes that address some of the problems with the current ratings system and problem quality control flow. See these notes here:

Updates to the Ratings Algorithm

Problems with Incorrect Answers

Log in to reply

– Ashtik Mahapatra · 2 years, 6 months ago

It is good to see brilliant taking steps to solve these problems. Well done guys.Log in to reply

– Michael Mendrin · 2 years, 6 months ago

I'm gratified to see that the Brilliant staff is having a closer look at these problems. Kudos, guys, keep it up.Log in to reply

– Peter Taylor Staff · 2 years, 6 months ago

Thanks!Log in to reply

Brilliant needs to make their own problem set. – Ahmad Naufal Hakim Ashari · 2 years, 6 months ago

Log in to reply

– Michael Mendrin · 2 years, 6 months ago

Well, unfortunately, it's really hard for the Brilliant staff to be the ones to come up with all the problems, as excellent as their problems are. Brilliant does need contributions of the Brilliant Community to come up with problems, and, anyway, that's half of the mathematical experience--coming up with problems. Not just solving them.Log in to reply

I just think that it would be great if there's a problem set that was made by Brilliant itself.

But what do I know about all these stuff. – Ahmad Naufal Hakim Ashari · 2 years, 6 months ago

Log in to reply

– Ashtik Mahapatra · 2 years, 6 months ago

I agreeLog in to reply