×

# Many problems incorrect

Most questions in brilliant have incorrect answers causing substantial drops in ratings. Many users must be facing this. The users whose ratings are high are not solving the lower rating questions. This dicourages expert answers on various problems. The staff should look into this matter.

Note by Ashtik Mahapatra
2 years, 9 months ago

Sort by:

I agree. As long as there's inevitably a good fraction of problems that are defective (poor wording, ambiguous, wrong "correct" answers, etc.), Brilliant shouldn't assume that all problems are perfect and base your rating changes on "0 expected return". Brilliant needs to adjust rating changes to take into consideration that a lot of problems have problems with them, instead of hoping that some day all of their problems will be perfect. · 2 years, 9 months ago

Hi @Ashtik Mahapatra my colleague Sue just posted two notes that address some of the problems with the current ratings system and problem quality control flow. See these notes here:

Staff · 2 years, 9 months ago

It is good to see brilliant taking steps to solve these problems. Well done guys. · 2 years, 9 months ago

I'm gratified to see that the Brilliant staff is having a closer look at these problems. Kudos, guys, keep it up. · 2 years, 9 months ago

Thanks! Staff · 2 years, 9 months ago

Brilliant needs to make their own problem set. · 2 years, 9 months ago

Well, unfortunately, it's really hard for the Brilliant staff to be the ones to come up with all the problems, as excellent as their problems are. Brilliant does need contributions of the Brilliant Community to come up with problems, and, anyway, that's half of the mathematical experience--coming up with problems. Not just solving them. · 2 years, 9 months ago

I'm not saying that Brilliant is the only one that should be doing this, I sometimes come up with my problems too.

I just think that it would be great if there's a problem set that was made by Brilliant itself.

But what do I know about all these stuff. · 2 years, 9 months ago