# How to prevent users from misusing Hard? Ideas are welcome **URL:** \ **Category:** Suggestions\ **Created:** [September 6, 2024, 1:01pm UTC](https://forums.ankiweb.net/t/how-to-prevent-users-from-misusing-hard-ideas-are-welcome/49092 "2024-09-06T13:01:28Z")\ **Posts on this page:** 20\ **Page:** 4
**Author:** ![Expertium](https://sea2.discourse-cdn.com/flex002/user_avatar/forums.ankiweb.net/expertium/32/24176_2.png) [@Expertium](https://forums.ankiweb.net/u/Expertium)\ **Post date:** [September 11, 2024, 10:27am UTC](https://forums.ankiweb.net/t/how-to-prevent-users-from-misusing-hard-ideas-are-welcome/49092/61 "2024-09-11T10:27:45Z")
@dae today I will post a survey about this answer button design on r/Anki. In the meantime, [I came up with a way to algorithmically detect whether someone is misusing Hard](https://github.com/open-spaced-repetition/srs-benchmark/issues/121). Just do 3 checks: 1. Check if w\_15 (a parameter in the parameters field) is \<0.01 2. Check if RMSE is \>5.0% 3. Check if the number of reviews is \>1000, just to avoid false positives If all 3 are true, display the following pop-up message: > There is a possibility that you are using the Hard button incorrectly. When you press Hard, Anki assumes that you have successfully recalled the card. > Please keep in mind that Hard is not “fail”, it’s “pass”. It’s not 100% reliable, but it should be reliable enough. And it’s as simple as it gets: three else-if statements and a pop-up. Doesn’t get much simpler than this. EDIT: nevermind, LMSherlock found a problem with my idea. ---
**Author:** ![sorata](https://sea2.discourse-cdn.com/flex002/user_avatar/forums.ankiweb.net/sorata/32/34115_2.png) [@sorata](https://forums.ankiweb.net/u/sorata)\ **Post date:** [September 11, 2024, 1:06pm UTC](https://forums.ankiweb.net/t/how-to-prevent-users-from-misusing-hard-ideas-are-welcome/49092/62 "2024-09-11T13:06:59Z")
1. But it will be hard to do in mobile clients where most reviews happen IMO. You don’t have enough space to put a gap between Again and other buttons and similar coloured buttons would be a nightmare to distinguish from each other. 2. Dae is simply prioritising other stuff, so you are not convincing him with a survey. Might be useful for future reference though. ---
**Author:** ![Deranged6605](https://avatars.discourse-cdn.com/v4/letter/d/e9a140/32.png) [@Deranged6605](https://forums.ankiweb.net/u/Deranged6605)\ **Post date:** [September 12, 2024, 12:04am UTC](https://forums.ankiweb.net/t/how-to-prevent-users-from-misusing-hard-ideas-are-welcome/49092/63 "2024-09-12T00:04:51Z")
Just put the again on top ---
**Author:** ![ZpLiu](https://avatars.discourse-cdn.com/v4/letter/z/4bbf92/32.png) [@ZpLiu](https://forums.ankiweb.net/u/ZpLiu)\ **Post date:** [September 12, 2024, 12:56am UTC](https://forums.ankiweb.net/t/how-to-prevent-users-from-misusing-hard-ideas-are-welcome/49092/64 "2024-09-12T00:56:36Z")
I can not appreciate my thanks for your effort in this picture presented. ---
**Author:** ![Expertium](https://sea2.discourse-cdn.com/flex002/user_avatar/forums.ankiweb.net/expertium/32/24176_2.png) [@Expertium](https://forums.ankiweb.net/u/Expertium)\ **Post date:** [September 12, 2024, 10:49am UTC](https://forums.ankiweb.net/t/how-to-prevent-users-from-misusing-hard-ideas-are-welcome/49092/65 "2024-09-12T10:49:38Z")
Here are the results so far: [Answer Buttons Design](https://docs.google.com/forms/d/1wexSJAQ3L8_-IBsnQ_Vs6shtG6cJnufGb9_XRB0ouQE/viewanalytics) 8-9% of users thought that Hard = fail ![20240912_135114](https://us1.discourse-cdn.com/flex002/uploads/anki2/original/3X/9/0/901e0a966254a1b574af05525130220c61c2bf01.jpeg) Around half of users like this design ![Answer buttons design to prevent misues](https://us1.discourse-cdn.com/flex002/uploads/anki2/original/3X/8/0/80aa64013865b28530c9d3d92a47f2d0a51d416c.png) Around 75% of users think that it’s helpful for solving tbe problem with misusing Hard. I deliberately asked two different questions - do you like it vs do you think it’s helpful. There are more people who think that it’s helpful than people who like it. @dae this should give you a good idea how many users are misusing Hard, and maybe nudge you towards a UI redesign. @L.M.Sherlock so do you think my idea with detecting who is misusing Hard based on w\_15 and RMSE will work? I think it will. It will most likely produce more false negatives (the user IS misusing Hard, but the system didn’t detect it) than false positives (the user isn’t misusing Hard, but got a pop-up). I think that’s good, it means that it won’t be an annoyance for normal users. ---
**Author:** ![Whar](https://sea2.discourse-cdn.com/flex002/user_avatar/forums.ankiweb.net/whar/32/23290_2.png) [@Whar](https://forums.ankiweb.net/u/Whar)\ **Post date:** [September 12, 2024, 1:47pm UTC](https://forums.ankiweb.net/t/how-to-prevent-users-from-misusing-hard-ideas-are-welcome/49092/66 "2024-09-12T13:47:44Z")
I think a good solution for the mobile UI could be this: [[Album] imgur.com ![](https://us1.discourse-cdn.com/flex002/uploads/anki2/original/3X/1/f/1fba9e71c402d8c8c743e417f311a1e0c36bad11.png "imgur.com") ](https://imgur.com/a/nhdGqDg) ---
**Author:** ![Expertium](https://sea2.discourse-cdn.com/flex002/user_avatar/forums.ankiweb.net/expertium/32/24176_2.png) [@Expertium](https://forums.ankiweb.net/u/Expertium)\ **Post date:** [September 12, 2024, 1:50pm UTC](https://forums.ankiweb.net/t/how-to-prevent-users-from-misusing-hard-ideas-are-welcome/49092/67 "2024-09-12T13:50:23Z")
Good should be the biggest button because it’s the one you are expected to press most often: 1. Again will only be used 15-5% of the time, for most users 2. Hard and Easy are expected to be used when Good is not good enough for whatever reason ---
**Author:** ![sorata](https://sea2.discourse-cdn.com/flex002/user_avatar/forums.ankiweb.net/sorata/32/34115_2.png) [@sorata](https://forums.ankiweb.net/u/sorata)\ **Post date:** [September 12, 2024, 3:12pm UTC](https://forums.ankiweb.net/t/how-to-prevent-users-from-misusing-hard-ideas-are-welcome/49092/68 "2024-09-12T15:12:52Z")
we can just do the colours. that should be better. ---
**Author:** ![Expertium](https://sea2.discourse-cdn.com/flex002/user_avatar/forums.ankiweb.net/expertium/32/24176_2.png) [@Expertium](https://forums.ankiweb.net/u/Expertium)\ **Post date:** [September 12, 2024, 3:23pm UTC](https://forums.ankiweb.net/t/how-to-prevent-users-from-misusing-hard-ideas-are-welcome/49092/69 "2024-09-12T15:23:43Z")
AnkiDroid already has different colors for buttons ---
**Author:** ![sorata](https://sea2.discourse-cdn.com/flex002/user_avatar/forums.ankiweb.net/sorata/32/34115_2.png) [@sorata](https://forums.ankiweb.net/u/sorata)\ **Post date:** [September 12, 2024, 4:43pm UTC](https://forums.ankiweb.net/t/how-to-prevent-users-from-misusing-hard-ideas-are-welcome/49092/70 "2024-09-12T16:43:10Z")
I feel like now I know why this happens. Look at these buttons from the new reviewer — ![Screenshot_2024-09-12-22-06-51-96_a9eef3a2a561b80d5c76daebd0f9a14c](https://us1.discourse-cdn.com/flex002/uploads/anki2/original/3X/8/d/8d2c1561f3efb158000360b3e56e1dd95953ce82.jpeg) I mean look at the colours we have. I already think it’s easy to categorise the buttons into **Good** + **Easy** / **Again** + **Hard**. If you now look at the colours **Again** + **Hard** have very similar looking colours. I’d expect the colours to communicate something but here they have the potential to miscommunicate. Making **Hard** + **Good** + **Easy** different shades of the same colour (or different but similar colours) might be a good idea (I mean, all green can confuse you). But clearly, something needs changing here. (I checked and found the same issue with AnkiMobile) ---
**Author:** ![Expertium](https://sea2.discourse-cdn.com/flex002/user_avatar/forums.ankiweb.net/expertium/32/24176_2.png) [@Expertium](https://forums.ankiweb.net/u/Expertium)\ **Post date:** [September 12, 2024, 4:55pm UTC](https://forums.ankiweb.net/t/how-to-prevent-users-from-misusing-hard-ideas-are-welcome/49092/71 "2024-09-12T16:55:18Z")
@David how about this? ![AnkiDroid button colors](https://us1.discourse-cdn.com/flex002/uploads/anki2/original/3X/3/0/3023b312f96abc486f4376c73dfcfb29d1424d74.png) Although colorblind people will beat us with rocks for this ---
**Author:** ![raresxd](https://sea2.discourse-cdn.com/flex002/user_avatar/forums.ankiweb.net/raresxd/32/22793_2.png) [@raresxd](https://forums.ankiweb.net/u/raresxd)\ **Post date:** [September 12, 2024, 4:57pm UTC](https://forums.ankiweb.net/t/how-to-prevent-users-from-misusing-hard-ideas-are-welcome/49092/72 "2024-09-12T16:57:01Z")
I’m a beginner when it comes to Anki so correct me if I’m wrong but the wording doesn’t seem that intuitive. “Good” should probably be the most casual button when it comes to grading a card as correct, so “I hesitated a little” might spark some confusion to some users. Removing that part and only leaving “My answer was correct” is better imo. I agree with the other buttons, though the “easy” one might benefit from some other wording. ---
**Author:** ![Keks](https://sea2.discourse-cdn.com/flex002/user_avatar/forums.ankiweb.net/keks/32/20537_2.png) [@Keks](https://forums.ankiweb.net/u/Keks)\ **Post date:** [September 12, 2024, 5:12pm UTC](https://forums.ankiweb.net/t/how-to-prevent-users-from-misusing-hard-ideas-are-welcome/49092/73 "2024-09-12T17:12:52Z")
Ankidroid: [![Imgur](https://us1.discourse-cdn.com/flex002/uploads/anki2/original/3X/a/0/a00bd916c9d1c4a148ee1ed7ee18a5442d5f2ef2.jpeg "imgur.com") ](https://imgur.com/Vo0SuZY) [![Imgur](https://us1.discourse-cdn.com/flex002/uploads/anki2/original/3X/5/e/5e8442bf94ecd514c5d3cc061c309e10e26ea2c8.jpeg "imgur.com") ](https://imgur.com/B26TeoO) Different colors have the advantage of making it easier to aim at the buttons. ---
**Author:** ![Keks](https://sea2.discourse-cdn.com/flex002/user_avatar/forums.ankiweb.net/keks/32/20537_2.png) [@Keks](https://forums.ankiweb.net/u/Keks)\ **Post date:** [September 12, 2024, 5:15pm UTC](https://forums.ankiweb.net/t/how-to-prevent-users-from-misusing-hard-ideas-are-welcome/49092/74 "2024-09-12T17:15:08Z")
It takes up a lot of space on the screen. To be honest, the only viable option is a two-button mode for beginners. ---
**Author:** ![sorata](https://sea2.discourse-cdn.com/flex002/user_avatar/forums.ankiweb.net/sorata/32/34115_2.png) [@sorata](https://forums.ankiweb.net/u/sorata)\ **Post date:** [September 12, 2024, 5:17pm UTC](https://forums.ankiweb.net/t/how-to-prevent-users-from-misusing-hard-ideas-are-welcome/49092/75 "2024-09-12T17:17:29Z")
My screenshot was from the new reviewer which has colours similar to the AnkiMobile app. The current one is better. ---
**Author:** ![Deranged6605](https://avatars.discourse-cdn.com/v4/letter/d/e9a140/32.png) [@Deranged6605](https://forums.ankiweb.net/u/Deranged6605)\ **Post date:** [September 13, 2024, 12:47am UTC](https://forums.ankiweb.net/t/how-to-prevent-users-from-misusing-hard-ideas-are-welcome/49092/76 "2024-09-13T00:47:26Z")
This is what I’m talking about🤣. And to be honest, this is basic form of it. No changes to colours or wording, just design ---
**Author:** ![sorata](https://sea2.discourse-cdn.com/flex002/user_avatar/forums.ankiweb.net/sorata/32/34115_2.png) [@sorata](https://forums.ankiweb.net/u/sorata)\ **Post date:** [September 13, 2024, 4:11am UTC](https://forums.ankiweb.net/t/how-to-prevent-users-from-misusing-hard-ideas-are-welcome/49092/77 "2024-09-13T04:11:03Z")
> [@Expertium](#): > > Although colorblind people will beat us with rocks for this 🤣🤣 u come up with some hilarious phrases. tbh, we can have some accessibility setting to change colours. well, we wouldn’t need to do any of this if 2 button mode became a default option. ---
**Author:** ![L.M.Sherlock](https://sea2.discourse-cdn.com/flex002/user_avatar/forums.ankiweb.net/l.m.sherlock/32/16770_2.png) [@L.M.Sherlock](https://forums.ankiweb.net/u/L.M.Sherlock)\ **Post date:** [September 13, 2024, 6:48am UTC](https://forums.ankiweb.net/t/how-to-prevent-users-from-misusing-hard-ideas-are-welcome/49092/78 "2024-09-13T06:48:03Z")
We don’t have the real labels in the dataset, so we don’t know how accurate the detecting method is. ---
**Author:** ![Expertium](https://sea2.discourse-cdn.com/flex002/user_avatar/forums.ankiweb.net/expertium/32/24176_2.png) [@Expertium](https://forums.ankiweb.net/u/Expertium)\ **Post date:** [September 13, 2024, 9:51am UTC](https://forums.ankiweb.net/t/how-to-prevent-users-from-misusing-hard-ideas-are-welcome/49092/79 "2024-09-13T09:51:48Z")
We do though. Or by “real” do you mean “extracted directly from the user’s brain”? In which case, I agree, we don’t. ---
**Author:** ![L.M.Sherlock](https://sea2.discourse-cdn.com/flex002/user_avatar/forums.ankiweb.net/l.m.sherlock/32/16770_2.png) [@L.M.Sherlock](https://forums.ankiweb.net/u/L.M.Sherlock)\ **Post date:** [September 13, 2024, 10:15am UTC](https://forums.ankiweb.net/t/how-to-prevent-users-from-misusing-hard-ideas-are-welcome/49092/80 "2024-09-13T10:15:25Z")
How confident do you think about the detecting method? My prior is 50%. If we could collect some data from those respondents and check whether their w\_15 is close to 0, I will be more confident. [Previous page](https://forums.ankiweb.net/t/how-to-prevent-users-from-misusing-hard-ideas-are-welcome/49092.md?page=3) [Next page](https://forums.ankiweb.net/t/how-to-prevent-users-from-misusing-hard-ideas-are-welcome/49092.md?page=5)