Suggestion to Damien: Migrating to an NN (Neural Net)

Anki Suggestions
21

Any estimates on how buggy it will be on old devices (phones especially)?

22

Right now itā€™s slow as hell. Alex said right now RWKV can process like 13 reviews/second. But there are many ways to speed it up. Itā€™s not impossible, but it does require someone who knows this stuff and is willing to put in the work.

We could probably get to 1000 reviews/second + use a smart way to prioritize some cards to run RWKV on, to save some time.

1 Like
23

Given you seem somewhat positive about RWKV, what do you think of all the FSRS related work? Feels like that was for nothing if now we just ditch FSRS and do RWKV.

1 Like
24

Well, thatā€™s just the nature of progress. New stuff replaces old stuff. Plus, maybe some users would prefer FSRS (we would keep both).

3 Likes
25

Anki using SM2, FSRS, RWKV all at the same timeā€¦

1 Like
26

What about implementing RWKV as an addon at first. Some users would trade speed for precision

1 Like
27

As far as I know, the neural network seems to be too big to be used as a plugin

1 Like
28

Alex isnā€™t interested in maintaining add-ons so we wonā€™t have anyone for the work too

1 Like
29

If the size of the file is too large it is easier to use add-ons, when uploading to AnkiWeb there is a limit of about 150MB but add-ons can download files from outside after installation, so there is no limit. (e.g. Ankimon, Ankihub) I donā€™t know about NN but the RWKV that Expertium mentions looks very small size.

2 Likes
30

The weights for RWKV are like 10 MB, so thatā€™s not a problem. But Iā€™m not sure if using an add-on is possible. I asked Alex in the Anki Discord server, Iā€™ll copy his replyā€¦if he replies.

1 Like
31

Do you have experience yourself for making an addon like this to host the NN if the plan goes through. Doesnt have to be RWKV, but we are still here talking about it.

1 Like
32

I donā€™t know how it works because I havenā€™t studied anything about NN. If the program is already working and does not need adjustment it is probably possible to embed it in an add-on, but in that case maybe other developers can develop it, AI is popular among developers so there are relatively many developers of add-ons related to AI.

2 Likes
33

Letā€™s wait a few weeks/months/years for Alex to make an account to post on the forum :laughing:
In the meantime I will be a messenger, lol

image
image673Ɨ110 14.7 KB

2 Likes
34

It does not sound practical to integrate in the near future, and we still have our hands full dealing with FSRS.

3 Likes
35

Fair enough :+1: Once FSRS reaches its full potential, then maybe this could be revisited.