I feel like this is deserving of its own topic. [image] Anki 24.10 Release candidate Beta Testing It’s a known issue: [image] FSRS-5 is the Python version. In 55.4% cases, it’s better than FSRS-rs (the Anki optimizer), but worse in 44.6% cases. [image…

Fixed in Feat/align FSRS-rs with PyTorch Implementation by L-M-Sherlock · Pull Request #3540 · ankitects/anki · GitHub

Can you do something like you did for CMRR? Say, here if it takes 5 secs with the slow method it’s probably worth trying it. If it takes 20 secs then do optimisation with one seed.

I’ll bet that’s not happening.

That’s what I will probably do, if it turns out that there is a significant (both statistically and practically) difference between using 1 and 10 seeds. I’ll make the number of “runs” depend on the number of reviews. (well, I’ll ask Jarrett to implement it)

What about the number of presets? Wouldnt it be extremely painful if you are to optimise params for 240+ different presets?

Don’t make 240 presets, buddy But seriously though, it’s the number of reviews that matters. The amount of time spent on optimization depends on the number of reviews, not presets.

A bit unrelated…Is there any progress on this. [image] Number of Cards worthy of a Preset FSRS Is there a particular number of cards that a deck should have for it to be deserving of its own preset? I have decks ranging from only <100-1000+ cards and it can vary widely, a…

No, but we will get a new dataset soon, and then we’ll measure how much metrics improve if parameters are set for every preset/deck individually. However, it will be difficult to figure out the optimal number of decks/presets. We will be able to calculate how much of a difference it makes on averag…

So, this and what else are you willing to test. It seems that you and Jarrett have a lot on your heads. [image] Number of Cards worthy of a Preset FSRS That’s something me and LMSherlock would like to investigate, but since our dataset doesn’t have deck/preset names, we ca…

Right now I’m just gonna wait for like 30 hours to test 1 vs 10 seeds. That stuff takes forever even on a relatively small dataset EDIT: update, I finished doing it with 2 seeds on 200 collections, some with (relatively) few reviews, and some with a lot of reviews. Note that I deliberately selected…

Thank you Jarrett :grin:. Does this mean FSRS Python is as good as FSRS Rust now? How much decrease in RMSE does this bring? I suppose this topic has served its purpose. @expertiumi would like to move the discussions about the sims and the new ideas to a new topic.

FSRS 5: Optimizer

Anki FSRS

DerIshmaelite October 27, 2024, 3:00pm 19

A bit unrelated…Is there any progress on this.

Topic		Replies	Views
Anticipated Features in 24.10 Help	40	820	October 27, 2024
When/How to separate presets for FSRS FSRS	27	1811	December 12, 2024
Measures to prevent new FSRS parameters from being worse than the old ones Suggestions	28	2976	January 28, 2024
25.02 possible bug - minimum recommended retention 0.70 FSRS	19	579	February 27, 2025
FSRS 5: Ideas and Sims FSRS	9	308	October 29, 2024

FSRS 5: Optimizer

Related topics