I don’t think adding such a toggle would be worth it. People would feel that they are missing out if they don’t enable slow optimization but the improvement in the RMSE won’t be proportional to the extra time spent.
By the way, is it that the greatest improvement in RMSE with different seeds occurs only in small collections? If it is so, we can try multiple seeds in smaller collections but only a single seed in larger ones.