RankMath doesn’t created redirects for some products

Hi,

Kind of new to WordPress/WooCommerce world. I have a website and I have noticed a lot of pages are not indexed because of canonical URL, but not redirected to it (or something similar). I have manually added 301 redirect for one product and the page was indexed fine after that.

What happened basically is that I have moved the products from one category to another before using RankMath (to create redirection), but already indexed by Google.

The products are a lot and manually adding redirection for each of them would take months.

How to solve that? And why old URLs are still accessible? Is there a way to retrieve those old URLs and programmatically add redirection for them?