Yes, it works with all of the archives and categories are the taxonomies, you should be able to see the pagination on WooCommerce category pages. But if you are expecting it on a custom page, it would require the advanced version.
At this moment, your URL is a page, I have checked its ID and found page-id-6254. Basic version of this plugin works for archives/taxonomies only.