So I’ve been testing out Simply Static for the last week to see if I could start building out my website and what the performance would be through CloudFlare Pages.
Everything looks fine, except for the robots.txt
I’m using RankMath for SEO currently, and have tried switiching to Yoast. It still gives me the same issue where the robots.txt is not valid. I’ve gone to the URL selfs.co.uk/robots.txt and nothing shows up (don’t add the “www” in front of the domain, I’m just using this domain for testing), it just takes me to the webpage. Where on my local machine that I am build this site, I get the following in the robots.txt URL:
User-agent: *
Disallow: /wp-admin/
Allow: /wp-admin/admin-ajax.php
Sitemap: http://thameswilliams.local/sitemap_index.xmlI’ve got Simply Static converting all urls from the development environment to the static url.
So I’m pretty certain there is an issue with robots.txt when generating the static files.
Is this is a common issue with the Plugin or have I missed something because I’ve not found a single thing on this online. Thanks.
-
This topic was modified 3 hours ago by
. -
This topic was modified 2 hours, 59 minutes ago by . Reason: correction to title and website url
The page I need help with: [log in to see the link]