Description
I’m looking for an EXPERT Dev to investigate an issue with my website. The website appears to be working normally when checked manually in browsers, but SEMrush, Screaming Frog, and other SEO crawling tools are reporting various issues/errors. I need someone who can identify why these tools are detecting problems even though the pages appear to work correctly for users. What I need you to do: • Crawl the website using Screaming Frog, SEMrush, and other relevant tools. • Identify and investigate all significant crawl errors. • Compare crawler results against what is actually happening on the website. • Check HTTP status codes, redirects, canonicals, robots.txt, XML sitemap, internal links, JavaScript rendering, server responses, etc. • Check whether any pages are intermittently returning errors to crawlers. • Investigate whether there are differences between Googlebot/crawler requests and normal browser requests. • Check for potential server, hosting, CDN, firewall, security, or bot-blocking issues. • Identify whether the website has any crawlability or indexing problems. • Determine the root cause rather than simply providing a list of SEMrush/Screaming Frog errors. • Provide a clear report explaining the issue and recommended fixes.