What to do if your website won’t test

Sitebeam can test over 99% of websites automatically, just by typing in their web address. However, some sites are more complex and require more advanced settings. Here you’ll find solutions to the most common problems.

If no/few pages are returned

We suggest you try these options one at a time, in order:

1. Pretend to be Google

Some websites block what they believe to be ‘bots’ – programs which download web pages. Sitebeam is a bot, and can be blocked as a result. One solution can be to imitate Google’s bot, which is generally permitted:

  • Go to Site Settings for the website.
  • Click Pages to test.
  • Set the User Agent dropdown menu to Googlebot.
  • Re-test the site.

2. Download from an alternative location

Some websites refuse to be accessed from specific geographic locations – by default Sitebeam downloads a site from the United States. To try an alternative location:

  • Go to Site Settings for the website.
  • Click Pages to test.
  • Select a location from the Location dropdown menu.
  • Ensure that the User Agent dropdown menu is set to Automatic.
  • Re-test the site.

3. Ignore HTTP errors

Some badly behaved websites always return errors when you attempt to spider them. Sitebeam can ignore these errors to test the site, although it may become confused by what parts of the site are legitimate or not.

  • Go to Site Settings for the website.
  • Click Pages to test.
  • Check the Ignore HTTP errors and spider everything box.
  • Ensure that the User Agent dropdown menu is set to Automatic.
  • Re-test the site.

If a report crashes

Sitebeam retries each report 3 times automatically. If a report fails, it is usually due to a problem you can’t fix yourself. We log and investigate all of these occurrences, but if you need a report urgently we suggest you contact us directly. Be sure to specify what website you were testing that failed (the easiest way to do this is supply the web address you were testing).

Use the Support link in the footer of Sitebeam to get in touch.

Was this article helpful? Contact our support team if you have a question.