How to Crawl Website and Spot Issues with Netpeak Spider

КейсыВидео
1Нравится
Комментарии
Поделиться

On our blog, you can find many guides and use-cases covering various aspects of work in Netpeak Spider, but it appeared that... the most essential and simplest use-case was still missing. We realized how difficult it can be to fathom out all nuts and bolts of the instrument, that's why we pulled our socks up and explained how to crawl and analyze the website in Netpeak Spider from the ground up.

  • 1. How to Crawl Website in Netpeak Spider
  • 2. How to See Issues Detected during Crawling
  • 3. How to Export Reports from the Program
  • 4. Recap

1. How to Crawl Website in Netpeak Spider

The main reasons you may need website crawling are SEO audit and detection of the website's issues. It's no biggie to perform these tasks in Netpeak Spider. You should:

  1. Copy the website address (which you want to crawl, obvs) and paste it in the 'Initial URL' field.
  2. A bit to the right hit the 'Start' button.

    How to run a website crawling in Netpeak Spider

  3. Watch the crawling process on the ‘Dashboard’ tab.

    Dashboard during crawling in Netpeak Spider

  4. You can stop the crawling manually by hitting the 'Pause' button. To continue crawling, click again on the 'Start' button. But if you want to rerun crawling, click on the 'Restart' button. You'll need the ‘restart’ if you changed the program settings and want to crawl the website considering those new settings.

    How to recrawl a project in Netpeak Spider

2. How to See Issues Detected during Crawling

First and foremost, wait until the program finishes the crawling and analysis. Then follow the steps:

  1. In a sidebar, open the 'Reports' tab → 'Issues'. Issues marked with red are severe errors, yellow – warnings, and blue – just notices. Not all notices need to be fixed, as some don't pose a danger. For example, pages with emojis in the description may not be a problem, but if emojis aren't supposed to be there, then the program prepares a report that can come in handy.

    Issues report in Netpeak Spider

  2. To see exactly which URLs contain this or that issue, click on the issue itself → the ‘URL Explorer’ tab will bring up the whole list of URLs.

    Filtered results in Netpeak Spider

  3. On the 'Info' panel, you can see what the issue means, what threats it may cause, and how to fix it → to expand the panel, drag it up with a left mouse button. In addition to necessary information, you'll find useful links that you can follow directly from the program and learn more about the issue.

    'Info' panel in Netpeak Spider

3. How to Export Reports from the Program

Here’re several ways to export issue report:

  1. Having the table with filtered results open, click on the ‘Export’ button → then all results from the current table will be exported.

    How to export current table results from Netpeak Spider

  2. Open the ‘Export’ menu on the top panel or in the far right corner.

    How to export current table results from Netpeak Spider

Using this menu, you can export different types of reports: for example, within a click, you can export:

  • All issue reports at once

    How to export all issue reports from Netpeak Spider

  • Special issue reports

    How to export special issue reports from Netpeak Spider

  • And also, XL (extra large) reports which contain massive data

    How to export XL (extra large) reports from Netpeak Spider

By the way, the Netpeak Spider Pro version owners can export reports and crawl results from the program directly to Google Sheets. To do so, go to 'Settings' → 'Export', add your Google account and in the 'File export format' section, select Google Sheets (Google Drive).

Export settings in Netpeak Spider

I'll showcase the most popular types of reports:

  1. Redirects: incoming links and final URLs.

    Netpeak Spider: redirect report

  2. Broken links

    Netpeak Spider: broken links report

  3. Hreflang links overview.

    Netpeak Spider: hreflang links overview

Note that the issues will be detected according to the parameters selected. To figure out what parameters can be checked for this or that issue, go to the ‘Info’ panel → simply click on the parameter and open the panel:

'Info' panel in Netpeak Spider

4. Recap

To crawl a website and check it for issues in Netpeak Spider, you need to follow a simple drill:

  1. Enter the website address into the 'Initial URL' field.
  2. Launch crawling hitting the ‘Start’ button.
  3. Wait until the crawling is completed and open the 'Issue' report in a sidebar. Click on the issue name and approach the filtered results → the table will contain URLs that have a particular issue.

Any questions remained? Drop them below or book a demo → our specialists know all the angles and will give you hand-holding in your first steps in taking over our SEO tools.

Book Demo