I like to make sure that every page has unique title and descriptions using this tool and also see if the H1 tags are used and the meta keyword is not being abused. This makes it easy to examine the whole website and see what needs to be updated. Screaming Frog SEO Spider collects the vital SEO elements for each page during the crawl: title, description, keywords, H1, h2 etc.

Second, I get the big picture of a website’s SEO elements and find what needs updated or fixed. Site Audit software is essential for any SEO job.

Custom Source Code Search – find anything you want in the source code of a webstieįirst, I index the whole website (as I show you inside) and save the results as the “before” crawl. This is helpful to demonstrate to a client what changes I have made to a website in the future, by having a snapshot of the website before I started.

Tracks the Follow and NoFollow status of all links.

Organizes Inlinks and Outlinks to any given URL.

Tracks Page Depth level (how many links from the homepage).

Tracks the Meta Robots tag so you can find the noindex, nofollow problems.

Finds duplicate pages with duplicate content.

Keyword elements like Title and Description and their lengths.

How many pages does it have? How are the titles and meta descriptions? Are there broken links? Site audit software is required for this job. What does Screaming Frog SEO Spider do? It “crawls” through your whole website and creates a list of all your internal pages. Plus it finds broken links, bad tags and much, much more.īefore optimizing any website, it helps to have a big picture view of the website.

OVERVIEW: This is a highly recommended Site Audit tool that is a must-have for any serious SEO work! It indexes your entire site and creates a spreadsheet of all your pages and their SEO elements.

Screaming frog seo spider code