Skip to content
Screaming Frog logo

Screaming Frog

A desktop crawler that finds what a site audit tool politely omits.

SEOFreemium
11 votes

About Screaming Frog

The Screaming Frog SEO Spider is a desktop crawler that fetches a site's URLs and reports technical SEO problems. It runs on Windows, macOS and Linux, and checks for more than 300 distinct SEO issues.

The crawler can render JavaScript, so client rendered pages are crawled as a browser would see them. Custom extraction pulls arbitrary data out of pages using XPath, CSS Path or regular expressions, spelling and grammar checking covers more than 25 languages, and crawls can be scheduled to run automatically. The crawler also connects to Google Analytics, Google Search Console and PageSpeed Insights to pull their data in alongside the crawl data.

Because the crawl runs on your own machine, that machine sets the ceiling. The application starts in database storage mode with 2GB of RAM allocated, which is generally sufficient for crawls under 200,000 URLs. Memory storage mode keeps the crawl in RAM instead and typically handles 10,000 to 100,000 URLs at the same 2GB default allocation. Crawling more than a million URLs is recommended on an SSD with 16GB of RAM or more, and the stated minimum is a 64 bit operating system with at least 4GB of RAM available.

Read more

The free version stops each crawl at 500 URLs. A paid licence makes the crawl limit unlimited, bounded only by the machine's memory and disk, and costs 199 pounds per year. Licences are per user, so two people need two separate licences, and each licence runs for one year and must be renewed to continue working. Buying in volume lowers the rate to 189 pounds each for 5 to 9 licences, 179 pounds for 10 to 19 and 169 pounds for 20 or more. Prices can be displayed in pounds, US dollars or euros.

The Log File Analyser is a separate product that ingests server logs, verifies search engine bots and reports which URLs those bots requested. It reads Apache logs, the W3C Extended Log File Format and the Amazon Elastic Load Balancing custom log format. The free version is limited to 1,000 log events and one project at a time, and a licence is listed at $139 per year.

Screaming Frog interface

Key features

  • Crawls a site's URLs from the desktop and reports technical SEO problems.
  • Checks for more than 300 distinct SEO issues.
  • Renders JavaScript so client rendered pages are crawled as a browser would see them.
  • Extracts arbitrary data from pages using XPath, CSS Path or regular expressions.
  • Pulls Google Analytics, Google Search Console and PageSpeed Insights data alongside the crawl.
  • Checks spelling and grammar in more than 25 languages.
  • Schedules crawls to run automatically.
  • Runs on Windows, macOS and Linux, needing a 64 bit system with at least 4GB of RAM.
  • Stops each crawl at 500 URLs on the free version and lifts the limit on a paid licence.
  • Stores crawls on disk in database mode, where 8GB of RAM handles crawls under 200,000 URLs.
  • Keeps crawls in memory instead, typically handling 10,000 to 100,000 URLs at the 2GB default.
  • Analyses server logs in a separate Log File Analyser, verifying bots and listing the URLs they requested.
  • Reads Apache logs, the W3C Extended Log File Format and Amazon Elastic Load Balancing custom logs.
  • Limits the free Log File Analyser to 1,000 log events and one project at a time.
  • Sells a per user licence at 199 pounds a year, falling to 169 pounds each at 20 or more.

What people use it for

  • Running a technical audit on a client site before quoting for the work.
  • Checking whether a JavaScript rendered site's content is visible to a crawler.
  • Pulling every product price off a site with a single XPath expression.
  • Crawling a site of more than a million URLs on a machine with an SSD and 16GB of RAM.
  • Scheduling a crawl overnight rather than tying up a machine during the day.
  • Confirming from server logs which URLs search engine bots actually requested.
  • Finding spelling mistakes across a site published in several languages.

Key facts

Key facts about Screaming Frog
CategorySEO
PricingFreemium
Free tierYes
Upvotes11
Listed22 August 2026

Is this your product?

Claim the listing to correct anything wrong with it, add features and a changelog, and answer questions from people deciding whether to try it. Free, and it stays yours.

Claim this listing
  • Technical audits that explain why each issue matters, not just that it exists.

    Paid
  • Keyword research, rank tracking and competitor teardowns in one suite.

    Freemium
  • The backlink index most SEO arguments are ultimately settled with.

    Paid
  • Briefs and on-page scoring built from what already ranks.

    Paid
Claimed by Editorial