HEADMasterSEO

HEADMasterSEO is a small app (PC or Mac) that can check huge URL lists for status code, redirects, response time, response headers and HTTP header fields. Analyze, filter and sort the results in real-time and export to CSV. The tool is fast, easy to use and free for checking lists of up to 500 URLs.

Download Free Version

Blazing fast URL checker

The tool can use HEAD requests to fetch only the server headers without the response body for faster speed and lower bandwidth consumption. With up to 200 simultaneous URL requests, HEADMasterSEO can check URLs at the maximum available speed.

Check huge URL lists

HEADMasterSEO is a small and light link checker app that is optimized to run fast and use as little memory as possible. The SEO tool can reliably check 2 to 6 million URLs at a time on a modest machine / instance with 4GB to 8GB RAM and up to 30 million links on machines with 32GB.

Bulk check URL status and response time

Get the URL status code and response time of every link in your URL list. Find dead links (status code - 404 Not Found, 410 Gone), redirects (301, 302, 3XX), server errors (5XX http status codes) and slow pages.

Bulk check 301 and 302 redirects, redirect chains and loops

Check details about every URL redirection in your list. Visualize the complete redirection path and follow up to 9 redirects in redirect chains. Filter results to get redirect chains / redirect loops / 301 permanent redirects / 302 temporary redirects / 3XX HTTP status code redirects. Export redirects to CSV reports. HEADMasterSEO is the best redirect checker for testing large lists of link redirections.

Features

Import URL lists

Import single or multiple URLs from plain text files, CSV files, XML sitemap files, the Clipboard or enter URL addresses manually. Import links from multiple files.

Request headers / User agents

Set custom HTTP request headers. Set the User Agent from a list of 20 pre-built agents (search engine bots, mobile devices and browsers). Completely customize the User Agents at any time.

Rewrite URLs

Rewrite URLs on the fly (for example to the staging environment of a website migration).

Use proxies

Set a proxy for all URL status checks. Use password protected proxies.

Use HEAD or GET requests

The software can use HEAD or GET requests. HEAD requests are faster and save time on huge URL lists but not all servers allow them. Use HEAD requests when checking large lists of URLs from a domain/website that supports them. Use GET requests when checking large lists of domains.

Filter and sort URL results in real time

Audit results as they come in by filtering and sorting. Here's the list of supported URL filters:

Sort the data for millions of URLs (more than the 1 million row limit that Excel can sort).

Export data to CSV

Export all data from URL checks or filtered subsets into different CSV reports (sorted or unsorted). Export URL results in the same order as the URLs were imported.

Save and reload data from URL checks

Save the results from your URL checks into .HEAD files and reload them later to filter, sort, analyze and export.

View HTTP headers

Audit the HTTP response headers of imported and redirected URLs. Export the response headers to CSV.

Audit all links in the HTTP response headers

The Link http header fields in your response headers carry important links and link parameters for your technical SEO setup (canonical, prev/next, alternate, hreflang). HEADMasterSEO visualizes all links from the response headers into an easy to examine grid and you can CSV export them for further analysis.

The URL checker can also import all extra links found only in the http response headers and check their status code, response headers and response time.

Bulk Check HTTP headers for X-Robots-Tag and Vary fields

The X-Robots-Tag "noindex, nofollow" directives in response headers can deindex pages and cause large drops in organic traffic. HEADMasterSEO extracts the X-Robots-Tag and Vary header fields into separate grid columns so that you can easily check and export them.

Check XML sitemaps for errors

Validate and check XML sitemaps for errors (non-200 status code links, dead links, internal server errors, redirects). Audit every link in image and video sitemaps.

Run the URL checker on cheap instances in "Low Memory Mode"

The program can check an unlimited amount of URLs in a special Low Memory Mode. In this mode, the tool imports the URLs in small batches and immediately exports the received results to CSV. Almost no data is kept in the memory. The tool can check huge lists of URLs on cheap VMs with very little memory (you only need disk space for the CSV results).

Redirect tester + URL mapping rules = Even more time saved

HEADMasterSEO can take a list of URLs and a list of URL mapping rules and test if every link in your list redirects to the proper destination URL using a single 301 redirect. Write URL mapping rules once and run the redirect tester as many times as needed.

Test canonical URL redirects setup

Run the built-in canonical URL redirect tester to find if your (http <-> https and www <-> non-www) canonical redirects are setup correctly.

Test URLs for secure cookies and HSTS header fields

The bulk URL tester can make sure that all your URLs return proper HSTS headers (Strict-Transport-Security) and there are no insecure cookies set.

Pricing and Licensing

Pricing and licensing is based on the maximum number of URLs you can import and check at once. You can check up to 500 URLs with the free version. Buy a license to check bigger URL lists.