What to Know About 404 Errors

404 Errors

Written by Jeremy Earle, JD

June 23, 2022

It discusses the distinction between 404 errors and soft 404 errors and how to remedy the SEO problems that might cause them.

A response code is provided in the HTTP headers of every page that loads in a web browser, and it may or may not be displayed on the page itself.

In addition to the 404-response code, a server may use multiple more response codes to express the status of its page.

An error number of 400 to 499 is usually a sign that the page has not loaded. Only the 404-response code conveys a clear message: the page has vanished and won’t be returning any time soon.

A Soft 404 Error is a 404 Not Found error.

No response code is delivered to a web browser by a soft 404 error. Just a label that Google puts to one of their index pages.

To ensure that no time is spent by crawling missing pages that do not need to be indexed, Google distributes resources judiciously when crawling pages.

On the other hand, some servers are set up incorrectly, resulting in a 404-response code being shown instead of the expected 200 code. Even if the web page explicitly declares that it cannot be discovered, Google may still index the page if the invisible HTTP header shows a 200 code.

According to Google’s efforts, 404 pages may be identified by their unique qualities, and the search engine uses this information to determine whether or not it’s an error page. Or, to put it another way: If it’s got all three of those characteristics (i.e. an error code 404), then it most likely represents an actual error page.

It’s Possible to Misinterpret Soft 404

Even if the page isn’t genuinely absent, Google may classify it as such because of specific features.

Two examples of these traits are small or non-existent content on the page and too many comparable pages on the site.

They share traits with the Panda algorithm, as well. When it comes to Google’s Panda algorithm, thin and duplicate material is considered ranking issues that should be penalised.

It is important to solve these minor flaws to prevent both soft 404s and Panda difficulties.

There are two primary sources of 404 errors:

Users are sent to a page that doesn’t exist because of a link that has an issue.

A link to a formerly there page has since been removed.

An Error in the Linking

If a linking issue causes a 404, all you need to do is fix the links. Finding all of a website’s broken links is the most challenging component of this operation.

Large, complicated sites with tens of thousands or millions of pages may find this more difficult. A good set of crawling tools is a must-have in such situations. Xenu, DeepCrawl, Screaming Frog, or Botify are all good options.

The Last Known Location of This Page

You have two alternatives when a page is no longer accessible:

If the page was mistakenly deleted, restore it.

 If it was deleted on purpose, use a 301 redirect to send visitors to the most closely similar page.

The first step is to find all the broken links on the website. You may utilise crawling technologies in the same way you would locate all of the broken links on a large-scale website. On the other hand, orphaned pages may not be found by crawling tools since they do not appear in the navigational links or on any of the other pages.

An orphaned page may survive even when the connection to this old page has been removed, but external links from other websites may still go to them. You may use several tools to see whether your site has these sorts of pages.

GSC (Google Search Console)

As Google crawls through all the sites it can locate, the search console will display 404 errors. Other websites’ links to a page on your website that no longer exists might fall into this category.

Analytics from Google

By default, Google Analytics does not include a report for a missing page. You may, however, keep tabs on them in a variety of ways.

One way to do this is by creating a custom report and separating pages with Error 404 – Page Not Found as a page title.

You may also use Google Analytics to detect orphaned pages by creating content groups and assigning 404 pages to a content group.

Operator Search Command: This is where you should go.

Site:example.com will return all of the indexed pages of example.com if you search Google for “site: example.” com.” It is possible to verify if the pages load or return 404 errors independently.

It’s easier for me to use WebCEO since it allows me to run the site across many search engines.

Running it on numerous search engines will help you get a more comprehensive list of your site’s pages since each search engine will only offer you a portion of the total. Export this list and run it via tools to check for 404 errors on a large scale. Just add all URLs to an HTML file and load it on Xenu, automatically checking for 404 problems and flagging them as such.

Researching Backlinks Using Other Means

Majestic, Ahrefs, Moz Open Site Explorer, Sistrix, LinkResearchTools, and CognitiveSEO are some examples of backlink research tools that might be useful.

A list of backlinks pointing to your website may often be exported from most of these programmes. From there, you may scan for 404 errors on all of the related sites.

Soft 404 Errors: How to Fix Them.

Because it isn’t a 404 error, crawling tools won’t pick up on a soft 404. There is another way to identify it using crawling tools. Things to look for include:

In addition to reporting sites with sparse content, some crawling programmes also provide a total word count. Start with the fewest words possible to determine whether a page has thin content. You may then sort the URLs by the number of words in your text.

Several crawling technologies may determine the proportion of the page that contains template content. If the primary material is practically identical to many other sites, you should investigate these pages and discover why your site has so much duplicate content.

Crawl errors may also be seen in Google Search Console under crawl errors, where you can search for sites that are categorised as soft 404s.

It is possible to investigate and fix issues that produce soft 404s before Google discovers them.

You’ll need to fix these soft 404 errors after seeing them.

In most cases, the remedies are obvious. It might be as easy as adding more material to pages with little or no content or removing and replacing information that is the same.

There are a few things to keep in mind as you go through this process:

In certain cases, thin content might be produced by narrowing the page subject, leaving you with nothing to say. • Consolidate Pages: If the themes are closely connected, it can be better to combine numerous thin pages into a single page than separate them all. This not only addresses the problem of thin content, but it may also address the problem of duplicating material. When offering shoes in several colours and sizes, an e-commerce site may have a distinct URL for each combination. As a result, there are many pages with sparse and almost similar material. Instead, it’s better to consolidate all of this information on one page and list all of the alternatives that are accessible.

The same material may be traced back to technical flaws, which can be found using even the most basic web crawling tool, such as Xenu (which doesn’t look at content but simply at URLs, response codes, and title tags). Things like www vs non-www URLs, HTTP vs HTTPS, index.html vs no index.html, tracking parameters vs none, etc., are all included in this. Slide 6 of this presentation gives a fair breakdown of these frequent duplicate content concerns identified in URL patterns.

404 Errors and Soft 404 Errors are treated the same by Google.

Crawling your site regularly is the greatest way to detect 404 or soft 404 issues. A soft 404 is not a legitimate 404 error, but if it isn’t corrected immediately, Google will deindex those sites. Crawling tools are an essential part of any SEO strategy.

You May Also Like…