SlideShare a Scribd company logo
1 of 5
Download to read offline
4 Tools to Find and Fix Website 404 Errors
Website owners fear 404 errors for good reason. Broken pages can damage a website’s reputation,
frustrate users, and result in lost sales. So what can be done to ensure that this “page not found” error
does not cause a loss in visitor traffic, a loss in the website’s search engine rank, or worse yet, a lost sale
because the visitor couldn’t find the web page? This post will attempt to define 404 errors and proper
strategies for “fixing” these 404 errors.
404 Errors and HTTP Response Codes
Before understanding the best ways to fix a 404 error, let’s briefly talk through the technical aspects of
how an Internet browser like Firefox or Chrome communicates with a website server. The basic
communication between an Internet browser and a web server goes like this. The browser sends a request
to the server and the server responds with a code. These response codes are called HyperText Transfer
Protocol response status codes or HTTP response codes. These codes inform the browser that a page was
found, a page was not found, a page has been moved permanently, a page has been moved temporarily, or
that a server error happened. Every time an Internet browser makes a request to a website server, the
browser expects a response code back from the server.
When a valid web page is requested by a browser and it is available from the server, the server responds
with a “200″ success code. This 200 code means that the requested page was found by the server and
should be rendered for use in the browser. However, in the case of a 404 response code, the response
means the page is “not found” by the server.
As a website visitor, getting a 404 error code can be very frustrating. The visitor wants to view the page,
but the server is responding “the page is missing”. A 404 error response usually happens when a page
used to exist on a website, but the page is now missing (or deleted) from the server. Another situation is
when the URL is incorrect and there has never been a page available at that location. In other cases the
page is missing on purpose because it was removed from the site and sometimes it is missing by accident.
Regardless, if there are URLs pointing to the missing page on the Internet, then anyone clicking on that
link will receive the server’s 404 response. This is especially troubling for site owners if the missing page
has been indexed by search engines or when the URL is listed on a high traffic website.
How to Find and Diagnose 404 Errors
Diagnose broken links and find 404 errors with these free tools:
Tool #1 – Xenu’s Link Sleuth
(http://xenu.com)
Pros: Simple website crawler and link checker, provides a broken links report
Cons: This website crawler only crawls the links that it can find on the page — if 404 pages do not have
any links for Xenu’s Link Sleuth to find, then it will not crawl them.
Xenu Link Sleuth crawling website pages…
Xenu Link Sleuth provides a broken link report
Tool #2 – Google Webmaster Tools (GWT)
(http://www.google.com/webmasters/tools/)
Pros: Easy to use, has other valuable features
Cons: Website must be verified by Google and broken pages only appear when Google provides them
Find 404 errors in Google Webmaster Tools
- 404 errors in Google Webmaster Tools
Tool #3 – Screaming Frog
(http://www.screamingfrog.co.uk/seo-spider/)
Pros: Advanced spidering/crawling, SEO perspectives
Cons: 500 URI crawl limit for free version, complicated for basic users
Screaming Frog displays HTTP status codes after crawling
Tool #4 – 404 Redirected Plugin For WordPress
(http://wordpress.org/extend/plugins/404-redirected/)
Pros: Automatic 404 error detection, easy configuration of redirects
Cons: Available for WordPress websites only, requires an additional plugin
404 errors can be setup to redirect manually or automatically (automatic matching seems to work well)
Automatic 404 error collection is convenient — 301 and 302 redirects are both available
Do I need to fix 404 errors?
Not necessarily… 404 errors are okay to have as long as they are not causing damage through lost site
traffic, lost sales, customer frustration, etc. Most of the time, 404 errors are bad for everyone. However,
404 errors are not to be confused with 404 pages. To create a replacement page, the 404 error should
return a custom error page or should be replaced with a 301 redirect that takes visitors to a page that
actually exists. Essentially, give the user a good experience even when the page is missing.
Find Links Pointing to the 404
One of the best approaches for handling new 404 errors is to determine how many links are pointing to
the missing page. These “broken” links may be on the same website, they may be on other websites, may
be within email messages, on offline marketing materials, or even within search engine results. If there
are a lot of incoming links going to the missing page, then a 301 redirect should be setup.
Using 301 Redirects
301 redirects are highly recommended when redirecting individual pages or entire websites. A 301
redirect is setup on a server to let the Internet browser know “this page has moved permanently”. These
redirects are especially handy when the missing page has a high organic search rank on search engines
because it maintains the SEO strength of the link even when redirected. Sometimes there isn’t a good
page to redirect to. In this case, a custom error page should be provided.
Creating Custom 404 Pages
If a 301 redirect was not chosen, then a visitor-friendly, custom error page can be used in place of the
missing page. Typically, a website uses a single custom error page for
all 404 errors. This custom error page usually provides a few important items to the confused visitor:
1. A message to the user explaining that the page they are looking for does not exist
2. A search box to help a visitor find exactly what they want
3. A website navigation system to help visitors browse for more information
4. A link to the home page
So there you have it — how to find 404 pages and how to fix them. Now when your favorite customers
find a broken link, they will find either your custom 404 page or won’t be able to tell that anything
happened with a 301 redirect.
http://www.volume9inc.com/2012/12/04/4-tools-to-find-website-404-errors/

More Related Content

Recently uploaded

Are Multi-Cloud and Serverless Good or Bad?
Are Multi-Cloud and Serverless Good or Bad?Are Multi-Cloud and Serverless Good or Bad?
Are Multi-Cloud and Serverless Good or Bad?Mattias Andersson
 
SAP Build Work Zone - Overview L2-L3.pptx
SAP Build Work Zone - Overview L2-L3.pptxSAP Build Work Zone - Overview L2-L3.pptx
SAP Build Work Zone - Overview L2-L3.pptxNavinnSomaal
 
"Debugging python applications inside k8s environment", Andrii Soldatenko
"Debugging python applications inside k8s environment", Andrii Soldatenko"Debugging python applications inside k8s environment", Andrii Soldatenko
"Debugging python applications inside k8s environment", Andrii SoldatenkoFwdays
 
Developer Data Modeling Mistakes: From Postgres to NoSQL
Developer Data Modeling Mistakes: From Postgres to NoSQLDeveloper Data Modeling Mistakes: From Postgres to NoSQL
Developer Data Modeling Mistakes: From Postgres to NoSQLScyllaDB
 
Digital Identity is Under Attack: FIDO Paris Seminar.pptx
Digital Identity is Under Attack: FIDO Paris Seminar.pptxDigital Identity is Under Attack: FIDO Paris Seminar.pptx
Digital Identity is Under Attack: FIDO Paris Seminar.pptxLoriGlavin3
 
Advanced Computer Architecture – An Introduction
Advanced Computer Architecture – An IntroductionAdvanced Computer Architecture – An Introduction
Advanced Computer Architecture – An IntroductionDilum Bandara
 
Ensuring Technical Readiness For Copilot in Microsoft 365
Ensuring Technical Readiness For Copilot in Microsoft 365Ensuring Technical Readiness For Copilot in Microsoft 365
Ensuring Technical Readiness For Copilot in Microsoft 3652toLead Limited
 
Unleash Your Potential - Namagunga Girls Coding Club
Unleash Your Potential - Namagunga Girls Coding ClubUnleash Your Potential - Namagunga Girls Coding Club
Unleash Your Potential - Namagunga Girls Coding ClubKalema Edgar
 
The Fit for Passkeys for Employee and Consumer Sign-ins: FIDO Paris Seminar.pptx
The Fit for Passkeys for Employee and Consumer Sign-ins: FIDO Paris Seminar.pptxThe Fit for Passkeys for Employee and Consumer Sign-ins: FIDO Paris Seminar.pptx
The Fit for Passkeys for Employee and Consumer Sign-ins: FIDO Paris Seminar.pptxLoriGlavin3
 
A Deep Dive on Passkeys: FIDO Paris Seminar.pptx
A Deep Dive on Passkeys: FIDO Paris Seminar.pptxA Deep Dive on Passkeys: FIDO Paris Seminar.pptx
A Deep Dive on Passkeys: FIDO Paris Seminar.pptxLoriGlavin3
 
The Ultimate Guide to Choosing WordPress Pros and Cons
The Ultimate Guide to Choosing WordPress Pros and ConsThe Ultimate Guide to Choosing WordPress Pros and Cons
The Ultimate Guide to Choosing WordPress Pros and ConsPixlogix Infotech
 
Scanning the Internet for External Cloud Exposures via SSL Certs
Scanning the Internet for External Cloud Exposures via SSL CertsScanning the Internet for External Cloud Exposures via SSL Certs
Scanning the Internet for External Cloud Exposures via SSL CertsRizwan Syed
 
"ML in Production",Oleksandr Bagan
"ML in Production",Oleksandr Bagan"ML in Production",Oleksandr Bagan
"ML in Production",Oleksandr BaganFwdays
 
Passkey Providers and Enabling Portability: FIDO Paris Seminar.pptx
Passkey Providers and Enabling Portability: FIDO Paris Seminar.pptxPasskey Providers and Enabling Portability: FIDO Paris Seminar.pptx
Passkey Providers and Enabling Portability: FIDO Paris Seminar.pptxLoriGlavin3
 
unit 4 immunoblotting technique complete.pptx
unit 4 immunoblotting technique complete.pptxunit 4 immunoblotting technique complete.pptx
unit 4 immunoblotting technique complete.pptxBkGupta21
 
Take control of your SAP testing with UiPath Test Suite
Take control of your SAP testing with UiPath Test SuiteTake control of your SAP testing with UiPath Test Suite
Take control of your SAP testing with UiPath Test SuiteDianaGray10
 
DevoxxFR 2024 Reproducible Builds with Apache Maven
DevoxxFR 2024 Reproducible Builds with Apache MavenDevoxxFR 2024 Reproducible Builds with Apache Maven
DevoxxFR 2024 Reproducible Builds with Apache MavenHervé Boutemy
 
Commit 2024 - Secret Management made easy
Commit 2024 - Secret Management made easyCommit 2024 - Secret Management made easy
Commit 2024 - Secret Management made easyAlfredo García Lavilla
 
Streamlining Python Development: A Guide to a Modern Project Setup
Streamlining Python Development: A Guide to a Modern Project SetupStreamlining Python Development: A Guide to a Modern Project Setup
Streamlining Python Development: A Guide to a Modern Project SetupFlorian Wilhelm
 
Dev Dives: Streamline document processing with UiPath Studio Web
Dev Dives: Streamline document processing with UiPath Studio WebDev Dives: Streamline document processing with UiPath Studio Web
Dev Dives: Streamline document processing with UiPath Studio WebUiPathCommunity
 

Recently uploaded (20)

Are Multi-Cloud and Serverless Good or Bad?
Are Multi-Cloud and Serverless Good or Bad?Are Multi-Cloud and Serverless Good or Bad?
Are Multi-Cloud and Serverless Good or Bad?
 
SAP Build Work Zone - Overview L2-L3.pptx
SAP Build Work Zone - Overview L2-L3.pptxSAP Build Work Zone - Overview L2-L3.pptx
SAP Build Work Zone - Overview L2-L3.pptx
 
"Debugging python applications inside k8s environment", Andrii Soldatenko
"Debugging python applications inside k8s environment", Andrii Soldatenko"Debugging python applications inside k8s environment", Andrii Soldatenko
"Debugging python applications inside k8s environment", Andrii Soldatenko
 
Developer Data Modeling Mistakes: From Postgres to NoSQL
Developer Data Modeling Mistakes: From Postgres to NoSQLDeveloper Data Modeling Mistakes: From Postgres to NoSQL
Developer Data Modeling Mistakes: From Postgres to NoSQL
 
Digital Identity is Under Attack: FIDO Paris Seminar.pptx
Digital Identity is Under Attack: FIDO Paris Seminar.pptxDigital Identity is Under Attack: FIDO Paris Seminar.pptx
Digital Identity is Under Attack: FIDO Paris Seminar.pptx
 
Advanced Computer Architecture – An Introduction
Advanced Computer Architecture – An IntroductionAdvanced Computer Architecture – An Introduction
Advanced Computer Architecture – An Introduction
 
Ensuring Technical Readiness For Copilot in Microsoft 365
Ensuring Technical Readiness For Copilot in Microsoft 365Ensuring Technical Readiness For Copilot in Microsoft 365
Ensuring Technical Readiness For Copilot in Microsoft 365
 
Unleash Your Potential - Namagunga Girls Coding Club
Unleash Your Potential - Namagunga Girls Coding ClubUnleash Your Potential - Namagunga Girls Coding Club
Unleash Your Potential - Namagunga Girls Coding Club
 
The Fit for Passkeys for Employee and Consumer Sign-ins: FIDO Paris Seminar.pptx
The Fit for Passkeys for Employee and Consumer Sign-ins: FIDO Paris Seminar.pptxThe Fit for Passkeys for Employee and Consumer Sign-ins: FIDO Paris Seminar.pptx
The Fit for Passkeys for Employee and Consumer Sign-ins: FIDO Paris Seminar.pptx
 
A Deep Dive on Passkeys: FIDO Paris Seminar.pptx
A Deep Dive on Passkeys: FIDO Paris Seminar.pptxA Deep Dive on Passkeys: FIDO Paris Seminar.pptx
A Deep Dive on Passkeys: FIDO Paris Seminar.pptx
 
The Ultimate Guide to Choosing WordPress Pros and Cons
The Ultimate Guide to Choosing WordPress Pros and ConsThe Ultimate Guide to Choosing WordPress Pros and Cons
The Ultimate Guide to Choosing WordPress Pros and Cons
 
Scanning the Internet for External Cloud Exposures via SSL Certs
Scanning the Internet for External Cloud Exposures via SSL CertsScanning the Internet for External Cloud Exposures via SSL Certs
Scanning the Internet for External Cloud Exposures via SSL Certs
 
"ML in Production",Oleksandr Bagan
"ML in Production",Oleksandr Bagan"ML in Production",Oleksandr Bagan
"ML in Production",Oleksandr Bagan
 
Passkey Providers and Enabling Portability: FIDO Paris Seminar.pptx
Passkey Providers and Enabling Portability: FIDO Paris Seminar.pptxPasskey Providers and Enabling Portability: FIDO Paris Seminar.pptx
Passkey Providers and Enabling Portability: FIDO Paris Seminar.pptx
 
unit 4 immunoblotting technique complete.pptx
unit 4 immunoblotting technique complete.pptxunit 4 immunoblotting technique complete.pptx
unit 4 immunoblotting technique complete.pptx
 
Take control of your SAP testing with UiPath Test Suite
Take control of your SAP testing with UiPath Test SuiteTake control of your SAP testing with UiPath Test Suite
Take control of your SAP testing with UiPath Test Suite
 
DevoxxFR 2024 Reproducible Builds with Apache Maven
DevoxxFR 2024 Reproducible Builds with Apache MavenDevoxxFR 2024 Reproducible Builds with Apache Maven
DevoxxFR 2024 Reproducible Builds with Apache Maven
 
Commit 2024 - Secret Management made easy
Commit 2024 - Secret Management made easyCommit 2024 - Secret Management made easy
Commit 2024 - Secret Management made easy
 
Streamlining Python Development: A Guide to a Modern Project Setup
Streamlining Python Development: A Guide to a Modern Project SetupStreamlining Python Development: A Guide to a Modern Project Setup
Streamlining Python Development: A Guide to a Modern Project Setup
 
Dev Dives: Streamline document processing with UiPath Studio Web
Dev Dives: Streamline document processing with UiPath Studio WebDev Dives: Streamline document processing with UiPath Studio Web
Dev Dives: Streamline document processing with UiPath Studio Web
 

Featured

Content Methodology: A Best Practices Report (Webinar)
Content Methodology: A Best Practices Report (Webinar)Content Methodology: A Best Practices Report (Webinar)
Content Methodology: A Best Practices Report (Webinar)contently
 
How to Prepare For a Successful Job Search for 2024
How to Prepare For a Successful Job Search for 2024How to Prepare For a Successful Job Search for 2024
How to Prepare For a Successful Job Search for 2024Albert Qian
 
Social Media Marketing Trends 2024 // The Global Indie Insights
Social Media Marketing Trends 2024 // The Global Indie InsightsSocial Media Marketing Trends 2024 // The Global Indie Insights
Social Media Marketing Trends 2024 // The Global Indie InsightsKurio // The Social Media Age(ncy)
 
Trends In Paid Search: Navigating The Digital Landscape In 2024
Trends In Paid Search: Navigating The Digital Landscape In 2024Trends In Paid Search: Navigating The Digital Landscape In 2024
Trends In Paid Search: Navigating The Digital Landscape In 2024Search Engine Journal
 
5 Public speaking tips from TED - Visualized summary
5 Public speaking tips from TED - Visualized summary5 Public speaking tips from TED - Visualized summary
5 Public speaking tips from TED - Visualized summarySpeakerHub
 
ChatGPT and the Future of Work - Clark Boyd
ChatGPT and the Future of Work - Clark Boyd ChatGPT and the Future of Work - Clark Boyd
ChatGPT and the Future of Work - Clark Boyd Clark Boyd
 
Getting into the tech field. what next
Getting into the tech field. what next Getting into the tech field. what next
Getting into the tech field. what next Tessa Mero
 
Google's Just Not That Into You: Understanding Core Updates & Search Intent
Google's Just Not That Into You: Understanding Core Updates & Search IntentGoogle's Just Not That Into You: Understanding Core Updates & Search Intent
Google's Just Not That Into You: Understanding Core Updates & Search IntentLily Ray
 
Time Management & Productivity - Best Practices
Time Management & Productivity -  Best PracticesTime Management & Productivity -  Best Practices
Time Management & Productivity - Best PracticesVit Horky
 
The six step guide to practical project management
The six step guide to practical project managementThe six step guide to practical project management
The six step guide to practical project managementMindGenius
 
Beginners Guide to TikTok for Search - Rachel Pearson - We are Tilt __ Bright...
Beginners Guide to TikTok for Search - Rachel Pearson - We are Tilt __ Bright...Beginners Guide to TikTok for Search - Rachel Pearson - We are Tilt __ Bright...
Beginners Guide to TikTok for Search - Rachel Pearson - We are Tilt __ Bright...RachelPearson36
 
Unlocking the Power of ChatGPT and AI in Testing - A Real-World Look, present...
Unlocking the Power of ChatGPT and AI in Testing - A Real-World Look, present...Unlocking the Power of ChatGPT and AI in Testing - A Real-World Look, present...
Unlocking the Power of ChatGPT and AI in Testing - A Real-World Look, present...Applitools
 
12 Ways to Increase Your Influence at Work
12 Ways to Increase Your Influence at Work12 Ways to Increase Your Influence at Work
12 Ways to Increase Your Influence at WorkGetSmarter
 
Ride the Storm: Navigating Through Unstable Periods / Katerina Rudko (Belka G...
Ride the Storm: Navigating Through Unstable Periods / Katerina Rudko (Belka G...Ride the Storm: Navigating Through Unstable Periods / Katerina Rudko (Belka G...
Ride the Storm: Navigating Through Unstable Periods / Katerina Rudko (Belka G...DevGAMM Conference
 
Barbie - Brand Strategy Presentation
Barbie - Brand Strategy PresentationBarbie - Brand Strategy Presentation
Barbie - Brand Strategy PresentationErica Santiago
 
Good Stuff Happens in 1:1 Meetings: Why you need them and how to do them well
Good Stuff Happens in 1:1 Meetings: Why you need them and how to do them wellGood Stuff Happens in 1:1 Meetings: Why you need them and how to do them well
Good Stuff Happens in 1:1 Meetings: Why you need them and how to do them wellSaba Software
 

Featured (20)

Content Methodology: A Best Practices Report (Webinar)
Content Methodology: A Best Practices Report (Webinar)Content Methodology: A Best Practices Report (Webinar)
Content Methodology: A Best Practices Report (Webinar)
 
How to Prepare For a Successful Job Search for 2024
How to Prepare For a Successful Job Search for 2024How to Prepare For a Successful Job Search for 2024
How to Prepare For a Successful Job Search for 2024
 
Social Media Marketing Trends 2024 // The Global Indie Insights
Social Media Marketing Trends 2024 // The Global Indie InsightsSocial Media Marketing Trends 2024 // The Global Indie Insights
Social Media Marketing Trends 2024 // The Global Indie Insights
 
Trends In Paid Search: Navigating The Digital Landscape In 2024
Trends In Paid Search: Navigating The Digital Landscape In 2024Trends In Paid Search: Navigating The Digital Landscape In 2024
Trends In Paid Search: Navigating The Digital Landscape In 2024
 
5 Public speaking tips from TED - Visualized summary
5 Public speaking tips from TED - Visualized summary5 Public speaking tips from TED - Visualized summary
5 Public speaking tips from TED - Visualized summary
 
ChatGPT and the Future of Work - Clark Boyd
ChatGPT and the Future of Work - Clark Boyd ChatGPT and the Future of Work - Clark Boyd
ChatGPT and the Future of Work - Clark Boyd
 
Getting into the tech field. what next
Getting into the tech field. what next Getting into the tech field. what next
Getting into the tech field. what next
 
Google's Just Not That Into You: Understanding Core Updates & Search Intent
Google's Just Not That Into You: Understanding Core Updates & Search IntentGoogle's Just Not That Into You: Understanding Core Updates & Search Intent
Google's Just Not That Into You: Understanding Core Updates & Search Intent
 
How to have difficult conversations
How to have difficult conversations How to have difficult conversations
How to have difficult conversations
 
Introduction to Data Science
Introduction to Data ScienceIntroduction to Data Science
Introduction to Data Science
 
Time Management & Productivity - Best Practices
Time Management & Productivity -  Best PracticesTime Management & Productivity -  Best Practices
Time Management & Productivity - Best Practices
 
The six step guide to practical project management
The six step guide to practical project managementThe six step guide to practical project management
The six step guide to practical project management
 
Beginners Guide to TikTok for Search - Rachel Pearson - We are Tilt __ Bright...
Beginners Guide to TikTok for Search - Rachel Pearson - We are Tilt __ Bright...Beginners Guide to TikTok for Search - Rachel Pearson - We are Tilt __ Bright...
Beginners Guide to TikTok for Search - Rachel Pearson - We are Tilt __ Bright...
 
Unlocking the Power of ChatGPT and AI in Testing - A Real-World Look, present...
Unlocking the Power of ChatGPT and AI in Testing - A Real-World Look, present...Unlocking the Power of ChatGPT and AI in Testing - A Real-World Look, present...
Unlocking the Power of ChatGPT and AI in Testing - A Real-World Look, present...
 
12 Ways to Increase Your Influence at Work
12 Ways to Increase Your Influence at Work12 Ways to Increase Your Influence at Work
12 Ways to Increase Your Influence at Work
 
ChatGPT webinar slides
ChatGPT webinar slidesChatGPT webinar slides
ChatGPT webinar slides
 
More than Just Lines on a Map: Best Practices for U.S Bike Routes
More than Just Lines on a Map: Best Practices for U.S Bike RoutesMore than Just Lines on a Map: Best Practices for U.S Bike Routes
More than Just Lines on a Map: Best Practices for U.S Bike Routes
 
Ride the Storm: Navigating Through Unstable Periods / Katerina Rudko (Belka G...
Ride the Storm: Navigating Through Unstable Periods / Katerina Rudko (Belka G...Ride the Storm: Navigating Through Unstable Periods / Katerina Rudko (Belka G...
Ride the Storm: Navigating Through Unstable Periods / Katerina Rudko (Belka G...
 
Barbie - Brand Strategy Presentation
Barbie - Brand Strategy PresentationBarbie - Brand Strategy Presentation
Barbie - Brand Strategy Presentation
 
Good Stuff Happens in 1:1 Meetings: Why you need them and how to do them well
Good Stuff Happens in 1:1 Meetings: Why you need them and how to do them wellGood Stuff Happens in 1:1 Meetings: Why you need them and how to do them well
Good Stuff Happens in 1:1 Meetings: Why you need them and how to do them well
 

4 tools to find and fix website 404 errors by volume 9 inc

  • 1. 4 Tools to Find and Fix Website 404 Errors Website owners fear 404 errors for good reason. Broken pages can damage a website’s reputation, frustrate users, and result in lost sales. So what can be done to ensure that this “page not found” error does not cause a loss in visitor traffic, a loss in the website’s search engine rank, or worse yet, a lost sale because the visitor couldn’t find the web page? This post will attempt to define 404 errors and proper strategies for “fixing” these 404 errors. 404 Errors and HTTP Response Codes Before understanding the best ways to fix a 404 error, let’s briefly talk through the technical aspects of how an Internet browser like Firefox or Chrome communicates with a website server. The basic communication between an Internet browser and a web server goes like this. The browser sends a request to the server and the server responds with a code. These response codes are called HyperText Transfer Protocol response status codes or HTTP response codes. These codes inform the browser that a page was found, a page was not found, a page has been moved permanently, a page has been moved temporarily, or that a server error happened. Every time an Internet browser makes a request to a website server, the browser expects a response code back from the server. When a valid web page is requested by a browser and it is available from the server, the server responds with a “200″ success code. This 200 code means that the requested page was found by the server and should be rendered for use in the browser. However, in the case of a 404 response code, the response means the page is “not found” by the server. As a website visitor, getting a 404 error code can be very frustrating. The visitor wants to view the page, but the server is responding “the page is missing”. A 404 error response usually happens when a page used to exist on a website, but the page is now missing (or deleted) from the server. Another situation is when the URL is incorrect and there has never been a page available at that location. In other cases the page is missing on purpose because it was removed from the site and sometimes it is missing by accident. Regardless, if there are URLs pointing to the missing page on the Internet, then anyone clicking on that link will receive the server’s 404 response. This is especially troubling for site owners if the missing page has been indexed by search engines or when the URL is listed on a high traffic website. How to Find and Diagnose 404 Errors Diagnose broken links and find 404 errors with these free tools: Tool #1 – Xenu’s Link Sleuth (http://xenu.com) Pros: Simple website crawler and link checker, provides a broken links report Cons: This website crawler only crawls the links that it can find on the page — if 404 pages do not have any links for Xenu’s Link Sleuth to find, then it will not crawl them.
  • 2. Xenu Link Sleuth crawling website pages… Xenu Link Sleuth provides a broken link report Tool #2 – Google Webmaster Tools (GWT) (http://www.google.com/webmasters/tools/)
  • 3. Pros: Easy to use, has other valuable features Cons: Website must be verified by Google and broken pages only appear when Google provides them Find 404 errors in Google Webmaster Tools - 404 errors in Google Webmaster Tools
  • 4. Tool #3 – Screaming Frog (http://www.screamingfrog.co.uk/seo-spider/) Pros: Advanced spidering/crawling, SEO perspectives Cons: 500 URI crawl limit for free version, complicated for basic users Screaming Frog displays HTTP status codes after crawling Tool #4 – 404 Redirected Plugin For WordPress (http://wordpress.org/extend/plugins/404-redirected/) Pros: Automatic 404 error detection, easy configuration of redirects Cons: Available for WordPress websites only, requires an additional plugin
  • 5. 404 errors can be setup to redirect manually or automatically (automatic matching seems to work well) Automatic 404 error collection is convenient — 301 and 302 redirects are both available Do I need to fix 404 errors? Not necessarily… 404 errors are okay to have as long as they are not causing damage through lost site traffic, lost sales, customer frustration, etc. Most of the time, 404 errors are bad for everyone. However, 404 errors are not to be confused with 404 pages. To create a replacement page, the 404 error should return a custom error page or should be replaced with a 301 redirect that takes visitors to a page that actually exists. Essentially, give the user a good experience even when the page is missing. Find Links Pointing to the 404 One of the best approaches for handling new 404 errors is to determine how many links are pointing to the missing page. These “broken” links may be on the same website, they may be on other websites, may be within email messages, on offline marketing materials, or even within search engine results. If there are a lot of incoming links going to the missing page, then a 301 redirect should be setup. Using 301 Redirects 301 redirects are highly recommended when redirecting individual pages or entire websites. A 301 redirect is setup on a server to let the Internet browser know “this page has moved permanently”. These redirects are especially handy when the missing page has a high organic search rank on search engines because it maintains the SEO strength of the link even when redirected. Sometimes there isn’t a good page to redirect to. In this case, a custom error page should be provided. Creating Custom 404 Pages If a 301 redirect was not chosen, then a visitor-friendly, custom error page can be used in place of the missing page. Typically, a website uses a single custom error page for all 404 errors. This custom error page usually provides a few important items to the confused visitor: 1. A message to the user explaining that the page they are looking for does not exist 2. A search box to help a visitor find exactly what they want 3. A website navigation system to help visitors browse for more information 4. A link to the home page So there you have it — how to find 404 pages and how to fix them. Now when your favorite customers find a broken link, they will find either your custom 404 page or won’t be able to tell that anything happened with a 301 redirect. http://www.volume9inc.com/2012/12/04/4-tools-to-find-website-404-errors/