A Uniform Resource Locator or Universal Resource Locator (URL) is a character string that specifies where a known resource is available on the Internet and the mechanism for retrieving it.
Short for Domain Name System, an Internet service that translates domain names into IP addresses
For example, the domain name www.example.com might translate to 184.108.40.206.
The document index keeps information about each document.
The information stored in each entry includes the current document status, a pointer into the repository, a document checksum, and various statistics, points to variable file which contains crawled pages’ URL.
Parse:to divide large components into small components that can be analyzed.
PARSER: A program that dissects source code so that it can be translated into object code.