Definition and Importance of Web Indexing
– Web indexing is the process of indexing the contents of a website or the entire internet.
– It involves using keywords and metadata for efficient searching.
– Web indexing is crucial for search engines and periodical websites.
– Back-of-the-book-style indexes are used for individual websites or intranets.
– A-Z indexes provide an alphabetical browse view for websites.
Types of Web Indexing
– Back-of-the-book-style indexes are alphabetical and used for individual websites.
– Hierarchical categories or taxonomies are used for some websites.
– Metadata web indexing assigns keywords or phrases to web pages.
– Metadata tags or meta-tags are used for search engine indexing.
– Different methods of web indexing include Z39.50 and OpenSearch.
Web Indexing Techniques
– Web crawlers are used to index the web.
– Search/Retrieve Web Service is a technique for web indexing.
– Search/Retrieve via URL is another technique for web indexing.
– Representational State Transfer (REST) is used for web indexing.
– Wide area information server (WAIS) is a technique for web indexing.
Related Concepts and Technologies
– Search engines are closely related to web indexing.
– Desktop search is another concept related to web indexing.
– Online search is an important aspect of web indexing.
– Z39.50 is a protocol used for information retrieval.
– Web indexing is supported by the concept of OpenSearch.
References and Further Reading
– ‘Web Crawlers: Indexing the Web’ by Malay Kumar Kundu, Durga Prasad Mohapatra, Amit Konar, and Aruna Chakraborty.
– ‘Indexing the Web’ by the American Society for Indexing.
– ‘What is Website Indexing?’ – an article on Wikipedia.
– Advanced Computing, Networking and Informatics – Volume 1: Advanced Computing and Informatics Proceedings of the Second International Conference on Advanced Computing, Networking and Informatics (ICACNI-2014).
– Internet search algorithms and index publishing are related categories.
This article includes a list of general references, but it lacks sufficient corresponding inline citations. (December 2014) |
Web indexing, or internet indexing, comprises methods for indexing the contents of a website or of the Internet as a whole. Individual websites or intranets may use a back-of-the-book index, while search engines usually use keywords and metadata to provide a more useful vocabulary for Internet or onsite searching. With the increase in the number of periodicals that have articles online, web indexing is also becoming important for periodical websites.
Back-of-the-book-style web indexes may be called "web site A-Z indexes". The implication with "A-Z" is that there is an alphabetical browse view or interface. This interface differs from that of a browse through layers of hierarchical categories (also known as a taxonomy) which are not necessarily alphabetical, but are also found on some web sites. Although an A-Z index could be used to index multiple sites, rather than the multiple pages of a single site, this is unusual.
Metadata web indexing involves assigning keywords, description or phrases to web pages or web sites within a metadata tag (or "meta-tag") field, so that the web page or web site can be retrieved with a list. This method is commonly used by search engine indexing.
