Sitemaps

« Back to Glossary Index

History and Purpose of Sitemaps
Google introduced Sitemaps 0.84 in June 2005
Google, Yahoo!, and Microsoft announced joint support for the Sitemaps protocol in November 2006
– Ask.com and IBM announced support for Sitemaps in April 2007
– State governments of Arizona, California, Utah, and Virginia announced they would use Sitemaps in May 2007
– Sitemaps protocol is based on ideas from Crawler-friendly Web Servers
– Sitemaps are beneficial for websites with unavailable areas through the browsable interface
– Useful for websites with rich Ajax, Silverlight, or Flash content not processed by search engines
– Helps with large websites to avoid overlooking new or updated content
– Effective for websites with isolated or poorly linked pages
– Useful for websites with few external links

File Format and Element Definitions
– Sitemaps use XML tags and can be UTF-8 encoded
– Sitemaps can also be plain text lists of URLs
– Sitemaps can be compressed in .gz format
– Sitemap index files are necessary for large sites with a maximum size of 50MiB or 50,000 URLs
– Sitemap index files reference separate sitemaps
– The ‘urlset’ element is required and contains the Sitemap
– The ‘url’ element is required and serves as the parent element for each entry
– The ‘sitemapindex’ element is required for Sitemap index files
– The ‘sitemap’ element is required and serves as the parent element for each entry in the index
– The ‘loc’ element is required and provides the full URL of the page or sitemap

Other Formats and Search Engine Submission
– Sitemaps can be in the form of a simple list of URLs in a text file
– Syndication feeds can be used to submit URLs to crawlers
– Having a syndication feed as a delta update can supplement a complete sitemap
Search engine submission of Sitemaps provides status information and processing errors
– Sitemap location can be included in the robots.txt file or specified in the search engine’s submission URL.

Sitemap Limits
– Sitemap files have a limit of 50,000 URLs and 50MiB (52,428,800 bytes) per sitemap.
– Sitemaps can be compressed using gzip, reducing bandwidth consumption.
– Multiple sitemap files are supported, with a Sitemap index file serving as an entry point.
– Sitemap index files may not list more than 50,000 Sitemaps and must be no larger than 50MiB and can be compressed.
– You can have more than one Sitemap index file.

Additional Sitemap Types
– A number of additional XML sitemap types outside of the scope of the Sitemaps protocol are supported by Google.
– Video and image sitemaps are intended to improve the capability of websites to rank in image and video searches.

Subgroup: Video Sitemaps
– Video sitemaps indicate data related to embedding and autoplaying, preferred thumbnails to show in search results, publication date, video duration, and other metadata.
– Video sitemaps are also used to allow search engines to index videos that are embedded on a website, but that are hosted externally, such as on Vimeo or YouTube.

Subgroup: Image Sitemaps
– Image sitemaps are used to indicate image metadata, such as licensing information, geographic location, and an image’s caption.

Subgroup: Google News Sitemaps
Google supports a Google News sitemap type for facilitating quick indexing of time-sensitive news subjects.

Sitemaps (Wikipedia)

Sitemaps is a protocol in XML format meant for a webmaster to inform search engines about URLs on a website that are available for web crawling. It allows webmasters to include additional information about each URL: when it was last updated, how often it changes, and how important it is in relation to other URLs of the site. This allows search engines to crawl the site more efficiently and to find URLs that may be isolated from the rest of the site's content. The Sitemaps protocol is a URL inclusion protocol and complements robots.txt, a URL exclusion protocol.

« Back to Glossary Index

Submit your RFP

We can't wait to read about your project. Use the form below to submit your RFP!

Gabrielle Buff
Gabrielle Buff

Just left us a 5 star review

Great customer service and was able to walk us through the various options available to us in a way that made sense. Would definitely recommend!

Stoute Web Solutions has been a valuable resource for our business. Their attention to detail, expertise, and willingness to help at a moment's notice make them an essential support system for us.

Paul and the team are very professional, courteous, and efficient. They always respond immediately even to my minute concerns. Also, their SEO consultation is superb. These are good people!

Paul Stoute & his team are top notch! You will not find a more honest, hard working group whose focus is the success of your business. If you’re ready to work with the best to create the best for your business, go Stoute Web Solutions; you’ll definitely be glad you did!

Wonderful people that understand our needs and make it happen!

Paul is the absolute best! Always there with solutions in high pressure situations. A steady hand; always there when needed; I would recommend Paul to anyone!

facebook
Vince Fogliani
recommends

The team over at Stoute web solutions set my business up with a fantastic new website, could not be happier

facebook
Steve Sacre
recommends

If You are looking for Website design & creativity look no further. Paul & his team are the epitome of excellence.Don't take my word just refer to my website "stevestours.net"that Stoute Web Solutions created.This should convince anyone that You have finally found Your perfect fit

facebook
Jamie Hill
recommends

Paul and the team at Stoute Web are amazing. They are super fast to answer questions. Super easy to work with, and knows their stuff. 10,000 stars.

Paul and the team from Stoute Web solutions are awesome to work with. They're super intuitive on what best suits your needs and the end product is even better. We will be using them exclusively for our web design and hosting.

facebook
Dean Eardley
recommends

Beautifully functional websites from professional, knowledgeable team.

Along with hosting most of my url's Paul's business has helped me with website development, graphic design and even a really cool back end database app! I highly recommend him as your 360 solution to making your business more visible in today's social media driven marketplace.

I hate dealing with domain/site hosts. After terrible service for over a decade from Dreamhost, I was desperate to find a new one. I was lucky enough to win...

Paul Stoute has been extremely helpful in helping me choose the best package to suite my needs. Any time I had a technical issue he was there to help me through it. Superb customer service at a great value. I would recommend his services to anyone that wants a hassle free and quality experience for their website needs.

Paul is the BEST! I am a current customer and happy to say he has never let me down. Always responds quickly and if he cant fix the issue right away, if available, he provides you a temporary work around while researching the correct fix! Thanks for being an honest and great company!!

Paul Stoute is absolutely wonderful. Paul always responds to my calls and emails right away. He is truly the backbone of my business. From my fantastic website to popping right up on Google when people search for me and designing my business cards, Paul has been there every step of the way. I would recommend this company to anyone.

I can't say enough great things about Green Tie Hosting. Paul was wonderful in helping me get my website up and running quickly. I have stayed with Green...