| What are Sitemaps?
Sitemaps are an easy way for
webmasters to inform search engines about pages
on their sites that are available for crawling.
In its simplest form, a Sitemap is an XML file
that lists URLs for a site along with additional
metadata about each URL (when it was last updated,
how often it usually changes, and how important
it is, relative to other URLs in the site) so
that search engines can more intelligently crawl
the site.
Web crawlers usually discover
pages from links within the site and from other
sites. Sitemaps supplement this data to allow
crawlers that support Sitemaps to pick up all
URLs in the Sitemap and learn about those URLs
using the associated metadata. Using the Sitemap
protocol does not guarantee that web pages are
included in search engines, but provides hints
for web crawlers to do a better job of crawling
your site.
Sitemap 0.90 is offered under
the terms of the Attribution-ShareAlike Creative
Commons License and has wide adoption, including
support from Google, Yahoo!, and Microsoft.
Benefits of sitemaps
Site maps can improve search
engine optimization of a site by making sure that
all the pages can be found. This is especially
important if a site uses Adobe Flash or JavaScript
menus that do not include HTML links.
Most search engines will only follow a finite
number of links from a page, so if a site is very
large, the site map may be required so that search
engines and visitors can access all content on
the site.
XML sitemaps
Google introduced Google Sitemaps so web developers
can publish lists of links from across their sites.
The basic premise is that some sites have a large
number of dynamic pages that are only available
through the use of forms and user entries. The
sitemap files can then be used to indicate to
a web crawler how such pages can be found.
Google, MSN, Yahoo and Ask now jointly support
the Sitemaps protocol.
Since MSN, Yahoo, Ask, and Google
use the same protocol, having a sitemap lets the
four biggest search engines have the updated page
information. Sitemaps do not guarantee all links
will be crawled, and being crawled does not guarantee
indexing. However, a sitemap is still the best
insurance for getting a search engine to learn
about your entire site.
XML sitemaps have replaced the
older method of "submitting to search engines"
by filing out a form on the search engines submission
page. Now web developers submit a sitemap directly,
or wait for search engines to find it.
|