Why the number of pages crawled by Google is higher than the number on your site

Thread Rating:

0 Vote(s) - 0 Average
1
2
3
4
5

Threaded Mode | Linear Mode

Why the number of pages crawled by Google is higher than the number on your site

11-10-2006, 12:19 PM,

Post: #1

mandy Offline

Administrator

Posts: 9,932
Likes Given: 0
Likes Received: 6 in 5 posts
Joined: Feb 2011
Reputation: 0

Why the number of pages crawled by Google is higher than the number on your site

Quote:The Googlebot activity reports in webmaster tools show you the number of pages of your site Googlebot has crawled over the last 90 days. We've seen some of you asking why this number might be higher than the total number of pages on your sites.

Googlebot crawls pages of your site based on a number of things including:

* pages it already knows about
* links from other web pages (within your site and on other sites)
* pages listed in your Sitemap file

More specifically, Googlebot doesn't access pages, it accesses URLs. And the same page can often be accessed via several URLs...

full article: http://googlewebmastercentral.blogspot.c...rawls.html

« Next Oldest | Next Newest »

Possibly Related Threads…
Thread		Author	Replies	Views	Last Post
	Optimizing Your Site for Google Search	Kristijntje	0	142,330	07-12-2008, 11:35 AM Last Post: Kristijntje
	Optimizing Your Website Pages for Google	mandy	0	2,142	04-20-2008, 09:06 AM Last Post: mandy
	Doorway Pages, Startpages, and Google's Fight Against Spam	Kristijntje	0	1,884	07-10-2007, 01:01 PM Last Post: Kristijntje
	Google's Favorite Site Volkswagen Spams Google	mandy	0	2,183	05-08-2007, 09:19 AM Last Post: mandy
	Google is fast (or why is Yahoo so friggin' slow to index new sites)	amy	0	1,852	03-10-2007, 12:18 AM Last Post: amy
	google's hidden pages	WebGraphicsSource	8	4,480	12-13-2006, 12:14 AM Last Post: BellisimaJ.
	Should you target Visitors or Search Engines when you develop Web Pages?	mandy	0	2,070	11-02-2006, 09:29 AM Last Post: mandy
	Google's resident SEO expert discusses Google SEO Myths, Images, Site Launches	mandy	0	2,128	08-01-2006, 10:46 AM Last Post: mandy
	Big Google is much worse than Big Oil: Tell your senator	mandy	1	2,340	11-12-2005, 12:23 PM Last Post: Kristijntje

Forum Jump:

Users browsing this thread: 1 Guest(s)