Welcome Guest Search | Active Topics | Members | Log In | Register

How does respidering work? Options
ozbiz
Posted: Friday, November 28, 2008 12:37:52 AM
Rank: Newbie
Groups: Member

Joined: 11/25/2008
Posts: 2
Points: -141
Location: Australia
After a site has been completely spidered, how does the refresh work?

Does it use a head request to confirm the existence of the file or is the whole file requested again?
Sponsor
Posted: Friday, November 28, 2008 12:37:52 AM
Get your Sitemap Generator license today! http://www.keylimetie.com/Checkout/Quick-PayPal/
KeyLimeTie
Posted: Saturday, November 29, 2008 10:38:30 AM
Rank: Administration
Groups: Administration

Joined: 1/31/2007
Posts: 590
Points: 396
Location: Chicago, IL
The entire website is spidered again to search for new pages and removed pages. All saved details for a page (i.e. priority, change frequency) are saved so you don't have to reset them.

Thanks,
Brian
KeyLimeTie
Users browsing this topic
Guest


Forum Jump
You cannot post new topics in this forum.
You cannot reply to topics in this forum.
You cannot delete your posts in this forum.
You cannot edit your posts in this forum.
You cannot create polls in this forum.
You cannot vote in polls in this forum.

Main Forum RSS : RSS

None
Powered by Yet Another Forum.net version 1.9.1.2 (NET v2.0) - 9/27/2007
Copyright © 2003-2006 Yet Another Forum.net. All rights reserved.
This page was generated in 0.044 seconds.