Welcome Guest Search | Active Topics | Members | Log In | Register

Query String Options
hsegars
Posted: Monday, December 17, 2007 11:25:50 AM
Rank: Newbie
Groups: Member

Joined: 12/17/2007
Posts: 3
Points: 9
Location: Brick, NJ
I am having a problem spidering my site. I use a cgi file that generates pages with ?ct= and I do not want to include these in the spidering as it creates too many pages that do not contain relevant contect. When I spider my site now, it generated over 35,000 pages. Many of these pages were those with "?ct=". I also have pages that have ?direct= that I do want to include. If I try to exclude "ct" in the query string, it also excludes any pages with "ct" in them, such as "direct=". Is there a way to exclude "ct" with out excluding "direct"?
Sponsor
Posted: Monday, December 17, 2007 11:25:50 AM
Get your Sitemap Generator license today! http://www.keylimetie.com/Checkout/Quick-PayPal/
KeyLimeTie
Posted: Friday, December 21, 2007 11:32:25 AM
Rank: Administration
Groups: Administration

Joined: 1/31/2007
Posts: 586
Points: 384
Location: Chicago, IL
Yes. Please read the documentation. Use the "Ignore Querystring" preference.
Users browsing this topic
Guest


Forum Jump
You cannot post new topics in this forum.
You cannot reply to topics in this forum.
You cannot delete your posts in this forum.
You cannot edit your posts in this forum.
You cannot create polls in this forum.
You cannot vote in polls in this forum.

Main Forum RSS : RSS

None
Powered by Yet Another Forum.net version 1.9.1.2 (NET v2.0) - 9/27/2007
Copyright © 2003-2006 Yet Another Forum.net. All rights reserved.
This page was generated in 0.044 seconds.