|
|
Rank: Member
Groups: Member
Joined: 12/29/2008
Posts: 10
Points: 30
Location: California
|
I'm trying to spider the URL, http://connections.rock.com. Unfortunately, KLT returns a 404 error, even though the URL is valid. The problem may be that the URL forwards to http://www.rock.com/connections, but when I spider http://www.rock.com, the /connections extension is not found. Any ideas? Erin Rado
|
|
|
|
|
|
Rank: Administration
Groups: Administration
Joined: 1/31/2007
Posts: 586
Points: 384
Location: Chicago, IL
|
erinrado - We'll take a look at this and get back to you early next week.
|
|
Rank: Member
Groups: Member
Joined: 12/29/2008
Posts: 10
Points: 30
Location: California
|
Thanks.
Please reply ASAP, though, because we I really need to create a sitemap for the URL listed.
Erin Rado
|
|
Rank: Member
Groups: Member
Joined: 12/29/2008
Posts: 10
Points: 30
Location: California
|
I never received a reply to this post. I need an answer to this question. Please respond ASAP.
Thank you, Erin Rado
|
|
Rank: Administration
Groups: Administration
Joined: 1/31/2007
Posts: 586
Points: 384
Location: Chicago, IL
|
Erin, The problem is in what you want to do is not allowed by Google. If the main site is http://connections.rock.com, then all URLs that are spidered and saved to the sitemap MUST start with http://connections.rock.com. The URL redirects to http://www.rock.com/connections, and is ignored since it isn't valid. If you want to submit URLs that start with http://www.rock.com/connections to search engines, they need to be submitted under the http://www.rock.com sitemap. The best approach might be to add a link to http://www.rock.com/connections somewhere on http://www.rock.com. Thanks, KeyLimeTie
|
|
Rank: Member
Groups: Member
Joined: 12/29/2008
Posts: 10
Points: 30
Location: California
|
We tried to add a link to www.rock.com that links to www.rock.com/connections, but KLT only found the root URL www.rock.com. We have links in both the header and footer of www.rock.com that KLT doesn't find. Does KLT locate links in headers and footers? Please advise. Thank you.
|
|
Rank: Administration
Groups: Administration
Joined: 1/31/2007
Posts: 586
Points: 384
Location: Chicago, IL
|
We started to spider www.rock.com and it immediately found the connections URL. It is working perfectly. 
|
|
Rank: Member
Groups: Member
Joined: 12/29/2008
Posts: 10
Points: 30
Location: California
|
This is strange because for over a month when I spidered www.rock.com I only found 1 URL, www.rock.com. Today when I spidered the site, the same results you have popped up for me. http://connections.rock.com has thousands of pages. Is there any way I will ever be able to spider it? Erin Rado
|
|
Rank: Administration
Groups: Administration
Joined: 1/31/2007
Posts: 586
Points: 384
Location: Chicago, IL
|
connections.rock.com forwards to www.rock.com, therefore, it doesn't make sense to ever spider connections.rock.com. There wouldn't be any URLs except the root URL. In a sitemap file, ALL URLs must contain the root URL (e.g. all URLs in the connections.rock.com sitemap file must start with connections.rock.com).
|
|
|
Guest |
