|
|
Rank: Newbie Groups: Member
Joined: 2/19/2009 Posts: 1 Points: 3
|
Hi, I am evaluating the trial version and have a question around mapping sites. Is there a way with the program to have it crawl a website and login to a members area using a supplied ID and Password? I have a website that has only 3 pages of public content but hundreds of pages of content for the members. I can create a test user and password for the spider to use, but am not sure if you support that type of crawling?
Thanks.
|
|
|
|
|
|
Rank: Administration Groups: Administration
Joined: 1/31/2007 Posts: 590 Points: 396 Location: Chicago, IL
|
The software does not have the ability to log into websites. If your website is built in ASP.NET and you have have access to the code, we can provide code that allows search engines in.
|
|
Rank: Newbie Groups: Member
Joined: 3/10/2009 Posts: 6 Points: 18
|
Can I ask a different question - why would you need to submit a sitemap if google can't crawl those pages anyhow?
Are you playing "bothockey" and showing googlebot real content and users a login page? If so, then we can get your content free by running a user-agent switcher.
Anyway... Steve
|
|
|
Guest |