Crawling of PHP based website

General discussions related to php

Moderators: macek, egami, gesf

New php-forum User
New php-forum User
Posts: 1
Joined: Sun Jun 17, 2012 6:12 am

Crawling of PHP based website

Postby anooalex000 » Sun Jun 17, 2012 6:40 am

I have developed a small website using PHP and PostgreSQL. The application uses Javascripts and Ajax. The application grants access based on user role. There are include files that are brought in conditionally.

Now I have to build the documentation of the application. Typical web crawlers will fail as the next page selection is conditional, and so is the layout of the page.

Are there any crawlers that can go through the server side source code and build the sitemap?

php-forum Super User
php-forum Super User
Posts: 1805
Joined: Thu Mar 10, 2011 5:07 pm

Re: Crawling of PHP based website

Postby johnj » Mon Jun 18, 2012 7:46 am

Why don't you crawl every file to build the sitemap?

Return to “PHP General”

Who is online

Users browsing this forum: No registered users and 4 guests