Board index   FAQ   Search  
Register  Login
Board index PHP PHP General

Crawling of PHP based website

General discussions related to php

Moderators: macek, egami, gesf

Crawling of PHP based website

Postby anooalex000 » Sun Jun 17, 2012 6:40 am

I have developed a small website using PHP and PostgreSQL. The application uses Javascripts and Ajax. The application grants access based on user role. There are include files that are brought in conditionally.

Now I have to build the documentation of the application. Typical web crawlers will fail as the next page selection is conditional, and so is the layout of the page.

Are there any crawlers that can go through the server side source code and build the sitemap?
anooalex000
New php-forum User
New php-forum User
 
Posts: 1
Joined: Sun Jun 17, 2012 6:12 am

Re: Crawling of PHP based website

Postby johnj » Mon Jun 18, 2012 7:46 am

Why don't you crawl every file to build the sitemap?
johnj
php-forum Super User
php-forum Super User
 
Posts: 1805
Joined: Thu Mar 10, 2011 5:07 pm


Return to PHP General

Who is online

Users browsing this forum: No registered users and 2 guests

Sponsored by Sitebuilder Web hosting and Traduzioni Italiano Rumeno and antispam for cPanel.