robots.spider(tm) 1.0
Developed by Betsy A. Gamrat, listed in Configuration
robots.spider(tm) will read a robots.txt file and compare it with the pages on the site. Search engines spider the site. If there are no references to a directory or file, it will not be indexed.
robots.txt files should not refer to unreferenced content because it allows other viewers to identify areas of your site that you don't want indexed. The read depth limits the number of pages scanned.
License type: GPL
Date added: 7 years, 3 months 3 days ago | Last updated: 7 years, 3 months 3 days ago
More popular Configuration
- Config Manager 1.0 (4 years, 7 months 26 days ago)
- Class Generator 1.0 (2 years, 5 months 1 day ago)
- Logger class oLogger 1.0 (7 years, 1 month ago)
- Ianaz Configuration Class 1.0 (5 years, 2 months 22 days ago)
- A simple ini parser 1.0 (7 years, 4 months 6 days ago)
This is actually one of the most advanced image hosting script. The imagetize key features: SEO, Ads Ready, Admin
Listing Files
robots-spidertm
Hot Scripts
- Mysql Ajax Table Editor
- PHP DataGrid
- Console App
- AJAX Login Module
- Form Tools
- Amba XML document
- LimeSurvey
- XLS Export
- ajaxCRUD
- SuperCali PHP Event Calendar
Sponsors
- FREE MySQL Cloud Database Super Simple, Zero-Management MySQL Cloud DB. Use It FREE!
- Pinterest clone Start your own pin board social network today. Get Pintastic and start your own pinterest clone network.
- MYRE Real Estate Software Professional Real Estate solutions by MYREPHP PROGRAMMING!
