Étiquette de l’extension : crawler
-
Robots.txt Extender
(0 notes en tout)Dynamic robots.txt for Multisite! Change parameters, or don't, for each site of your network without losing the defaults from WordPress Includes.
-
rexCrawler
(0 notes en tout)rexCrawler is a regular expression web-crawler plugin. Able to parse websites, save data and show them on pages.
-
JaspreetChahal’s wordpress bot detector lite
(1 notes en tout)This plugin detects a few bots (e.g. Google, Google ads, Alta vista etc) and sends an email based on interval set by you. you can choose what format e …
-
SEObot Monitor for Googlebot, Bingbot and search engine spiders
(0 notes en tout)With SEObot Monitor for Googlebot you will be able to dump the server logs to Google Analytics, easily and automatically. This will allow you to dete …
-
Page Modified
(1 notes en tout)Display the results of your Page Modified crawls right within your WordPress Admin.