Blackhole For Bad Bots

This is very simple free module for prestashop and thirtybees platforms. It is based on a very simple idea:

1. you instruct all robots visiting your website NOT to open specific url

2. this module will add hidden link from all pages on your website to this forbidden page. This link is perfectly visible to all robots, but normal visitors will not notice it at all (without looking into web page source code)

3. when anyone access this forbidden page, their IP address will be immediately added to blacklist

4. blacklisted visitor are forbidden from viewing content from your website

5. shop administrator is notified about new entries to blacklist. They will receive email with WHOIS information about the visitor - their IP address, location, network, etc.

And that’s it. This trap will not affect any good robots who are following robots.txt directives. On other hand, all bad bots and crawlers will be eventually trapped and forbidden from ever collecting information from your site again.

Module activation

1. edit robots.txt file in the root directory

Before you install this module, you need to edit your robots.txt file, and add following two lines

User-agent: *
Disallow: */blackhole/

1. install module

2. optionally, you can test it by navigating to https://www.yourdomain.com/blackhole/. You should be banned from your own site. 

Moderation

List of blocked IP addresses is displayed in back office module configuration page. You can review use this list to review IP addresses. You can also unblock IP addresses that were trapped by mistake.

Configuration

You can change trap url if default https://www.yourdomain.com/blackhole/ does not meet your needs.