Support

Admin Tools

#20267 Blocking Bot / Crawler

Posted in ‘Admin Tools for Joomla! 4 & 5’
This is a public ticket

Everybody will be able to see its contents. Do not include usernames, passwords or any other sensitive information.

Environment Information

Joomla! version
n/a
PHP version
n/a
Admin Tools version
n/a

Latest post by nicholas on Friday, 13 June 2014 01:20 CDT

Thursday, 12 June 2014 14:15 CDT

user69824
 Hi Nicholas,

How are you?

I wasn't here for a long time... which I guess is a good thing, no? :)

I have a problem with a bot/crawler/referring url that is hitting my sites everyday, but each time with new IP, so there's no point of blocking the IP:

http://semalt.semalt.com/crawler.php?u=http://xxxxxxxxxxxxx.com [where 'x' is of course my domain/website name].

CanI block it with the htaccess maker? If yes -- what to add to the htaccess:

1.http://semalt.semalt.com/crawler.php?u=

2. http://semalt.semalt.com/crawler.php

3.http://semalt.semalt.com/


Thanks for your help!

Friday, 13 June 2014 01:20 CDT

nicholas
You need to find its user agent string (from your site's access log) and use the .htaccess Maker to block that user agent.

Nicholas K. Dionysopoulos

Lead Developer and Director

🇬🇷Greek: native 🇬🇧English: excellent 🇫🇷French: basic • 🕐 My time zone is Europe / Athens
Please keep in mind my timezone and cultural differences when reading my replies. Thank you!

Support Information

Working hours: We are open Monday to Friday, 9am to 7pm Cyprus timezone (EET / EEST). Support is provided by the same developers writing the software, all of which live in Europe. You can still file tickets outside of our working hours, but we cannot respond to them until we're back at the office.

Support policy: We would like to kindly inform you that when using our support you have already agreed to the Support Policy which is part of our Terms of Service. Thank you for your understanding and for helping us help you!