• Introducing WebPros Cloud - a fully managed infrastructure platform purpose-built to simplify the deployment of WebPros products !  WebPros Cloud enables you to easily deliver WebPros solutions — without the complexity of managing the infrastructure.
    Join the pilot program today!
  • Support for BIND DNS has been removed from Plesk for Windows due to security and maintenance risks.
    If a Plesk for Windows server is still using BIND, the upgrade to Plesk Obsidian 18.0.70 will be unavailable until the administrator switches the DNS server to Microsoft DNS.

Question Block selected UserAgents for all vhosts

Azurel

Silver Pleskian
I want block a few bots and crawlers, which not respect robots.txt.
I think the best way is to create a new apache config-file in "/etc/httpd/conf.d/block_useragents.conf" and reload apache?

Content of block_useragents.conf:
<Directory "/var/www/vhosts/">
RewriteEngine On
RewriteCond %{HTTP_USER_AGENT} ^(Agent1|Agent2|Agent3) [NC]
RewriteRule .* - [F]
</Directory>

Would this work for all vhosts? Is here a better way?
 
Last edited:
 
Thanks for this link. Helps a lot.
BUT what about "missing" user-agents? In my log files I found dozens of requests with "no" or "unknown" user-agent. How to add this to the linked list?
 
Back
Top