Forum Moderators: goodroi
The info page says it's a distributed crawler, so just like my policy for the cronic robots.txt violater Grub, I banned the user agent and the entire IP block associated with the offending IP.
Already covered multiple times in this thread.
I keep searching the thread but I cannot find the contents of the robots.txt file you claim to have posted - what does "troll" mean in this context? If you have "troll" as a robots.txt directive, this may be the problem - please check one of the validators I mentioned earlier.
