piwik should serve a robots.txt to prevent polluting the error logs #431
Labels
Task
Indicates an issue is neither a feature nor a bug and it's purely a "technical" change.
Milestone
My server logs show many requests for a robots.txt from the crawlers of the search engines.
To stop the crawlers from polluting the logs a robots.txt should be added to the root of piwik.
I think a global dissalow is the desired behaviour in most caeses – see attached file.
The text was updated successfully, but these errors were encountered: