-
Notifications
You must be signed in to change notification settings - Fork 30
Open
Description
Hi!
A Motorola Edge 30 for example has the user agent:
Mozilla/5.0 (Linux; Android 13; motorola edge 30 Build/T1RD33.116-33-3; wv) AppleWebKit/537.36 (KHTML, like Gecko) Version/4.0 Chrome/113.0.5672.132 Mobile Safari/537.36
because that inevitably matches the term "motor" it's flagged as a robot.
I did a bit of digging to figure out where this term might come from and found this entry on robotstxt.org.
According to this it's from a web crawler from 1996 "to build the database for the www.webindex.de".
Today www.webindex.de redirects to www.cybercon.de, the owners of it and it seems that a soft redirect was already put in place at the end of 2004 (according to http://web.archive.org/web/20041129080254/www.webindex.de).
So I think it's safe to say that this project is not around for almost 20 years now and the string can be removed from the list.
Metadata
Metadata
Assignees
Labels
No labels