Set user agent for crawler #2

Open

Labels

opened

Crawler should set a user agent so site owners know where the request is coming from.

Via https://twitter.com/benediktLEB/status/1037659559211556864

Metadata

Assignees

No one assigned

Labels

Type

No type

Fields

No fields configured for issues without a type.

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests