One in twelve software companies in Wikidata blocks an AI crawler by name
What software companies block in robots.txt
| Value | |
|---|---|
| Block a training crawler by name | 8.4% |
| Block every crawler through * and name no AI crawler | 0.6% |
| Block a search or user crawler by name | 0.2% |








