A robot is a program that automatically traverses the Web's hypertext structure by retrieving a document, and recursively retrieving all documents that are referenced.

That's not FediDB. That's not even nodeinfo.

[–] WhoLooksHere 0 points 1 day ago* (last edited 1 day ago) (1 children)

From your own wiki link

robots.txt is the filename used for implementing the Robots Exclusion Protocol, a standard used by websites to indicate to visiting web crawlers and other web robots which portions of the website they are allowed to visit.

How is fedidb not an "other web robot"?

[–] [email protected] 1 points 1 day ago (1 children)

Ok if you want to focus on that single phrase and ignore the whole rest of the page which documents decades of stuff to do with search engines and not a single mention of api endpoints, that's fine. You can have the win on this, here's a gold star.

[–] WhoLooksHere 1 points 15 hours ago* (last edited 15 hours ago)

Okay,

So why should reinevent a standard when one that serves functionally the same purpose with one of implied consent?

Edit: my problem isn't robots.txt. It's implied consent.

If you are ever thinking, I wonder if I should ask, the answer is always yes. Doesn't matter the situation. If you are not 1000% sure you have consent, you don't. That's just my ethics.

If you want to propose a new standard, go nuts. But implied consent is not it.