Robots.txt started I’m 1994.

It’s been a consensus for decades.

Why throw it out and replace it with imied consent to scrape?

That’s why I said legally there’s nothing they can do. If people want to scrape it they can and will.

This is strictly about consent. Just because you can doesn’t mean you should yes?

I guess I haven’t read a convincing argument yet why robots.txt should be ignored.

Why invent implied consent when complicit explicit has been the standard in robots.txt for ages now?

Legally speaking there’s nothing they can do. But this is about consent, not legality. So why use implied?