OpenAI Says Robots.txt May Not Apply To ChatGPT’s Fetch Bot via @sejournal, @MattGSouthern

New data shows ChatGPT's page-fetching bot is reaching sites that have disallowed it, and OpenAI's own documentation explains why the file may not stop it.
The post OpenAI Says Robots.txt May Not Apply To ChatGPT’s Fetch Bot appeared first on Search Engine Journal.