Hacker Newsnew | past | comments | ask | show | jobs | submitlogin

The document suggests unblocking OAI-SearchBot in robots.txt, and then clarifies:

> OAI-SearchBot is for search. OAI-SearchBot is used to link to and surface websites in search results in ChatGPT's search features. It is not used to crawl content to train OpenAI’s generative AI foundation models. Learn more (opens in a new window).



Consider applying for YC's Summer 2026 batch! Applications are open till May 4

Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: