That's intentional. They take the data and deal with the consequences later beca... | Hacker News

Hacker Newsnew | past | comments | ask | show | jobs | submit

		shprd on March 18, 2025 \| parent \| context \| favorite \| on: AI crawlers haven't learned to play nice with webs... That's intentional. They take the data and deal with the consequences later because there's none so far. I hope data poisoning see more traction as a possible countermeasure.

01HNNWZ0MV43FF on March 18, 2025 [–]

I wonder what their data cleaning process looks like. If I put a lot of furry porn on my website, would it get excluded from the data sets?

mtvrs on March 18, 2025 | [–]

Probably only those data sets which do not include furry porn but it's also possible that it could be used in negative data set.

Consider applying for YC's Summer 2026 batch! Applications are open till May 4
Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact