Hacker Newsnew | past | comments | ask | show | jobs | submitlogin

Would someone even want to circumvent it though? Most sites won't care very much about encouraging scrapers to include them in LLM training data, it's not like you get paid.


If your website is created to promote a product of course you are incentivized to be included.




Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: