Post

I will absolutely have my site send your scraper the misleading HTTP status code to your scraper just like I'll poison my robots.txt with trash pages Have fun with that...