Hacker Newsnew | past | comments | ask | show | jobs | submitlogin

Honestly, from prior experience any scraping requirements that require browser implementation tend to be due to captchas and anti-scraping measures, nothing to do with the data layout.

It's either in the DOM or in one or two other payloads.

Isn't this sort-of-why people hide themselves behind Cloudflare, to remove the lowest common denominators of scraping.



Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: