These days I prefer to ask an LLM to just go fetch content for me as much as possible.

How often do they run into anti bot protections?

Vision language models are quite good at solving captchas now :)

-links +lynx

`links` is a text mode browser which is more capable than `lynx` and which has graphics support through the framebuffer.

and elinks is better than both of them :))

and w3m if you want support for images

And chawan is better than all of them, even has basic support for CSS and Javascript.