33
you are viewing a single comment's thread
view the rest of the comments
[-] 8uurg@lemmy.world 15 points 3 weeks ago

Classic bots (e.g. standard web crawlers, as used by search engines, that report their both nature inside their user agent) or the modern LLM-controlled bots that control a full modern browser that also runs javascript?

Because I can imagine they account for the first category, while missing the latter, which have become increasingly more prominent.

[-] freeman@sh.itjust.works 2 points 3 weeks ago

The kind that wants to not appear as a bot is unlikely to send a Linux user agent even if running on Linux.

[-] 8uurg@lemmy.world 2 points 3 weeks ago

It doesn't have to be on purpose. Web crawlers like Google's specifically identify themselves as a bot. A headless browser just acts like any normal browser, and uses the same user agent as one, just controlled by code rather than a keyboard and mouse.

this post was submitted on 03 Aug 2026
33 points (70.4% liked)

PC Master Race

22219 readers
324 users here now

A community for PC Master Race.

Rules:

  1. No bigotry: Including racism, sexism, homophobia, transphobia, or xenophobia. Code of Conduct.
  2. Be respectful. Everyone should feel welcome here.
  3. No NSFW content.
  4. No Ads / Spamming.
  5. Be thoughtful and helpful: especially when new beginners have questions.

founded 3 years ago
MODERATORS