this post was submitted on 12 Feb 2025
149 points (98.7% liked)

Opensource

1879 readers
191 users here now

A community for discussion about open source software! Ask questions, share knowledge, share news, or post interesting stuff related to it!

CreditsIcon base by Lorc under CC BY 3.0 with modifications to add a gradient

⠀

founded 1 year ago
MODERATORS
pylapp@programming.dev
149
Codeberg is currently suffering from hate campaigns due to far-right forces (blog.codeberg.org)
submitted 1 day ago by RmDebArc_5@sh.itjust.works to c/opensource@programming.dev
22 comments fedilink hide all child comments
you are viewing a single comment's thread
view the rest of the comments
[–] asudox@lemmy.asudox.dev 7 points 19 hours ago (1 children)

Time for the LLM crawler trap: https://zadzmo.org/code/nepenthes/

[–] xtools@programming.dev 2 points 12 hours ago

interesting project, thx for sharing! though:

There is not currently a way to differentiate between web crawlers that are indexing sites for search purposes, vs crawlers that are training AI models. ANY SITE THIS SOFTWARE IS APPLIED TO WILL LIKELY DISAPPEAR FROM ALL SEARCH RESULTS.