this post was submitted on 12 Feb 2025
149 points (98.7% liked)

Opensource

1879 readers
157 users here now

A community for discussion about open source software! Ask questions, share knowledge, share news, or post interesting stuff related to it!

CreditsIcon base by Lorc under CC BY 3.0 with modifications to add a gradient



founded 1 year ago
MODERATORS
you are viewing a single comment's thread
view the rest of the comments
[–] poVoq@slrpnk.net 9 points 22 hours ago (1 children)

More likely due to extreme AI scraping. That has been an issue with selfhosted Forgejo instances for months now and it is a complete PITA to deal with.

[–] asudox@lemmy.asudox.dev 7 points 20 hours ago (1 children)
[–] xtools@programming.dev 2 points 13 hours ago

interesting project, thx for sharing! though:

There is not currently a way to differentiate between web crawlers that are indexing sites for search purposes, vs crawlers that are training AI models. ANY SITE THIS SOFTWARE IS APPLIED TO WILL LIKELY DISAPPEAR FROM ALL SEARCH RESULTS.