10
submitted 1 week ago by FedX@quokk.au to c/fuck_ai@lemmy.world

A simple tool to figure out just how much LLM generated code has been used in a project. Obviously not perfect, but it automates the task of going through commits for "co-authored by" statements and other signs. In the off chance you don't want to use the CLI, there's also a web app!

you are viewing a single comment's thread
view the rest of the comments
[-] CameronDev@programming.dev 1 points 1 week ago* (last edited 1 week ago)

Its just reading the commit history. It doesnt read the files at all. So it only finds overt slop, anyone who does their commits manually would pass completely.

Edit: https://slopscore.ava.pet/repo/https%3A%2F%2Fgithub%2Ecom%2Fcameroncros%2Fedgy%2Dtable

This repo is 100% slop (its mine, I know what I did), and it gets marked clean.

[-] bugbear@lemmy.sdf.org 1 points 1 week ago

I mean, realistically speaking that's what I would do manually. So it's just making my life easier by automating it.

I don't expect it to analyse individual files.

[-] FedX@quokk.au 2 points 1 week ago

Exactly. It can produce false negatives, but by nature of Git's blaming everyone for every change, it makes it (probably) won't produce false positives. It's a give and take in that instance. Do you do a witch hunt and try and track down every LLM generated repo and get some legit repos caught up in an imperfect process. Or do you use actionable evidence to make an informed decision?

In my opinion, witch hunts are really quite unhealthy for society. When possible, I choose projects with blanket no-AI statements, but when not, this expedites the process of choosing between alternatives. Rustic has less AI generated code than Restic, let's do that. Kitty has hundreds of AI generated commits, let's delete that immediately.

[-] chickenf622@sh.itjust.works 1 points 1 week ago

It also looks for certain files like AGENTS.md which your repo doesn't appear to have.

[-] eremophila@lemmy.zip 0 points 1 week ago
[-] CameronDev@programming.dev 0 points 1 week ago

Ha, I still hand write most of my code, i used it for that repo to try out local LLMs. Know thy enemy.

I did hand-polish that code as well, just the initial pass was slopped together.

this post was submitted on 05 Sep 2026
10 points (100.0% liked)

Fuck AI

8202 readers
860 users here now

"We did it, Patrick! We made a technological breakthrough!"

A place for all those who loathe AI to discuss things, post articles, and ridicule the AI hype. Proud supporter of working people. And proud booer of SXSW 2024.

AI, in this case, refers to LLMs, GPT technology, and anything listed as "AI" meant to increase market valuations.

founded 2 years ago
MODERATORS