78

Support this channel on Patreon ► https://www.patreon.com/zoranhorvatGenerative AI can write code, but it cannot develop software on its own. Here is why the...

you are viewing a single comment's thread
view the rest of the comments
[-] fruitcantfly@programming.dev 9 points 3 months ago

I don't have great experiences trying to get LLMs to write code, but I've found it to be incredibly valuable for checking my code for mistakes and oversights. Sure, it will spit out nit picks, false positives, and straight up nonsense, but at a rate that is quite a bit lower than other tools I've used. I not infrequently end up going through a number of iterations, rewriting code and tests based on its feedback, until I'm happy with the code and the LLM no longer points out actual problems.

It probably doesn't help my productivity, in terms of lines of code committed or whatever companies might use, but it certainly helps improve the quality of my work

[-] starelfsc2@sh.itjust.works 4 points 3 months ago

It's only really good if you are totally confident in what is and is not a mistake though, as it'll do things like replace a struct with an int and be like "use a vec of indices and access the actual array with that since it's smaller to copy and pass around!" when you have no need to copy and pass it around, and it basically created a layer of indirection for no reason.

It'll then make up some reason as to why you DO need to pass it around and copy it, so you have to be REALLY sure about what the code should be doing.

[-] fruitcantfly@programming.dev 2 points 3 months ago

It probably depends on what model you are using, but what you describe is more akin to the kind of advice I've gotten when I've asked for suggestions for optimizations, rather than asked the LLM to identify (not solve) problems in the code. When I've asked the LLM to identify problems, the overwhelming majority of issues raised where true positives, though most of them weren't very serious either

[-] starelfsc2@sh.itjust.works 2 points 3 months ago* (last edited 3 months ago)

Yeah I would say it's pretty good at catching most mistakes the majority of the time, it's just the few times when it does make a mistake that I'm not sure is a mistake or not, it'll argue in a way that seems plausible and forces me to rethink and verify the code that was already correct. I probably still save time with it, but it can be incredibly annoying and time consuming when it fails.

[-] fruitcantfly@programming.dev 2 points 3 months ago

True. Most of the false positives were easy to dismiss, but I did spent a significant amount of time of time on a couple of them, since it wasn't immediately clear to me that the code was correct. In one case the agent had missed a precondition that was verified elsewhere, and in the other it had misrepresented what the C++ standard actually said

this post was submitted on 28 Jun 2026
78 points (93.3% liked)

Programming

28702 readers
513 users here now

Welcome to the main community in programming.dev! Feel free to post anything relating to programming here!

Cross posting is strongly encouraged in the instance. If you feel your post or another person's post makes sense in another community cross post into it.

Hope you enjoy the instance!

Rules

Rules

  • Follow the programming.dev instance rules
  • Keep content related to programming in some way
  • If you're posting long videos try to add in some form of tldr for those who don't want to watch videos

Wormhole

Follow the wormhole through a path of communities !webdev@programming.dev



founded 3 years ago
MODERATORS