PC Gaming

I means, I’m I huge local LLM advocate. I look at slop metrics, I’ve finetuned or messed with smaller LLMs for prose. I use bigger MoEs with raw completion syntax to get past writers block and some probably-related-to-neurodivergence issues I have.

But they really are terrible with long-form stories.

There’s no way around it. They just can’t stick to a coherent plot.

And even at the “micro” scale (eg “I’m stuck, how do I finish this sentence?” or “how should this character realistically respond?” or “does this paragraph feel stilted?”) they’re only there for inspiration, or maybe as a mirror to bounce ideas off of. Not any sort of output you could rely on.

It absolutely boggles my mind people think they can replace, or even “double” writers. They don’t think. They are literally architected to be terrible at that, no matter how much koolaid on scaling Altman preaches.

sadly, a bad first draft in five minutes usually beats a thoughtful solution in three days

edit: oops i thought we were talking about code. nvm, people actually look at prose.

I can see how it could be useful, or mandatory in future rpgs. It can generate a framework for a real writer, with extremely large amounts of logical branching, a billion times faster. Then you go over the top of it and use the framework as concepts to use or revise. This streamlines the process, unifies the creative vision, and allows for such a large game without procedural generation that would haven taken a team 10 years or not at all, done in 2.

Nah, can't agree. I have postponed few ideas for years, was able to vibe them in a week during evenings, now i have something usable. 70% of it was vibed, just had to fix stupid stuff that was partially on my queries.