483
submitted 7 months ago* (last edited 7 months ago) by swiftywizard@discuss.tchncs.de to c/programmer_humor@programming.dev
you are viewing a single comment's thread
view the rest of the comments
[-] FishFace@piefed.social 1 points 7 months ago

There is something wrong if it's not discarding old context to make room for new

[-] bunchberry@lemmy.world 1 points 7 months ago

At least llama.cpp doesn't seem to do that by default. If it overruns the context window it just blorps.

[-] FishFace@piefed.social 1 points 7 months ago

I think there are parameters for that, from googling.

this post was submitted on 25 Jan 2026
483 points (97.4% liked)

Programmer Humor

33145 readers
1087 users here now

Welcome to Programmer Humor!

This is a place where you can post jokes, memes, humor, etc. related to programming!

For sharing awful code theres also Programming Horror.

Rules

founded 3 years ago
MODERATORS