1179
New compression technique
(lemmy.nz)
Welcome to Programmer Humor!
This is a place where you can post jokes, memes, humor, etc. related to programming!
For sharing awful code theres also Programming Horror.
On a similar note, I saw a story a bit back of someone saving input tokens by feeding the bot an image of a wall of text rather than the text itself and having it read the image via OCR.
Satire and reality are too hard too distinguish these days.
I see this one all the time on LinkedIn, the management rubes love it
Saves input tokens and uses more output because of OCR, and output is priced way higher.
It's an accounting trick. It uses a different budget....
Also if you're doing anything multi-prompt, that output is re-used as (luckily cached) input tokens for the next prompt anyway lol
I mean, back in my days (👴) people sent a photo pasted into a word document, so things haven't change that much...
They still do
this is the default compaction method in omp now. afaik it's exploiting the pricing structure of the big providers more than anything