68
How to stop being overly dependent on AI
(lemmy.world)
"We did it, Patrick! We made a technological breakthrough!"
A place for all those who loathe AI to discuss things, post articles, and ridicule the AI hype. Proud supporter of working people. And proud booer of SXSW 2024.
AI, in this case, refers to LLMs, GPT technology, and anything listed as "AI" meant to increase market valuations.
One thing I should have clarified. If you play with mikupad, you have to use an LLM API (or local LLM engine) that serves the old Completions API. With logprobs.
This is "raw" LLM access without any chat formatting, and its full output before sampling.
If you use OpenAI, Claude, or most other big providers, you are stuck with Chat APIs without logprobs, so it kinda defeats the point.
Honestly, I don't know of any API providers that offer this, but some role play focused ones might. Local inference engines (which are what I use) mostly have the raw API, but you need a pretty beefy computer for this.