The answer to your question is, it depends on your expectations. The tradeoff of a typical no VRAM machine is latency and quality.

My progression:

• I decided to try ollama and ran a small model on 8G RAM on a VPS. Slow but it worked. Ran an 3B parameter models -- slowly. Struggled with 8B models. Problems with hallucinations from these small models. This was my induction into self hosting llms.
• Installed similar setup on a SFF desktop with 16G RAM. Ran 8B models slowly. More capability, but still below the threshold I was looking for. Open WebUI + ollama worked but still too slow.
• Acquired a 16G VRAM card and installed in an old desktop with 16G RAM. This runs 12B models and crosses the threshold, in my opinion, of usability as an assistant. This setup runs Open WebUI, again reinforcing usability.
• Am I satisfied? No. I'd like bigger, faster meaning more VRAM, on a newer platform, but content enough now to continue experimenting with what I have.

In sum: Don't expect low laitency multi-step reasoning/planning with a low resource / no VRAM machine. Anything close to what you can get online at reasonable speeds requires ample VRAM.

For a reality check .. I did a quick run on those three machines as they are still active. What follows has been synthesized through a cloud based model from real data:

same prompt, three machines

Prompt: "Explain how a hash table works, including collisions, in about 250 words."
Run once on each machine with ollama run <model> --verbose, all Q4_K_M quantization.

What stood out

• The GPU box generated about 4-5x faster than the SFF while running a model roughly 3x bigger.
• Both CPU-only machines landed at 5-7 t/s. Usable, but slow for interactive chat.
• Turning thinking off on the 12B cut total time from 38s to 11.5s with no change in speed (~31 t/s) and no drop in answer quality on this prompt. Thinking would likely matter more for math, code, or multi-step problems, which this test doesn't cover.
• The 12B had no factual slips. The smaller models made small conceptual errors (blurring hash code vs. index, calling the whole array a "bucket") and one skipped lookup entirely.
• All of them left out worst-case O(n) behavior and resizing.

Caveats

• Different models on each machine, so this shows what each box can run well, not identical hardware running identical software.
• The thinking-on run generated about 1,180 tokens versus about 350 with thinking off, so compare tokens/sec rather than total time across those two rows.
• Quality scores are my rough 1-5 ratings on accuracy, length, completeness and cleanliness, with an LLM's help, from one run each at temperature 1. Treat them as anecdotal, not a benchmark.
• gemma3n is listed by Ollama as 6.9B, but it uses an "effective parameter" design (Google calls it E4B, roughly 4B in practice), so it's lighter than a dense 7B. That's why it ran on the 8 GB VPS where a standard 8B struggled.

Why does this board smell like burnt fingers?

Choices.

Why isnt their a minimum set of knowledge, skills, or abilities? .. In the cronyistic world of politics today this would absolutely get abused. Imagine the redistricting fight brought to resumes for office.

My ramble on this topic:

Politicians should be of the people elected by the people to serve in the people's best interest. Being a constitutional republic / representative democracy, in the U.S. politicians can act without full consensus while remaining accountable to the electorate. That's the ideal anyway

The real question here is about who gets elevated within each party to be on the ballot. Which occurs through systems that are outside of the electoral process -- and often beyond the reach of people who only participate by voting

So then how do normal, centric folks have a chance to get on the ballot, then have any chance of being effective without having to immediately give into the extreme partisan culture? That's the question I see here.

We need centric leaders with diversity of opinion.

US Constitution citations:

House of Representatives: (Article I, Section 2, Clause 2): Person shall be a Representative who shall not have attained to the Age of twenty five Years, and been seven Years a Citizen of the United States, and who shall not, when elected, be an Inhabitant of that State in which he shall be chosen.

Senate (Article I, Section 3, Clause 3): No Person shall be a Senator who shall not have attained to the Age of thirty Years, and been nine Years a Citizen of the United States, and who shall not, when elected, be an Inhabitant of that State for which he shall be chosen.

In the U.S. timezones were developed by the railroads before being written into law to keep the train traffic moving. I think they even called it railroad time. Back in the day when the big clock in town meant something ... Imagine everyone setting 12:00 (noon) or 'high noon' with the sun directly overhead! There was no standard time nor timezones before we began traveling faster than the sun.

The answer is 'it depends' How long do you expect to live and what do you expect to do in retirement. The answer for a 30 y.o. is much different than that of a 65 y.o.

Patterson-Gimlin-Film maybe. I see this image everywhere!