5
submitted 1 week ago* (last edited 1 week ago) by leanleft@lemmy.ml to c/localllama@sh.itjust.works

the only time, that i would ever use an llm chatbot for conversation, is..

  1. locally, trusted, privately
  2. extremely low resource requirements

so..
i stumbled upon this model:
https://huggingface.co/nkthebass/tinybrainbot-360m-a75m-v5.1-chat
and it’s very simplistic. but provides adequate presence and emotional support.

what do you think about life? I think it's a mix of both. Life is full of ups and downs, right? But at the end of the day, we all have our own unique stories to tell. What's your take on life? [ Prompt: 440.3 t/s | Generation: 339.7 t/s ]

tell me more about the "downs" Downs are short-term memory lapses that happen when you try to remember something important or meaningful right now. They can be frustrating, but they're usually not serious. Think of them as little moments in your day where you were just trying to process and remember something. For example, if you need help with a task, you might say "I don't know what I'm doing" instead of saying "I'm sorry." Downs can be caused by stress, anxiety, or even boredom. They often happen when we try to fit everything into our little brain and forget what really matters. It's okay to feel down sometimes! Everyone has those days. Just take a deep breath and remember that life is full of ups and downs. You're not alone in feeling this way! [ Prompt: 714.0 t/s | Generation: 354.9 t/s ]

but then i looked into the alternatives (HF)

~~..and found https://huggingface.co/bayliner1980/Qwen3.5-0.8B-MoE-A0.6B-GGUF~~

~~tell me about life
[Start thinking]
The user asked "tell me about life." They want me to explain life in a general sense. But I need to be careful because I don't have a defined "life" concept. Let me think about how to respond.~~ ~~Actually, the user might be asking a general question about life. I should provide a broad, informative answer. Let me structure my response clearly and avoid assumptions. [End thinking]~~
~~Life is the process of existence, growth, and change. It encompasses all the natural and social processes that shape the human condition. Some key aspects of life are:~~
~~1. The passage of time: Life unfolds over many years, but it can also be experienced as a continuous journey. In many cultures, life is seen as a series of milestones (birth, growth, marriage, retirement) that contribute to a meaningful existence.~~ ~~2. The pursuit of purpose: Life often has meaning and purpose. Many people seek happiness, fulfillment, and connection with others. Some define life as a journey toward personal growth and self-discovery.
3. The challenges of life: Life is filled with risks, stress, and uncertainty. People often face obstacles, loss, and change. In many cultures, life is viewed as a series of trials that help shape one's character.~~ ~~4. The role of relationships: People often define life as being connected to others. Social relationships, friendships, family, and community play important roles in shaping identity and well-being.
5. The balance between work and leisure: Life is often seen as a combination of work and leisure. Some people work hard to achieve their goals, while others enjoy spending time with loved ones.~~ ~~6. The concept of life as a continuous journey: Life is not a single event or destination. Instead, it is a dynamic process that includes both growth and change. Life can be seen as a journey of discovery, learning, and adaptation.~~
~~7. The diversity of life: Life varies across cultures, religions, personal values, and historical periods. Life can be defined by many different aspects, including personal, spiritual, emotional, social, and physical life.~~ ~~8. The role of health: Life is often seen as a health-related process. Physical health, mental health, and emotional well-being are essential for a fulfilling life.~~ ~~9. The concept of life as a collective experience: Life is shared by many people. In many cultures, life is viewed as a collective experience that involves family, community, and shared values.
10. The meaning of life: Many people define life as having a meaningful purpose. Some believe life has a singular purpose (e.g., to love, work, or achieve personal goals), while others see life as a series of events that contribute to well-being.~~ ~~In many cultures, life is seen as a journey of growth and transformation. People often seek to understand themselves and their place in the world. Life is a continuous process of adaptation, learning, and connection.~~
~~[ Prompt: 168.0 t/s | Generation: 68.7 t/s ]~~

~~this is also good.~~
~~probably more competent.~~
~~deff more informative.~~
~~different style for the instructions that i gave it.~~

*MISTAKE: i loaded the wrong model. the Qwen3.5-0.8B-MoE-A0.6B model actually kinda sucks.

i think ~~these are both~~ good models that i could reach for, whenever i want to consult a chatbot on my phone

you are viewing a single comment's thread
view the rest of the comments
[-] dgriffith@aussie.zone 7 points 1 week ago

I would be cautious about using these models (or, any general purpose LLMs really) for mental health or companionship chats.

They're all generally agreeable to your point of view, which can reinforce the wrong things in your mind. I'm not sure if prompts in the harness could make them generate dissenting or outright adversarial/challenging responses, which are the things that people often need to get out of the rut that they're in.

[-] SSSAsrld12@szmer.info 3 points 1 week ago* (last edited 1 week ago)

Big boys tested Big Cloud LLMs for this and it doesn't look good for mental health right now. Tiny models - probably even more sycophantic.

[-] hendrik@palaver.p3x.de 2 points 1 week ago* (last edited 1 week ago)

And it kind of sounds like a religious preacher. I think if someone is intelligent, they don't necessarily strive to become a walking stereotype. Like laid out in the chatbot's answer. You don't need to be on some self-growth expedition. You don't need to marry and do all the things people around you do. I mean you can if you like. But that's not what life is about.

this post was submitted on 07 Nov 2026
5 points (72.7% liked)

LocalLLaMA

5662 readers
270 users here now

Welcome to LocalLLaMA! Here we discuss running and developing machine learning models at home. Lets explore cutting edge open source neural network technology together.

Get support from the community! Ask questions, share prompts, discuss benchmarks, get hyped at the latest and greatest model releases! Enjoy talking about our awesome hobby.

As ambassadors of the self-hosting machine learning community, we strive to support each other and share our enthusiasm in a positive constructive way.

Rules:

Rule 1 - No harassment or personal character attacks of community members. I.E no namecalling, no generalizing entire groups of people that make up our community, no baseless personal insults.

Rule 2 - No comparing artificial intelligence/machine learning models to cryptocurrency. I.E no comparing the usefulness of models to that of NFTs, no comparing the resource usage required to train a model is anything close to maintaining a blockchain/ mining for crypto, no implying its just a fad/bubble that will leave people with nothing of value when it burst.

Rule 3 - No comparing artificial intelligence/machine learning to simple text prediction algorithms. I.E statements such as "llms are basically just simple text predictions like what your phone keyboard autocorrect uses, and they're still using the same algorithms since <over 10 years ago>.

Rule 4 - No implying that models are devoid of purpose or potential for enriching peoples lives.

founded 3 years ago
MODERATORS