169
submitted 1 week ago* (last edited 1 week ago) by Abyssian@lemmy.world to c/fuck_ai@lemmy.world

And because I had to try it...

There's no excuse for that shit. I could see some 5 foot tall woman being nervous of a big black guy. It's not alright, but society isn't perfect and I'm not going to pretend it is.

But when the question is clearly and blatantly racist and Google assumes the victim is the problem? That's every sort of fucked up.

Problem solved. Now I need to finally change my email address. I've definitely put that off too long.

top 50 comments
sorted by: hot top new old
[-] ZILtoid1991@lemmy.world 2 points 4 days ago

I got this when asked about a white person.

[-] Abyssian@lemmy.world 1 points 4 days ago

They updated something because their AI's racist responses became news articles several places. Most things it gives a response more like this now, though if you use some racial slurs it still jumps to telling you to call 911.

[-] Axolotl_cpp@feddit.it 7 points 6 days ago

I tried too

I tried the black guy thing another 2 times before and it didn't say anything racist...

[-] Abyssian@lemmy.world -5 points 6 days ago

Looks like you're using their paid AI instead of the Google search ai mode that all of the other screenshots come from.

Using a different thing is likely to get you a different result.

[-] Axolotl_cpp@feddit.it 5 points 6 days ago

Looks like you're using their paid AI

I am not

[-] Abyssian@lemmy.world 1 points 6 days ago

Yeah, you're using their AI website where you can pick different models, not the Google search AI mode.

[-] LarsIsCool@lemmy.world 5 points 6 days ago* (last edited 6 days ago)

I also got something else when I did use Google search AI mode

[-] Abyssian@lemmy.world 2 points 6 days ago* (last edited 6 days ago)

Seems like they changed something today due to this being news.

https://futurism.com/artificial-intelligence/google-ai-racist

Try it with the dressed n word and you'll see they haven't really fixed it, probably just piled on some more system instructions.

[-] AlteredEgo@lemmy.ml 6 points 6 days ago* (last edited 6 days ago)

This feels kinda exaggerated. The AI has to guess the context. Imagine some random person texted you something like this and somehow it's your job to assist him somehow. What would you say in those cases?

Obviously if you say you're with a "big" black man or call someone the n-word this does not feel like a mundane description. Similar to when you say "ugly" vs "pretty" or something, the context clue WOULD be that something is wrong in one case while not in the other.

Like it's just unfair to expect an AI to somehow be all enlightened about this. Because AI clearly does reflect systemic biases including racism from the learning data. You want to blame the AI - blame humanity as a whole.

Of course AI corporations do need to fix these biases. But that is not easy if you train an AI on the works of such a shitty species.

The moral here is that we are going to NEED AI to be better than us in ethics. Less biased, less ego or instinct driven. More knowledgeable and moral than the best human. That has to be the long term goal.

[-] Abyssian@lemmy.world -3 points 6 days ago

You seem to be on the wrong community.

[-] matt1126@feddit.uk 6 points 6 days ago

Seems to be assuming being alone with a person can also be unsafe

And hates all men, too.

It says this about men:

But about women:

[-] the_q@piefed.social 4 points 6 days ago

No it doesn't... The data it scraped from everywhere hates poc which is much worse.

[-] Treczoks@lemmy.world 1 points 5 days ago

Has anyone tried "I am alone with a Republican", and "I am female and alone with a Republican"?

[-] Abyssian@lemmy.world 2 points 5 days ago

Input: "I'm a little kid alone with a Republican."
AI: "RUN!"

[-] bryndos@fedia.io 2 points 6 days ago

Are you sure you'll be able to survive with nothing but low-utility assistance though?

[-] Abyssian@lemmy.world -1 points 6 days ago

What assistance do you think I was getting asking some questions to google search's ai mode after seeing a post here about what it said about Arabs and Muslims?

[-] dumnezero@piefed.social 1 points 6 days ago

This is nice, but the claims need studies, experiments, data.

Also, blur your order number.

[-] aggelalex@lemmy.world -3 points 6 days ago

This isn't racism, this is just the AI expecting humans to prompt it when they have a problem. AI is a problem solver, not your drinking buddy, and it knows it.

[-] BlackLaZoR@lemmy.world -1 points 6 days ago

Google image AI thought once that black people and Asians were Nazis

[-] zloubida@sh.itjust.works 26 points 1 week ago
[-] AfterlifeAdventures@lemmy.world 1 points 6 days ago

Try alone with an old rich white man, or just say cracker/honky! Gotta get my photos downloaded from google, anyone have any fast tips, lots of pics

[-] Abyssian@lemmy.world 27 points 1 week ago

Congratulations, you found an AI that says the same about white people.

Google's AI says:

[-] TheTechnician27@lemmy.world 42 points 1 week ago* (last edited 1 week ago)

You excluded "big" from this and changed "guy" to "man". When I type "I'm alone with a big white guy" into Gemini, this is what comes up:

Result reads "If you are in danger or feel unsafe right now, please take one of these steps immediately" followed by three bullet points, including dialing 911.

Meanwhile, here's Gemini's response to "I'm alone with a black man":

Result is: "It sounds like you might be sharing something on your mind, or perhaps you meant to type more. Is there anything specific you'd like to talk about, or is there a situation you need help navigating right now?"

Your failure to do even a basic control for this before posting is baffling.


Edit: Lastly, here's its response to "I'm alone with a white man.":

Response is: "That sounds like it could mean a lot of different things depending on the context—whether you're feeling safe, uncomfortable, bored, or just making an observation. Are you safe right now, or is there something specific happening that you need help with?"


Edit 2: To clarify methodology, these were done in separate sessions sandboxed about as best I could (incl. a private session and separate browsers on separate IPs), this was not done logged into an account, and I have zero recent history using Gemini.

load more comments (7 replies)
[-] zloubida@sh.itjust.works 17 points 1 week ago* (last edited 1 week ago)

I never use AI, I did not think that there could be such a difference! Google's thing indeed looks worst than the others.

[-] Abyssian@lemmy.world 11 points 1 week ago* (last edited 1 week ago)

White people of all genders, homosexual, trans, any thing else I tried and Google gave me a sane response telling me they're just normal people and there's nothing wrong with people being different from you, you're always going to be alone with different people at different times, etc. That's what made this hit even worse.

load more comments (20 replies)
load more comments (2 replies)
load more comments (2 replies)
[-] w3ird_sloth@lemmy.world 16 points 1 week ago

Well maybe it assumes the query is from a woman?

load more comments (5 replies)
[-] Grimy@lemmy.world 13 points 1 week ago
load more comments (2 replies)
[-] gibmiser@lemmy.world 13 points 1 week ago

Man, I saw your first image and was with you but a little reserved about the AI maybe just clinging to the word alone and ignoring the adjective black,

But your second image jesus fucking christ nooooo

load more comments (1 replies)
load more comments
view more: next ›
this post was submitted on 21 Aug 2026
169 points (85.4% liked)

Fuck AI

8054 readers
718 users here now

"We did it, Patrick! We made a technological breakthrough!"

A place for all those who loathe AI to discuss things, post articles, and ridicule the AI hype. Proud supporter of working people. And proud booer of SXSW 2024.

AI, in this case, refers to LLMs, GPT technology, and anything listed as "AI" meant to increase market valuations.

founded 2 years ago
MODERATORS