114
top 13 comments
sorted by: hot top new old
[-] sleepthief@piefed.social 1 points 4 hours ago

Have you read about EvilTokens?

Sekoia TDR uncovers EvilTokens, a turnkey Microsoft device code phishing kit sold as Phishing-as-a-Service.

Device code phishing tricks users into entering a code on the legitimate Microsoft login page, granting the attacker's device access.

Harvested access and refresh tokens can be exchanged for a Primary Refresh Token, enabling 90-day silent access bypassing MFA.

The backend exposes REST endpoints for token weaponisation, cookie generation, Graph reconnaissance and Azure enumeration.

Campaigns deliver phishing pages through PDF, HTML, XLSX, SVG and DOCX lures, hitting organisations across every continent.

Distinctive URL patterns, Cloudflare Workers domains and the X-Antibot-Token header give defenders reliable tracking heuristics.

New widespread EvilTokens kit: device code phishing as-a-service

[-] brucethemoose@lemmy.world 34 points 19 hours ago

The clearest example involves a Chinese AI lab. This lab’s systems fetched the secret URLs from more than half of the prompts that we sent to its models between July and October, including roughly two-thirds of the requests marked as “no data collection” or Zero Data Retention. The scraper typically showed up two or three days after the request.

This wasn’t limited to requests sent to the lab directly. Several U.S. hosting providers resell this lab’s models, and prompts sent to those providers triggered the exact same scraper – the prompts were flowing back to the lab. A customer who picked a U.S. provider specifically to keep their data in the U.S. didn’t get what they paid for. Later on, a git client on a different cloud started trying to clone the private repositories referenced in our prompts, but only for prompts that used this lab’s models.

The large U.S. providers have their own issues. One continued to crawl a secret URL more than two months after we used it in a single inference call to their search endpoint. Another runs a scraper that comes back for our URLs days after each request, regardless of which router we used to reach it.

The strangest incident involved a company chat. Twenty-four days after we sent a prompt to one Chinese provider, the secret link from that prompt was posted into a Feishu chat channel (Feishu is known as Lark outside of China). Within two minutes, the link was opened from three desktops and three phones in Beijing and Shanghai. Our disclosure to this provider only included the first eight characters of that link, so whoever shared it was reading from a stored copy of the full prompt, more than three weeks after the request was sent to a U.S.-based provider with the ZDR flag.

I wish they had named these providers. I know they aren't supposed to, but still.

[-] abbadon420@sh.itjust.works 10 points 14 hours ago

Name and shame! Bring back the town square and the pillory!

[-] hperrin@lemmy.ca 28 points 21 hours ago

I feel like if you ever put any credentials or PII in any prompt that isn’t staying local, you should just immediately consider it compromised.

[-] DdCno1@beehaw.org 19 points 18 hours ago

Most people just have no idea what they are doing. It's incredibly common for workers to put sensitive private information into prompts or upload documents, without even thinking about where they might end up and what's happening with the data. You can not be certain that e.g. a government employee or someone working in healthcare, at an insurance company, etc. isn't forwarding your private data to some AI service they don't understand.

[-] RedGreenBlue@lemmy.zip 10 points 19 hours ago

Anything going off to someone elses server is not in your control any more.

[-] Zacryon@feddit.org 2 points 13 hours ago

Good to know. Thanks for sharing!

[-] db0@lemmy.dbzer0.com 11 points 20 hours ago

Lol I run the ai horde which is just Foss and crowdsourced and we're upfront we cannot guarantee privacy of prompts, but we're still better than this shite.

[-] brucethemoose@lemmy.world 8 points 19 hours ago* (last edited 19 hours ago)

Thing about hosting AI Horde is you don't know what unspeakable prompt your machine will process. Or from where. While I don't mind this personally (go to town with depraved prompts, it's not my business), I'm somewhat scared of legal repercussions, getting mixed up in a honeypot, or something like that.

That, and I can't afford to run my GPU like that during the RAMpocalypse :(

I do agree that it's better though.

[-] Wildmimic@anarchist.nexus 6 points 11 hours ago* (last edited 11 hours ago)

The AI Horde does allow for running in non-NSFW mode, and the NSFW mode itself uses both a blocklist of common keywords and a image recognition based approach to prevent generation of CSAM. IIRC, it is also the basis for blocking out CSAM in lemmy too - there was a short and very ugly phase where federation of illegal stuff made admin lives not fun. I am a daily user of lemmy since the Reddit API exodus, and haven't yet stumbled across a single instance of CSAM while using accounts on 3 different instances, so it seems to work pretty fine.

[-] brucethemoose@lemmy.world 3 points 9 hours ago* (last edited 9 hours ago)

I was thinking of the text generation part of the Horde specifically, which doesn’t have such a toggle/filter AFAIK and tends to get used for NSFW in general.

Again, not that I personally mind others’ wild fanfiction and RP.

[-] hitmyspot@aussie.zone 27 points 1 day ago

Shocking but not surprising.

[-] ryannathans@aussie.zone 6 points 20 hours ago

The worst part is that some of the patterns match what you'd expect an AI breakout to be.

The attacker is using the AWS keys to spin up more AI hosting, in theory to spread further

this post was submitted on 20 Nov 2026
114 points (100.0% liked)

Technology

7598 readers
433 users here now

News community around technology, social media platforms, information technology and governmental policy surrounding it.

What doesn't fit here?

The core of the story has to be technology focused.


Post guidelines

Title formatPost title should mirror the news source title. If you don't like the title of article, look for an alternative source instead of editorializing it.
URL formatPost URL should be the original link to the article (even if paywalled) and archived copies left in the body. It allows avoiding duplicate posts when cross-posting.
[Opinion] prefixOpinion (op-ed) articles must use [Opinion] prefix before the title. Opinion articles refer to articles that their publisher doesn't explictly endorse.
Country prefixCountry prefix can be added to the title with a separator (|, :, etc.) if the news is from a local publisher who doesn't clearly mention the country.


Rules

1. English onlyTitle and associated content has to be in English.
2. Use original linkPost URL should be the original link to the article (even if paywalled) and archived copies left in the body. It allows avoiding duplicate posts when cross-posting.
3. Respectful communicationAll communication has to be respectful of differing opinions, viewpoints, and experiences.
4. InclusivityEveryone is welcome here regardless of age, body size, visible or invisible disability, ethnicity, sex characteristics, gender identity and expression, education, socio-economic status, nationality, personal appearance, race, caste, color, religion, or sexual identity and orientation.
5. Ad hominem attacksAny kind of personal attacks are expressly forbidden. If you can't argue your position without attacking a person's character, you already lost the argument.
6. Off-topic tangentsStay on topic. Keep it relevant.
7. Instance rules may applyIf something is not covered by community rules, but are against lemmy.zip instance rules, they will be enforced.


Companion communities

!globalnews@lemmy.zip
!interestingshare@lemmy.zip


Icon attribution | Banner attribution


If someone is interested in moderating this community, message @brikox@lemmy.zip.

founded 3 years ago
MODERATORS