this post was submitted on 21 Jun 2023
710 points (100.0% liked)
Reddit Migration
37 readers
2 users here now
### About Community Tracking and helping #redditmigration to Kbin and the Fediverse. Say hello to the decentralized and open future. To see latest reeddit blackout info, see here: https://reddark.untone.uk/
founded 1 year ago
you are viewing a single comment's thread
view the rest of the comments
view the rest of the comments
There are characters that have two or three combining diacritic marks already included, so if you start with one of those, it'll make it harder to filter out.
That's what the normalizer is for. Normalize to NFD, strip combiners, map homoglyphs to ASCII, and look for ASCII “fuck spez”.