169
you are viewing a single comment's thread
view the rest of the comments
[-] confusedpuppy@lemmy.dbzer0.com 10 points 1 week ago

I found that using a wildcard domain cert for HTTPS and an uncommon higher port number works just fine to avoid crawlers and scrapers. I also hide my ssh port behind WireGuard because I got annoyed with the bots filling up my logs with failed attempts. I've been doing that for nearly a year now and I have had no more issues with bots

I'm going off the assumption that the people who run crawlers and scrapers are going for known common ports for quick ease of access

I don't feel the need to run anything extra such as Anubis either. The inconvenience of using an uncommon higher port number has been minimal and I still get to enjoy my tiny corner of the internet

[-] teolan@lemmy.world 2 points 1 week ago

Higher port? I suppose you just run things for yourself and never share them on the public internet then.

[-] confusedpuppy@lemmy.dbzer0.com 4 points 1 week ago

I share my site with only with people I know personally and they don't seem to have any issue accessing my site

They don't seem too bothered adding :8000 to the address. Also they are usually connecting at home or on their phone and are not frequently visiting it so the inconveniences are minimal

[-] teolan@lemmy.world 2 points 1 week ago

Most people getting hammered by bots are running public facing websites. There a custom port is suspicious as heck.

A limited access service like yours is better served by a VPS or a simple login before everything.

[-] confusedpuppy@lemmy.dbzer0.com 5 points 1 week ago

I don't understand how it's suspicious if I am sharing my address with a custom port to people I know. I even take time to explain why I do it and in a way a nontechnical person would understand

The connection is still encrypted because I have a proper domain cert. There's no warning or any other issue. I have spent more time securing my hardware/operating system/software than anything else, often taking priority over hosting more services

Do I really need to take all these extra steps like a VPS or a login for a basic blog generated from markdown files and a basic file server that has copies of my git repositories? Seems excessive when I already found a solution for myself that takes less effort and works to my satisfaction

I think there's value in experimenting outside the current set standards and norms. Especially since corporations and states are obviously abusing the trust of these standards and norms for their own personal benefit

I personally feel like a small web/indie web can find their own their place again on the internet with a little creativity and a will to break away from the current norms. Trying to do more of the same will eventually lead to issues like burnout or ever growing frustration

I'm doing this for fun and for myself above all else. Experimenting with different, low effort approaches to the crawler/scraper issue is fun for me. Involving more outside services or adding more internal software does not sound like fun to me. It doesn't sound like much fun for other people in this thread or by the original blog post either

this post was submitted on 08 Nov 2026
169 points (98.3% liked)

Selfhosted

63989 readers
1280 users here now

A place to share alternatives to popular online services that can be self-hosted without giving up privacy or locking you into a service you don't control.

Rules:

Detailed Rules Post

  1. Be civil.

  2. No spam.

  3. Posts are to be related to self-hosting.

  4. Don't duplicate the full text of your blog or readme if you're providing a link.

  5. Submission headline should match the article title.

  6. No trolling.

  7. Promotion posts require active participation, with an account that is at least 30 days old. F/LOSS without a paywall has exceptions, with requirements. See the rules link for details. Tags [CBH] or [AIP] are required, see the links in Rule 8 for details.

  8. AI-related discussions and AI-involved promotional posts have additional requirements for tagging, as noted in Rule 7 and the AI & Promotional Post Expanded Rules post, and find example disclosures here.

Resources:

Any issues on the community? Report it using the report flag.

Questions? DM the mods!

founded 3 years ago
MODERATORS