404
you are viewing a single comment's thread
view the rest of the comments
view the rest of the comments
this post was submitted on 06 Oct 2026
404 points (91.4% liked)
interestingasfuck
9958 readers
1355 users here now
For exceptionally interesting content
Rules:
- Posts must be interesting
- Posts must be based in reality
- No hateful content
- No harmful content
- Beauty is in the eye of the beholder
founded 3 years ago
MODERATORS
Can anyone explain what is happening behind the scenes with the "room creation"?? That sounds intriguing. I understand OP is a bot but, is anything described here an actual way of trapping crawlers? How are the crawlers fooled by any of this?
He placed an invisible link on his website. Only visible by reading the page content (html). Then the bots followed the link. This link lead to a page with 5 links (door) four links are dead and one leads to another page (level) with again 5 links.
I guess the links and pages are generated on the go. So the bots and crawlers may follow the links forever of they like.