ST Alpha - ""or else!" -- nm" (Reading a Post)

SlickerTalk
Search Archives
The Leaderboard
The FAQ

Login
Create Account

Search Dr. S. Talk
TT/ST Wiki
How Well Do You Know ...

RSS Feed

Hosting by DigitalOcean

Support ST on Ko-Fi

Down to Post

Backboards:

Posts: 157

In response to "ST has a robots file that tells all above-board search engines not to add it to their database. It's a little bit dark-web, in a sense. -- nm" by Graveman ⚰️💀

"or else!" -- nm

Posted by code (aka Max) Oct 28 '20, 19:44

(No message)

Responses:

/robots.txt is the standard file for issuing orders to robots (website crawlers, spiders, search engines, etc) -- nm - Graveman ⚰️💀 Oct 28, 19:48 1
- But if they are below-board, they can ignore it. This wouldn't be done by a legitimate one (barring a misconfiguration), but it could be done by - Graveman ⚰️💀 Oct 28, 19:50

Post a message top

Replies are disabled on threads older than 7 days.