robots_dot_txt
Differences
This shows you the differences between two versions of the page.
| Both sides previous revisionPrevious revision | |||
| robots_dot_txt [2025/10/06 16:41] – [robots.txt is voluntary for a reason] 1gn15 | robots_dot_txt [2025/10/07 04:13] (current) – 1gn15 | ||
|---|---|---|---|
| Line 1: | Line 1: | ||
| ====== robots.txt ====== | ====== robots.txt ====== | ||
| - | ===== robots.txt | + | ===== robots.txt |
| robots.txt is not there as a privacy measure. It is not there to protect intellectual property. And it's certainly not there for you to spout your anti-robot bigotry. | robots.txt is not there as a privacy measure. It is not there to protect intellectual property. And it's certainly not there for you to spout your anti-robot bigotry. | ||
| Line 10: | Line 10: | ||
| If you want privacy, avoid publishing things publicly. The internet never forgets. Keep things private. Use end-to-end encryption while you're at it (with trusted friends, so it doesn' | If you want privacy, avoid publishing things publicly. The internet never forgets. Keep things private. Use end-to-end encryption while you're at it (with trusted friends, so it doesn' | ||
| - | ===== CloudFlare | + | |
| + | ===== CloudFlare | ||
| What the hell is any of this? | What the hell is any of this? | ||
robots_dot_txt.txt · Last modified: by 1gn15