Managing /robots.txt #211

Closed
opened 2025-11-02 03:14:02 -06:00 by GiteaMirror · 4 comments
Owner

Originally created by @sztanpet on GitHub (Jan 9, 2017).

My use-case is simply to hide gitea from well-behaved search engines but still expose it on the internet.
Not sure how fine-grained it would need to be, but for my use-case I simply need to deny everything to everyone.

Originally created by @sztanpet on GitHub (Jan 9, 2017). My use-case is simply to hide gitea from well-behaved search engines but still expose it on the internet. Not sure how fine-grained it would need to be, but for my use-case I simply need to deny everything to everyone.
GiteaMirror added the issue/not-a-bug label 2025-11-02 03:14:02 -06:00
Author
Owner

@metalmatze commented on GitHub (Jan 9, 2017):

If you're running gitea behind a proxy you might be able to serve a /robots.txt right now. But maybe we should add it to gitea itself.

@metalmatze commented on GitHub (Jan 9, 2017): If you're running gitea behind a proxy you might be able to serve a `/robots.txt` right now. But maybe we should add it to gitea itself.
Author
Owner

@sztanpet commented on GitHub (Jan 9, 2017):

Indeed, if there is a robots.txt in the custom path, gitea will serve that file, so maybe this just needs documentation?

@sztanpet commented on GitHub (Jan 9, 2017): Indeed, if there is a robots.txt in the custom path, gitea will serve that file, so maybe this just needs documentation?
Author
Owner

@tboerger commented on GitHub (Jan 9, 2017):

Please file an issue or a pull request on the docs repo. For this repo it's invalid because it's already implemented.

@tboerger commented on GitHub (Jan 9, 2017): Please file an issue or a pull request on the docs repo. For this repo it's invalid because it's already implemented.
Author
Owner

@tboerger commented on GitHub (Jan 9, 2017):

Just to make it clear, you can place a robots.txt into the custom/ folder, restart gitea and this file will get served

@tboerger commented on GitHub (Jan 9, 2017): Just to make it clear, you can place a robots.txt into the custom/ folder, restart gitea and this file will get served
Sign in to join this conversation.
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: github-starred/gitea#211