Simple Django middleware to send the X-Robots-Tag
header to all URLs. Useful for ensuring a site in development is not accidentally picked up and indexed until it is ready.
From pypi:
$ pip install django-x-robots-tag-middleware
-
Add
"x_robots_middleware.XRobotsMiddleware",
to your middleware list in settings.py. -
Add
X_ROBOTS_TAG = ["noindex", "nofollow"]
to your settings.py with the values you want for the X_ROBOTS_TAG.
Details about the values for the tag and what they do can be found in the Google Documentation.